[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:17:19.000522 11916 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.163.62:41373
I20260709 12:17:19.002173 11916 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:17:19.003304 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:19.021067 11925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:19.021085 11922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:19.021153 11923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:20.248414 11924 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:17:20.248555 11916 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:17:20.253069 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:20.253336 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:20.253562 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599440253539 us; error 0 us; skew 500 ppm
I20260709 12:17:20.254415 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:20.261076 11916 webserver.cc:533] Webserver started at http://127.11.163.62:40209/ using document root <none> and password file <none>
I20260709 12:17:20.261981 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:20.262230 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:20.262699 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:20.268776 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/master-0-root/instance:
uuid: "b87ace67a6424f549f594eb7370ed9d1"
format_stamp: "Formatted at 2026-07-09 12:17:20 on dist-test-slave-z9f9"
I20260709 12:17:20.276839 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:17:20.282351 11931 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:20.283707 11916 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:17:20.284121 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/master-0-root
uuid: "b87ace67a6424f549f594eb7370ed9d1"
format_stamp: "Formatted at 2026-07-09 12:17:20 on dist-test-slave-z9f9"
I20260709 12:17:20.284493 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:20.336782 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:20.338475 11916 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:17:20.338964 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:20.412150 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.62:41373
I20260709 12:17:20.412214 11982 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.62:41373 every 8 connection(s)
I20260709 12:17:20.420564 11983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:20.444528 11983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1: Bootstrap starting.
I20260709 12:17:20.450484 11983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:20.452418 11983 log.cc:826] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1: Log is configured to *not* fsync() on all Append() calls
I20260709 12:17:20.457122 11983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1: No bootstrap required, opened a new log
I20260709 12:17:20.477921 11983 raft_consensus.cc:359] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87ace67a6424f549f594eb7370ed9d1" member_type: VOTER }
I20260709 12:17:20.478461 11983 raft_consensus.cc:385] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:20.478670 11983 raft_consensus.cc:740] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87ace67a6424f549f594eb7370ed9d1, State: Initialized, Role: FOLLOWER
I20260709 12:17:20.479614 11983 consensus_queue.cc:260] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87ace67a6424f549f594eb7370ed9d1" member_type: VOTER }
I20260709 12:17:20.480091 11983 raft_consensus.cc:399] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:20.480329 11983 raft_consensus.cc:493] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:20.480732 11983 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.484896 11983 raft_consensus.cc:515] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87ace67a6424f549f594eb7370ed9d1" member_type: VOTER }
I20260709 12:17:20.485585 11983 leader_election.cc:304] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b87ace67a6424f549f594eb7370ed9d1; no voters: 
I20260709 12:17:20.487234 11983 leader_election.cc:290] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:20.487603 11986 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:20.490366 11986 raft_consensus.cc:697] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [term 1 LEADER]: Becoming Leader. State: Replica: b87ace67a6424f549f594eb7370ed9d1, State: Running, Role: LEADER
I20260709 12:17:20.491333 11986 consensus_queue.cc:237] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87ace67a6424f549f594eb7370ed9d1" member_type: VOTER }
I20260709 12:17:20.492391 11983 sys_catalog.cc:565] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:20.503185 11988 sys_catalog.cc:455] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b87ace67a6424f549f594eb7370ed9d1. Latest consensus state: current_term: 1 leader_uuid: "b87ace67a6424f549f594eb7370ed9d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87ace67a6424f549f594eb7370ed9d1" member_type: VOTER } }
I20260709 12:17:20.504136 11988 sys_catalog.cc:458] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:20.503170 11987 sys_catalog.cc:455] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b87ace67a6424f549f594eb7370ed9d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87ace67a6424f549f594eb7370ed9d1" member_type: VOTER } }
I20260709 12:17:20.505859 11987 sys_catalog.cc:458] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:20.507555 11996 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:20.521166 11996 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:20.523725 11916 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:20.539301 11996 catalog_manager.cc:1383] Generated new cluster ID: 15b19236a239435587ffaf85d13968e5
I20260709 12:17:20.539651 11996 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:20.566677 11996 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:20.568315 11996 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:20.584345 11996 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1: Generated new TSK 0
I20260709 12:17:20.585425 11996 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:20.654629 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:20.663213 12005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:20.664970 12006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:20.668272 12008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:20.668442 11916 server_base.cc:1061] running on GCE node
I20260709 12:17:20.669246 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:20.669435 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:20.669657 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599440669624 us; error 0 us; skew 500 ppm
I20260709 12:17:20.670295 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:20.674961 11916 webserver.cc:533] Webserver started at http://127.11.163.1:45675/ using document root <none> and password file <none>
I20260709 12:17:20.675608 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:20.675815 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:20.676124 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:20.677266 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-0-root/instance:
uuid: "6e1ec5a9e997487891c58dd73ac305b4"
format_stamp: "Formatted at 2026-07-09 12:17:20 on dist-test-slave-z9f9"
I20260709 12:17:20.683238 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:17:20.687878 12013 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:20.688721 11916 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:17:20.689030 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-0-root
uuid: "6e1ec5a9e997487891c58dd73ac305b4"
format_stamp: "Formatted at 2026-07-09 12:17:20 on dist-test-slave-z9f9"
I20260709 12:17:20.689329 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:20.708889 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:20.710258 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:20.713090 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:20.717681 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:20.717900 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:20.718214 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:20.718364 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:20.828385 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.1:37865
I20260709 12:17:20.828452 12075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.1:37865 every 8 connection(s)
I20260709 12:17:20.836618 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:20.847059 12080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:20.849076 12081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:20.857431 12084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:20.858114 11916 server_base.cc:1061] running on GCE node
I20260709 12:17:20.859413 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:20.859722 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:20.859925 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599440859907 us; error 0 us; skew 500 ppm
I20260709 12:17:20.860743 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:20.863279 12076 heartbeater.cc:344] Connected to a master server at 127.11.163.62:41373
I20260709 12:17:20.863900 12076 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:20.864081 11916 webserver.cc:533] Webserver started at http://127.11.163.2:44801/ using document root <none> and password file <none>
I20260709 12:17:20.864765 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:20.865046 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:20.865106 12076 heartbeater.cc:507] Master 127.11.163.62:41373 requested a full tablet report, sending...
I20260709 12:17:20.865434 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:20.866878 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-1-root/instance:
uuid: "3152286337cd4eee8254979af6c272ec"
format_stamp: "Formatted at 2026-07-09 12:17:20 on dist-test-slave-z9f9"
I20260709 12:17:20.868785 11948 ts_manager.cc:194] Registered new tserver with Master: 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865)
I20260709 12:17:20.871904 11948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50024
I20260709 12:17:20.872810 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:17:20.878559 12088 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:20.879516 11916 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:17:20.879799 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-1-root
uuid: "3152286337cd4eee8254979af6c272ec"
format_stamp: "Formatted at 2026-07-09 12:17:20 on dist-test-slave-z9f9"
I20260709 12:17:20.880079 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:20.897135 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:20.898434 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:20.901098 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:20.904616 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:20.904806 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:20.905122 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:20.905270 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.008090 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.2:40267
I20260709 12:17:21.008219 12150 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.2:40267 every 8 connection(s)
I20260709 12:17:21.017863 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:21.029000 12154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:21.031564 12151 heartbeater.cc:344] Connected to a master server at 127.11.163.62:41373
I20260709 12:17:21.031991 12151 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:21.032966 12151 heartbeater.cc:507] Master 127.11.163.62:41373 requested a full tablet report, sending...
I20260709 12:17:21.035611 11948 ts_manager.cc:194] Registered new tserver with Master: 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:21.037339 11948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50032
W20260709 12:17:21.041286 12155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:21.043872 11916 server_base.cc:1061] running on GCE node
W20260709 12:17:21.045609 12157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:21.046613 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:21.046859 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:21.047041 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599441047021 us; error 0 us; skew 500 ppm
I20260709 12:17:21.047680 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:21.050468 11916 webserver.cc:533] Webserver started at http://127.11.163.3:37591/ using document root <none> and password file <none>
I20260709 12:17:21.050942 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:21.051155 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:21.051461 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:21.052498 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-2-root/instance:
uuid: "0e8199ed094d4061babcd1736d42ae84"
format_stamp: "Formatted at 2026-07-09 12:17:21 on dist-test-slave-z9f9"
I20260709 12:17:21.057173 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:17:21.061425 12162 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.062441 11916 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:17:21.062788 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-2-root
uuid: "0e8199ed094d4061babcd1736d42ae84"
format_stamp: "Formatted at 2026-07-09 12:17:21 on dist-test-slave-z9f9"
I20260709 12:17:21.063127 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599438829268-11916-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:21.088074 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:21.089648 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:21.091404 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:21.093834 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:21.094095 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.094378 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:21.094560 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.204116 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.3:42781
I20260709 12:17:21.204174 12224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.3:42781 every 8 connection(s)
I20260709 12:17:21.222445 12225 heartbeater.cc:344] Connected to a master server at 127.11.163.62:41373
I20260709 12:17:21.222903 12225 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:21.223909 12225 heartbeater.cc:507] Master 127.11.163.62:41373 requested a full tablet report, sending...
I20260709 12:17:21.226217 11948 ts_manager.cc:194] Registered new tserver with Master: 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:21.226671 11916 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016787246s
I20260709 12:17:21.228009 11948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50044
I20260709 12:17:21.290349 11948 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50058:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:21.295413 11948 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:21.421233 12116 tablet_service.cc:1511] Processing CreateTablet for tablet 01d7a6293a5e4645bca0099d889b3a28 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:21.421263 12114 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc43ff619294a0ca8cc1001b0232243 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:21.423771 12115 tablet_service.cc:1511] Processing CreateTablet for tablet bd6ac5b212184e0683a59fd95f12c5ed (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:21.424980 12116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d7a6293a5e4645bca0099d889b3a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.425804 12114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc43ff619294a0ca8cc1001b0232243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.426759 12189 tablet_service.cc:1511] Processing CreateTablet for tablet bd6ac5b212184e0683a59fd95f12c5ed (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:21.430294 12113 tablet_service.cc:1511] Processing CreateTablet for tablet 876ff9c6bd1847ebbd953859d7cca074 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:21.431741 12113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876ff9c6bd1847ebbd953859d7cca074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.432312 12189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6ac5b212184e0683a59fd95f12c5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.434182 12041 tablet_service.cc:1511] Processing CreateTablet for tablet 01d7a6293a5e4645bca0099d889b3a28 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:21.434497 12188 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc43ff619294a0ca8cc1001b0232243 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:21.435799 12188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc43ff619294a0ca8cc1001b0232243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.436822 12040 tablet_service.cc:1511] Processing CreateTablet for tablet bd6ac5b212184e0683a59fd95f12c5ed (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:21.438086 12112 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4c06558c1844528728331e2e261020 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:21.439546 12112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4c06558c1844528728331e2e261020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.439404 12039 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc43ff619294a0ca8cc1001b0232243 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:21.440817 12038 tablet_service.cc:1511] Processing CreateTablet for tablet 876ff9c6bd1847ebbd953859d7cca074 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:21.441473 12111 tablet_service.cc:1511] Processing CreateTablet for tablet 65e8fcfce3cc43d38d3acc6b153569d3 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:21.445044 12111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e8fcfce3cc43d38d3acc6b153569d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.445823 12037 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4c06558c1844528728331e2e261020 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:21.447247 12110 tablet_service.cc:1511] Processing CreateTablet for tablet 6cac52ca303c4bba8b7546d8b1374eca (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:21.448666 12110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cac52ca303c4bba8b7546d8b1374eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.448776 12035 tablet_service.cc:1511] Processing CreateTablet for tablet 6cac52ca303c4bba8b7546d8b1374eca (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:21.449649 12115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6ac5b212184e0683a59fd95f12c5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.450428 12041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d7a6293a5e4645bca0099d889b3a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.450832 12190 tablet_service.cc:1511] Processing CreateTablet for tablet 01d7a6293a5e4645bca0099d889b3a28 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:21.451727 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cac52ca303c4bba8b7546d8b1374eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.452236 12190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d7a6293a5e4645bca0099d889b3a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.452402 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4c06558c1844528728331e2e261020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.453078 12039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc43ff619294a0ca8cc1001b0232243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.460237 12040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6ac5b212184e0683a59fd95f12c5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.453792 12036 tablet_service.cc:1511] Processing CreateTablet for tablet 65e8fcfce3cc43d38d3acc6b153569d3 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:21.456118 12109 tablet_service.cc:1511] Processing CreateTablet for tablet edc6cf67d5e84146b6ddf629af5462a4 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:21.479097 12186 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4c06558c1844528728331e2e261020 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:21.480641 12109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc6cf67d5e84146b6ddf629af5462a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.481240 12038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876ff9c6bd1847ebbd953859d7cca074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.476905 12034 tablet_service.cc:1511] Processing CreateTablet for tablet edc6cf67d5e84146b6ddf629af5462a4 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:21.495244 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e8fcfce3cc43d38d3acc6b153569d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.497545 12186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4c06558c1844528728331e2e261020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.497915 12185 tablet_service.cc:1511] Processing CreateTablet for tablet 65e8fcfce3cc43d38d3acc6b153569d3 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:21.489188 12187 tablet_service.cc:1511] Processing CreateTablet for tablet 876ff9c6bd1847ebbd953859d7cca074 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
W20260709 12:17:21.581645 11995 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:21.576911 12033 tablet_service.cc:1511] Processing CreateTablet for tablet 6976c9fe8e804edda4e5132efd393fe9 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:21.588155 12182 tablet_service.cc:1511] Processing CreateTablet for tablet 6976c9fe8e804edda4e5132efd393fe9 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:21.500602 12184 tablet_service.cc:1511] Processing CreateTablet for tablet 6cac52ca303c4bba8b7546d8b1374eca (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:21.584084 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc6cf67d5e84146b6ddf629af5462a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.565477 12183 tablet_service.cc:1511] Processing CreateTablet for tablet edc6cf67d5e84146b6ddf629af5462a4 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:21.601466 12185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e8fcfce3cc43d38d3acc6b153569d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.601905 12108 tablet_service.cc:1511] Processing CreateTablet for tablet 6976c9fe8e804edda4e5132efd393fe9 (DEFAULT_TABLE table=test-workload [id=86a6137520224ca0bf02ea15cbe7e7b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:21.605931 12108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6976c9fe8e804edda4e5132efd393fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.610152 12183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc6cf67d5e84146b6ddf629af5462a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.612391 12184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cac52ca303c4bba8b7546d8b1374eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.617229 12187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876ff9c6bd1847ebbd953859d7cca074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.618659 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6976c9fe8e804edda4e5132efd393fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.622421 12182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6976c9fe8e804edda4e5132efd393fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.763326 12243 tablet_bootstrap.cc:492] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4: Bootstrap starting.
I20260709 12:17:21.809510 12243 tablet_bootstrap.cc:654] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:21.812378 12244 tablet_bootstrap.cc:492] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84: Bootstrap starting.
I20260709 12:17:21.818914 12245 tablet_bootstrap.cc:492] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec: Bootstrap starting.
I20260709 12:17:21.884336 12076 heartbeater.cc:499] Master 127.11.163.62:41373 was elected leader, sending a full tablet report...
I20260709 12:17:21.902079 12243 tablet_bootstrap.cc:492] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4: No bootstrap required, opened a new log
I20260709 12:17:21.902722 12243 ts_tablet_manager.cc:1403] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4: Time spent bootstrapping tablet: real 0.186s	user 0.010s	sys 0.023s
I20260709 12:17:21.909679 12244 tablet_bootstrap.cc:654] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:21.910329 12243 raft_consensus.cc:359] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:21.917270 12245 tablet_bootstrap.cc:654] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:21.918226 12243 raft_consensus.cc:385] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:21.918800 12243 raft_consensus.cc:740] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Initialized, Role: FOLLOWER
I20260709 12:17:21.919579 12243 consensus_queue.cc:260] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:21.941790 12245 tablet_bootstrap.cc:492] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec: No bootstrap required, opened a new log
I20260709 12:17:21.942348 12245 ts_tablet_manager.cc:1403] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.006s
I20260709 12:17:21.946802 12244 tablet_bootstrap.cc:492] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84: No bootstrap required, opened a new log
I20260709 12:17:21.946599 12245 raft_consensus.cc:359] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:21.947229 12244 ts_tablet_manager.cc:1403] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84: Time spent bootstrapping tablet: real 0.142s	user 0.011s	sys 0.006s
I20260709 12:17:21.947329 12245 raft_consensus.cc:385] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:21.950162 12244 raft_consensus.cc:359] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:21.950857 12244 raft_consensus.cc:385] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:21.951148 12244 raft_consensus.cc:740] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Initialized, Role: FOLLOWER
I20260709 12:17:21.947680 12245 raft_consensus.cc:740] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Initialized, Role: FOLLOWER
I20260709 12:17:21.951951 12244 consensus_queue.cc:260] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:21.952726 12243 ts_tablet_manager.cc:1434] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.002s
I20260709 12:17:21.952443 12245 consensus_queue.cc:260] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:21.956916 12243 tablet_bootstrap.cc:492] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4: Bootstrap starting.
I20260709 12:17:21.961367 12225 heartbeater.cc:499] Master 127.11.163.62:41373 was elected leader, sending a full tablet report...
I20260709 12:17:21.962853 12244 ts_tablet_manager.cc:1434] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 12:17:21.963869 12244 tablet_bootstrap.cc:492] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84: Bootstrap starting.
W20260709 12:17:21.967140 12226 tablet.cc:2406] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:17:21.969326 12243 tablet_bootstrap.cc:654] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:21.970628 12244 tablet_bootstrap.cc:654] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:21.982296 12244 tablet_bootstrap.cc:492] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84: No bootstrap required, opened a new log
I20260709 12:17:21.982544 12151 heartbeater.cc:499] Master 127.11.163.62:41373 was elected leader, sending a full tablet report...
I20260709 12:17:21.982949 12244 ts_tablet_manager.cc:1403] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.013s
I20260709 12:17:21.983197 12245 ts_tablet_manager.cc:1434] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec: Time spent starting tablet: real 0.041s	user 0.014s	sys 0.020s
I20260709 12:17:21.984756 12245 tablet_bootstrap.cc:492] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec: Bootstrap starting.
I20260709 12:17:21.990783 12244 raft_consensus.cc:359] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:21.991510 12244 raft_consensus.cc:385] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:21.991783 12244 raft_consensus.cc:740] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Initialized, Role: FOLLOWER
I20260709 12:17:21.992487 12244 consensus_queue.cc:260] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:21.996166 12244 ts_tablet_manager.cc:1434] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 12:17:21.997093 12244 tablet_bootstrap.cc:492] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84: Bootstrap starting.
I20260709 12:17:21.997963 12250 raft_consensus.cc:493] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.998428 12250 raft_consensus.cc:515] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:21.999508 12243 tablet_bootstrap.cc:492] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4: No bootstrap required, opened a new log
I20260709 12:17:21.999966 12243 ts_tablet_manager.cc:1403] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.000s
I20260709 12:17:22.001509 12250 leader_election.cc:290] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:22.013393 12245 tablet_bootstrap.cc:654] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.019572 12244 tablet_bootstrap.cc:654] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.022135 12245 tablet_bootstrap.cc:492] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec: No bootstrap required, opened a new log
I20260709 12:17:22.022787 12245 ts_tablet_manager.cc:1403] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec: Time spent bootstrapping tablet: real 0.038s	user 0.003s	sys 0.012s
I20260709 12:17:22.025806 12245 raft_consensus.cc:359] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.026612 12245 raft_consensus.cc:385] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.026957 12245 raft_consensus.cc:740] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.027733 12245 consensus_queue.cc:260] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.029177 12243 raft_consensus.cc:359] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.029886 12243 raft_consensus.cc:385] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.029932 12245 ts_tablet_manager.cc:1434] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:17:22.030297 12243 raft_consensus.cc:740] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.031270 12245 tablet_bootstrap.cc:492] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec: Bootstrap starting.
I20260709 12:17:22.031095 12243 consensus_queue.cc:260] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.034754 12243 ts_tablet_manager.cc:1434] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:17:22.036240 12243 tablet_bootstrap.cc:492] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4: Bootstrap starting.
I20260709 12:17:22.038820 12245 tablet_bootstrap.cc:654] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.047680 12243 tablet_bootstrap.cc:654] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.051173 12245 tablet_bootstrap.cc:492] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec: No bootstrap required, opened a new log
I20260709 12:17:22.051774 12245 ts_tablet_manager.cc:1403] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 12:17:22.054711 12245 raft_consensus.cc:359] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.055639 12245 raft_consensus.cc:385] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.056011 12245 raft_consensus.cc:740] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.057946 12051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
I20260709 12:17:22.059100 12244 tablet_bootstrap.cc:492] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84: No bootstrap required, opened a new log
I20260709 12:17:22.056820 12245 consensus_queue.cc:260] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.059589 12244 ts_tablet_manager.cc:1403] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.004s
I20260709 12:17:22.061169 12245 ts_tablet_manager.cc:1434] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
W20260709 12:17:22.062050 12165 leader_election.cc:343] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.062536 12244 raft_consensus.cc:359] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.063297 12244 raft_consensus.cc:385] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.063650 12244 raft_consensus.cc:740] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.064258 12245 tablet_bootstrap.cc:492] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec: Bootstrap starting.
I20260709 12:17:22.064460 12244 consensus_queue.cc:260] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.068610 12244 ts_tablet_manager.cc:1434] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:17:22.069654 12244 tablet_bootstrap.cc:492] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84: Bootstrap starting.
I20260709 12:17:22.073307 12245 tablet_bootstrap.cc:654] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.076428 12244 tablet_bootstrap.cc:654] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.077605 12243 tablet_bootstrap.cc:492] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4: No bootstrap required, opened a new log
I20260709 12:17:22.078035 12243 ts_tablet_manager.cc:1403] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.008s
I20260709 12:17:22.080833 12243 raft_consensus.cc:359] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.081596 12243 raft_consensus.cc:385] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.081941 12243 raft_consensus.cc:740] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.082700 12243 consensus_queue.cc:260] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.086604 12243 ts_tablet_manager.cc:1434] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:17:22.088914 12243 tablet_bootstrap.cc:492] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4: Bootstrap starting.
I20260709 12:17:22.096367 12245 tablet_bootstrap.cc:492] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec: No bootstrap required, opened a new log
I20260709 12:17:22.097083 12245 ts_tablet_manager.cc:1403] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.004s
I20260709 12:17:22.102212 12245 raft_consensus.cc:359] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.103602 12245 raft_consensus.cc:385] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.107892 12244 tablet_bootstrap.cc:492] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84: No bootstrap required, opened a new log
I20260709 12:17:22.108520 12244 ts_tablet_manager.cc:1403] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84: Time spent bootstrapping tablet: real 0.039s	user 0.026s	sys 0.007s
I20260709 12:17:22.104242 12245 raft_consensus.cc:740] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.109745 12245 consensus_queue.cc:260] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.110625 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
W20260709 12:17:22.112782 12164 leader_election.cc:343] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.113260 12164 leader_election.cc:304] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84; no voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:22.113216 12244 raft_consensus.cc:359] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.113860 12243 tablet_bootstrap.cc:654] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.114154 12250 raft_consensus.cc:2749] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.114183 12244 raft_consensus.cc:385] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.114769 12244 raft_consensus.cc:740] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.115579 12244 consensus_queue.cc:260] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.116365 12245 ts_tablet_manager.cc:1434] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.006s
I20260709 12:17:22.117311 12245 tablet_bootstrap.cc:492] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec: Bootstrap starting.
I20260709 12:17:22.118148 12244 ts_tablet_manager.cc:1434] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:17:22.119170 12244 tablet_bootstrap.cc:492] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84: Bootstrap starting.
I20260709 12:17:22.124334 12245 tablet_bootstrap.cc:654] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.126379 12244 tablet_bootstrap.cc:654] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.136772 12245 tablet_bootstrap.cc:492] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec: No bootstrap required, opened a new log
I20260709 12:17:22.137305 12245 ts_tablet_manager.cc:1403] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 12:17:22.139271 12244 tablet_bootstrap.cc:492] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84: No bootstrap required, opened a new log
I20260709 12:17:22.139817 12244 ts_tablet_manager.cc:1403] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:17:22.139955 12247 raft_consensus.cc:493] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.140478 12247 raft_consensus.cc:515] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.143030 12244 raft_consensus.cc:359] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.143980 12244 raft_consensus.cc:385] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.144369 12244 raft_consensus.cc:740] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.145220 12244 consensus_queue.cc:260] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.148003 12244 ts_tablet_manager.cc:1434] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:22.149241 12244 tablet_bootstrap.cc:492] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84: Bootstrap starting.
I20260709 12:17:22.151285 12247 leader_election.cc:290] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.157760 12244 tablet_bootstrap.cc:654] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.164722 12245 raft_consensus.cc:359] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.165767 12245 raft_consensus.cc:385] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.166703 12251 raft_consensus.cc:493] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.167358 12251 raft_consensus.cc:515] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.170549 12251 leader_election.cc:290] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.171934 12250 raft_consensus.cc:493] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.177296 12245 raft_consensus.cc:740] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.179255 12244 tablet_bootstrap.cc:492] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84: No bootstrap required, opened a new log
I20260709 12:17:22.180236 12244 ts_tablet_manager.cc:1403] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.011s
I20260709 12:17:22.179818 12245 consensus_queue.cc:260] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.184048 12244 raft_consensus.cc:359] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.192312 12244 raft_consensus.cc:385] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.192632 12244 raft_consensus.cc:740] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.176681 12250 raft_consensus.cc:515] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.193392 12244 consensus_queue.cc:260] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.184041 12245 ts_tablet_manager.cc:1434] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.001s
I20260709 12:17:22.196416 12250 leader_election.cc:290] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865)
I20260709 12:17:22.202216 12251 raft_consensus.cc:493] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.202749 12251 raft_consensus.cc:515] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.206682 12245 tablet_bootstrap.cc:492] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec: Bootstrap starting.
I20260709 12:17:22.207691 12251 leader_election.cc:290] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.216192 12247 raft_consensus.cc:493] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.222203 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
I20260709 12:17:22.222730 12051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
I20260709 12:17:22.222966 12126 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 0.
I20260709 12:17:22.223526 12247 raft_consensus.cc:515] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.223619 12051 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 0.
I20260709 12:17:22.228308 12165 leader_election.cc:304] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:22.229698 12250 raft_consensus.cc:2804] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.230062 12250 raft_consensus.cc:493] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.230394 12250 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.236413 12247 leader_election.cc:290] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.257325 12245 tablet_bootstrap.cc:654] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.259799 12243 tablet_bootstrap.cc:492] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4: No bootstrap required, opened a new log
I20260709 12:17:22.260718 12243 ts_tablet_manager.cc:1403] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent bootstrapping tablet: real 0.172s	user 0.049s	sys 0.023s
I20260709 12:17:22.262066 12244 ts_tablet_manager.cc:1434] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84: Time spent starting tablet: real 0.081s	user 0.013s	sys 0.013s
I20260709 12:17:22.262110 12274 raft_consensus.cc:493] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.262784 12274 raft_consensus.cc:515] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.267638 12244 tablet_bootstrap.cc:492] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84: Bootstrap starting.
I20260709 12:17:22.258656 12250 raft_consensus.cc:515] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.269937 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.271186 12199 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 0.
I20260709 12:17:22.271299 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
I20260709 12:17:22.269264 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.273653 12126 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 0.
I20260709 12:17:22.274598 12274 leader_election.cc:290] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:22.273334 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
I20260709 12:17:22.274511 12200 raft_consensus.cc:2393] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e1ec5a9e997487891c58dd73ac305b4 in current term 1: Already voted for candidate 0e8199ed094d4061babcd1736d42ae84 in this term.
I20260709 12:17:22.276438 12250 leader_election.cc:290] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865)
I20260709 12:17:22.279599 12015 leader_election.cc:304] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:22.279953 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
I20260709 12:17:22.280296 12243 raft_consensus.cc:359] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.281023 12243 raft_consensus.cc:385] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.281409 12243 raft_consensus.cc:740] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.281507 12247 raft_consensus.cc:2804] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.281668 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:22.282012 12247 raft_consensus.cc:493] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.282303 12125 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.282187 12243 consensus_queue.cc:260] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.282567 12247 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:22.280891 12015 leader_election.cc:343] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:22.281430 12164 leader_election.cc:343] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.285539 12014 leader_election.cc:304] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 3152286337cd4eee8254979af6c272ec
I20260709 12:17:22.289274 12050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:22.290012 12051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
I20260709 12:17:22.295586 12051 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 0.
I20260709 12:17:22.299901 12048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4c06558c1844528728331e2e261020" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
I20260709 12:17:22.304942 12049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e8fcfce3cc43d38d3acc6b153569d3" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
I20260709 12:17:22.307693 12165 leader_election.cc:304] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 3152286337cd4eee8254979af6c272ec
W20260709 12:17:22.308259 12091 leader_election.cc:343] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.309196 12250 raft_consensus.cc:2804] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.309661 12250 raft_consensus.cc:493] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:22.309774 12091 leader_election.cc:343] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.310159 12250 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.316288 12247 raft_consensus.cc:515] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.317739 12050 raft_consensus.cc:2393] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e8199ed094d4061babcd1736d42ae84 in current term 1: Already voted for candidate 6e1ec5a9e997487891c58dd73ac305b4 in this term.
I20260709 12:17:22.321923 12244 tablet_bootstrap.cc:654] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.323370 12247 leader_election.cc:290] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.323623 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:22.324725 12247 raft_consensus.cc:2804] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.324808 12274 raft_consensus.cc:493] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.325234 12247 raft_consensus.cc:493] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.325644 12247 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.325472 12274 raft_consensus.cc:515] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.329855 12049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
I20260709 12:17:22.330677 12049 raft_consensus.cc:2468] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 0.
I20260709 12:17:22.332325 12165 leader_election.cc:304] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:22.345520 12274 leader_election.cc:290] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:22.345623 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4c06558c1844528728331e2e261020" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.341166 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e8fcfce3cc43d38d3acc6b153569d3" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.346143 12274 raft_consensus.cc:2804] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.346561 12274 raft_consensus.cc:493] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.346975 12274 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:22.336751 12014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:42781, user_credentials={real_user=slave}} blocked reactor thread for 51668.8us
I20260709 12:17:22.351706 12199 raft_consensus.cc:2468] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 0.
I20260709 12:17:22.342350 12243 ts_tablet_manager.cc:1434] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.007s
I20260709 12:17:22.352886 12276 raft_consensus.cc:493] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.354584 12089 leader_election.cc:304] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec; no voters: 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:22.356477 12251 raft_consensus.cc:2804] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.347914 12247 raft_consensus.cc:515] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.357512 12251 raft_consensus.cc:493] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.357468 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:22.357594 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
I20260709 12:17:22.358081 12251 raft_consensus.cc:3060] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.358461 12199 raft_consensus.cc:2393] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e1ec5a9e997487891c58dd73ac305b4 in current term 1: Already voted for candidate 0e8199ed094d4061babcd1736d42ae84 in this term.
I20260709 12:17:22.354532 12276 raft_consensus.cc:515] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.357472 12245 tablet_bootstrap.cc:492] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec: No bootstrap required, opened a new log
I20260709 12:17:22.362732 12243 tablet_bootstrap.cc:492] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4: Bootstrap starting.
I20260709 12:17:22.364800 12014 leader_election.cc:304] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e1ec5a9e997487891c58dd73ac305b4; no voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec
I20260709 12:17:22.363950 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec"
W20260709 12:17:22.366753 12015 leader_election.cc:343] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.375649 12276 leader_election.cc:290] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
W20260709 12:17:22.370575 12089 leader_election.cc:343] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.376698 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
I20260709 12:17:22.380414 12089 leader_election.cc:304] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3152286337cd4eee8254979af6c272ec; no voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:22.370627 12245 ts_tablet_manager.cc:1403] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec: Time spent bootstrapping tablet: real 0.164s	user 0.008s	sys 0.011s
I20260709 12:17:22.380645 12251 raft_consensus.cc:515] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
W20260709 12:17:22.382476 12015 leader_election.cc:343] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:22.361106 12164 leader_election.cc:343] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.384657 12276 raft_consensus.cc:2749] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.388228 12125 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 1.
I20260709 12:17:22.389073 12251 leader_election.cc:290] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.389693 12251 raft_consensus.cc:2749] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.389914 12050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4c06558c1844528728331e2e261020" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:22.390784 12164 leader_election.cc:304] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec; no voters: 6e1ec5a9e997487891c58dd73ac305b4
W20260709 12:17:22.391404 12091 leader_election.cc:343] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.392546 12278 raft_consensus.cc:2804] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.394306 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.394248 12247 leader_election.cc:290] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.394896 12274 raft_consensus.cc:515] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.398545 12250 raft_consensus.cc:515] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.399703 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
W20260709 12:17:22.401901 12014 leader_election.cc:343] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.402248 12199 raft_consensus.cc:2393] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e1ec5a9e997487891c58dd73ac305b4 in current term 1: Already voted for candidate 0e8199ed094d4061babcd1736d42ae84 in this term.
I20260709 12:17:22.406263 12250 leader_election.cc:290] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:22.406829 12244 tablet_bootstrap.cc:492] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84: No bootstrap required, opened a new log
I20260709 12:17:22.406975 12050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:22.407841 12050 raft_consensus.cc:2393] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e8199ed094d4061babcd1736d42ae84 in current term 1: Already voted for candidate 6e1ec5a9e997487891c58dd73ac305b4 in this term.
I20260709 12:17:22.407639 12244 ts_tablet_manager.cc:1403] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84: Time spent bootstrapping tablet: real 0.141s	user 0.015s	sys 0.004s
I20260709 12:17:22.410945 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:22.398473 12245 raft_consensus.cc:359] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.412354 12050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:22.413379 12050 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.402427 12014 leader_election.cc:304] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e1ec5a9e997487891c58dd73ac305b4; no voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec
I20260709 12:17:22.412660 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:22.403014 12278 raft_consensus.cc:697] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 1 LEADER]: Becoming Leader. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:22.411098 12274 leader_election.cc:290] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:22.414677 12245 raft_consensus.cc:385] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.415948 12244 raft_consensus.cc:359] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
W20260709 12:17:22.416500 12164 leader_election.cc:343] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.416374 12245 raft_consensus.cc:740] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.416751 12244 raft_consensus.cc:385] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.417198 12244 raft_consensus.cc:740] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.417063 12164 leader_election.cc:304] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84; no voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4
W20260709 12:17:22.418844 12164 leader_election.cc:343] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.419028 12247 raft_consensus.cc:2749] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.418857 12278 consensus_queue.cc:237] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.424031 12014 leader_election.cc:304] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e1ec5a9e997487891c58dd73ac305b4; no voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec
I20260709 12:17:22.433748 12247 raft_consensus.cc:2749] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.421314 12243 tablet_bootstrap.cc:654] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:22.433955 12089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:42781, user_credentials={real_user=slave}} blocked reactor thread for 71576.2us
I20260709 12:17:22.421288 12274 raft_consensus.cc:2749] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.435935 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4c06558c1844528728331e2e261020" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:22.436600 12199 raft_consensus.cc:3060] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.420374 12245 consensus_queue.cc:260] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.441468 12050 raft_consensus.cc:2468] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 1.
I20260709 12:17:22.432575 12244 consensus_queue.cc:260] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.442737 12165 leader_election.cc:304] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 3152286337cd4eee8254979af6c272ec
I20260709 12:17:22.443630 12278 raft_consensus.cc:2804] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.444479 12244 ts_tablet_manager.cc:1434] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 12:17:22.445051 12199 raft_consensus.cc:2468] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 1.
I20260709 12:17:22.448947 12278 raft_consensus.cc:697] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 1 LEADER]: Becoming Leader. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:22.447153 11948 catalog_manager.cc:5697] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "0e8199ed094d4061babcd1736d42ae84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:22.446027 12280 raft_consensus.cc:493] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.449402 12244 tablet_bootstrap.cc:492] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84: Bootstrap starting.
I20260709 12:17:22.449747 12280 raft_consensus.cc:515] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.451922 12089 leader_election.cc:304] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec; no voters: 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:22.452850 12251 raft_consensus.cc:2804] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.452770 12278 consensus_queue.cc:237] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.459645 12251 raft_consensus.cc:697] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Becoming Leader. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:22.460708 12251 consensus_queue.cc:237] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.466837 12245 ts_tablet_manager.cc:1434] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec: Time spent starting tablet: real 0.076s	user 0.003s	sys 0.008s
I20260709 12:17:22.467077 12050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6976c9fe8e804edda4e5132efd393fe9" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
W20260709 12:17:22.471060 12091 leader_election.cc:343] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.472702 12244 tablet_bootstrap.cc:654] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.475562 12280 leader_election.cc:290] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.476110 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6976c9fe8e804edda4e5132efd393fe9" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.475880 12245 tablet_bootstrap.cc:492] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec: Bootstrap starting.
W20260709 12:17:22.477674 12089 leader_election.cc:343] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.478145 12089 leader_election.cc:304] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3152286337cd4eee8254979af6c272ec; no voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:22.481181 12280 raft_consensus.cc:2749] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.491417 12243 tablet_bootstrap.cc:492] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4: No bootstrap required, opened a new log
I20260709 12:17:22.492054 12243 ts_tablet_manager.cc:1403] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent bootstrapping tablet: real 0.131s	user 0.026s	sys 0.004s
I20260709 12:17:22.501343 12245 tablet_bootstrap.cc:654] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.505090 12244 tablet_bootstrap.cc:492] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84: No bootstrap required, opened a new log
I20260709 12:17:22.505541 12244 ts_tablet_manager.cc:1403] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.007s
I20260709 12:17:22.506371 12243 raft_consensus.cc:359] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.507143 12243 raft_consensus.cc:385] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.507465 12243 raft_consensus.cc:740] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.508035 12244 raft_consensus.cc:359] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.508217 12243 consensus_queue.cc:260] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.508782 12244 raft_consensus.cc:385] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.509054 12244 raft_consensus.cc:740] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.510540 12243 ts_tablet_manager.cc:1434] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 12:17:22.510142 12244 consensus_queue.cc:260] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.512641 12244 ts_tablet_manager.cc:1434] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:17:22.513247 12244 tablet_bootstrap.cc:492] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84: Bootstrap starting.
I20260709 12:17:22.518488 11947 catalog_manager.cc:5697] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 3152286337cd4eee8254979af6c272ec (127.11.163.2). New cstate: current_term: 1 leader_uuid: "3152286337cd4eee8254979af6c272ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:22.511579 12243 tablet_bootstrap.cc:492] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4: Bootstrap starting.
I20260709 12:17:22.531328 12244 tablet_bootstrap.cc:654] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.532552 12243 tablet_bootstrap.cc:654] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.532606 12245 tablet_bootstrap.cc:492] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec: No bootstrap required, opened a new log
I20260709 12:17:22.533311 12245 ts_tablet_manager.cc:1403] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.005s
I20260709 12:17:22.538899 12245 raft_consensus.cc:359] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.541699 12245 raft_consensus.cc:385] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.542032 12245 raft_consensus.cc:740] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.543040 12245 consensus_queue.cc:260] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.549875 12245 ts_tablet_manager.cc:1434] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.003s
I20260709 12:17:22.550215 12244 tablet_bootstrap.cc:492] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84: No bootstrap required, opened a new log
I20260709 12:17:22.550846 12245 tablet_bootstrap.cc:492] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec: Bootstrap starting.
I20260709 12:17:22.551201 12244 ts_tablet_manager.cc:1403] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.003s
I20260709 12:17:22.551223 12243 tablet_bootstrap.cc:492] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4: No bootstrap required, opened a new log
I20260709 12:17:22.554869 12243 ts_tablet_manager.cc:1403] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.007s
I20260709 12:17:22.558298 12245 tablet_bootstrap.cc:654] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.558106 12243 raft_consensus.cc:359] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.558882 12243 raft_consensus.cc:385] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.559993 12243 raft_consensus.cc:740] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.561509 12243 consensus_queue.cc:260] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.562970 12244 raft_consensus.cc:359] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.564043 12243 ts_tablet_manager.cc:1434] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:17:22.564920 12247 raft_consensus.cc:493] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.565347 12247 raft_consensus.cc:515] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.563650 12244 raft_consensus.cc:385] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.566769 12244 raft_consensus.cc:740] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.567408 12247 leader_election.cc:290] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.567541 12244 consensus_queue.cc:260] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.568337 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
I20260709 12:17:22.569129 12126 raft_consensus.cc:2468] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 0.
I20260709 12:17:22.569214 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.569835 12199 raft_consensus.cc:2468] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 0.
I20260709 12:17:22.570269 12244 ts_tablet_manager.cc:1434] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:17:22.570464 12015 leader_election.cc:304] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:22.571589 12247 raft_consensus.cc:2804] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.571964 12247 raft_consensus.cc:493] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.572335 12247 raft_consensus.cc:3060] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.574119 12245 tablet_bootstrap.cc:492] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec: No bootstrap required, opened a new log
I20260709 12:17:22.574545 12245 ts_tablet_manager.cc:1403] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec: Time spent bootstrapping tablet: real 0.024s	user 0.001s	sys 0.016s
I20260709 12:17:22.577140 12245 raft_consensus.cc:359] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.577608 12243 tablet_bootstrap.cc:492] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4: Bootstrap starting.
I20260709 12:17:22.577788 12245 raft_consensus.cc:385] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.578146 12245 raft_consensus.cc:740] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.579134 12245 consensus_queue.cc:260] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.581127 12245 ts_tablet_manager.cc:1434] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:17:22.584887 12245 tablet_bootstrap.cc:492] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec: Bootstrap starting.
W20260709 12:17:22.585398 11995 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:22.585660 12243 tablet_bootstrap.cc:654] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.589761 12245 tablet_bootstrap.cc:654] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.592808 11948 catalog_manager.cc:5697] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "0e8199ed094d4061babcd1736d42ae84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:22.605473 12247 raft_consensus.cc:515] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.607182 12245 tablet_bootstrap.cc:492] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec: No bootstrap required, opened a new log
I20260709 12:17:22.607684 12245 ts_tablet_manager.cc:1403] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 12:17:22.609129 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:22.609412 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:22.609733 12126 raft_consensus.cc:3060] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.610168 12199 raft_consensus.cc:3060] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.617002 12126 raft_consensus.cc:2468] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 1.
I20260709 12:17:22.618556 12015 leader_election.cc:304] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:22.619915 12276 raft_consensus.cc:2804] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.620442 12276 raft_consensus.cc:697] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:22.621395 12276 consensus_queue.cc:237] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.630250 12245 raft_consensus.cc:359] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.630966 12245 raft_consensus.cc:385] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.631232 12245 raft_consensus.cc:740] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.632014 12199 raft_consensus.cc:2468] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 1.
I20260709 12:17:22.634305 12245 consensus_queue.cc:260] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.635581 12247 leader_election.cc:290] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.640177 12251 raft_consensus.cc:493] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.640662 12251 raft_consensus.cc:515] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.642755 12251 leader_election.cc:290] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.639837 12245 ts_tablet_manager.cc:1434] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:17:22.646543 12050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
I20260709 12:17:22.646224 11948 catalog_manager.cc:5697] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:22.647440 12050 raft_consensus.cc:2468] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 0.
I20260709 12:17:22.651887 12091 leader_election.cc:304] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:22.653645 12251 raft_consensus.cc:2804] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.654036 12251 raft_consensus.cc:493] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.654374 12251 raft_consensus.cc:3060] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.659687 12280 raft_consensus.cc:493] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.660341 12280 raft_consensus.cc:515] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.662170 12251 raft_consensus.cc:515] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.663826 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.664485 12199 raft_consensus.cc:2468] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 0.
I20260709 12:17:22.668102 12280 leader_election.cc:290] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.668478 12243 tablet_bootstrap.cc:492] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4: No bootstrap required, opened a new log
I20260709 12:17:22.668964 12243 ts_tablet_manager.cc:1403] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent bootstrapping tablet: real 0.092s	user 0.040s	sys 0.040s
I20260709 12:17:22.669880 12050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
I20260709 12:17:22.670938 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
W20260709 12:17:22.671259 12091 leader_election.cc:343] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.671638 12199 raft_consensus.cc:2468] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 0.
I20260709 12:17:22.671782 12243 raft_consensus.cc:359] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.672505 12243 raft_consensus.cc:385] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.672791 12243 raft_consensus.cc:740] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.672876 12089 leader_election.cc:304] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec; no voters: 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:22.674300 12280 raft_consensus.cc:2804] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.674641 12251 leader_election.cc:290] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.675335 12243 consensus_queue.cc:260] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.675766 12050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:22.676334 12050 raft_consensus.cc:3060] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.677929 12243 ts_tablet_manager.cc:1434] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:17:22.678925 12243 tablet_bootstrap.cc:492] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4: Bootstrap starting.
I20260709 12:17:22.674646 12280 raft_consensus.cc:493] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.685428 12280 raft_consensus.cc:3060] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.686455 12243 tablet_bootstrap.cc:654] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.689186 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:22.689757 12199 raft_consensus.cc:3060] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.696486 12280 raft_consensus.cc:515] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.696650 12050 raft_consensus.cc:2468] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 1.
I20260709 12:17:22.698256 12091 leader_election.cc:304] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:22.699023 12280 leader_election.cc:290] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.700002 12251 raft_consensus.cc:2804] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.700791 12251 raft_consensus.cc:697] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Becoming Leader. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:22.701126 12050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:22.701974 12199 raft_consensus.cc:2468] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 1.
I20260709 12:17:22.700156 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
W20260709 12:17:22.702481 12091 leader_election.cc:343] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.701644 12251 consensus_queue.cc:237] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.702905 12200 raft_consensus.cc:3060] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.709688 12200 raft_consensus.cc:2468] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 1.
I20260709 12:17:22.710000 12243 tablet_bootstrap.cc:492] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4: No bootstrap required, opened a new log
I20260709 12:17:22.710461 12243 ts_tablet_manager.cc:1403] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent bootstrapping tablet: real 0.032s	user 0.000s	sys 0.015s
I20260709 12:17:22.711056 12089 leader_election.cc:304] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec; no voters: 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:22.711238 11946 catalog_manager.cc:5697] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 3152286337cd4eee8254979af6c272ec (127.11.163.2). New cstate: current_term: 1 leader_uuid: "3152286337cd4eee8254979af6c272ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:22.712209 12280 raft_consensus.cc:2804] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.712693 12280 raft_consensus.cc:697] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Becoming Leader. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:22.713135 12243 raft_consensus.cc:359] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.713829 12243 raft_consensus.cc:385] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.713546 12280 consensus_queue.cc:237] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.714151 12243 raft_consensus.cc:740] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.715096 12243 consensus_queue.cc:260] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.717197 12243 ts_tablet_manager.cc:1434] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:17:22.718031 12243 tablet_bootstrap.cc:492] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4: Bootstrap starting.
I20260709 12:17:22.723838 12243 tablet_bootstrap.cc:654] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.734705 12243 tablet_bootstrap.cc:492] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4: No bootstrap required, opened a new log
I20260709 12:17:22.735260 12243 ts_tablet_manager.cc:1403] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 12:17:22.738188 12243 raft_consensus.cc:359] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.738888 12243 raft_consensus.cc:385] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.739198 12243 raft_consensus.cc:740] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.739856 12243 consensus_queue.cc:260] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.741873 12243 ts_tablet_manager.cc:1434] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:17:22.743263 11946 catalog_manager.cc:5697] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 3152286337cd4eee8254979af6c272ec (127.11.163.2). New cstate: current_term: 1 leader_uuid: "3152286337cd4eee8254979af6c272ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:22.802903 12276 raft_consensus.cc:493] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.803478 12276 raft_consensus.cc:515] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.805562 12276 leader_election.cc:290] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.806402 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e8fcfce3cc43d38d3acc6b153569d3" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
I20260709 12:17:22.806980 12126 raft_consensus.cc:2468] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 0.
I20260709 12:17:22.807096 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e8fcfce3cc43d38d3acc6b153569d3" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.807780 12200 raft_consensus.cc:2468] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 0.
I20260709 12:17:22.808127 12015 leader_election.cc:304] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:22.809382 12276 raft_consensus.cc:2804] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.809728 12276 raft_consensus.cc:493] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.810014 12280 raft_consensus.cc:493] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.810072 12276 raft_consensus.cc:3060] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.810540 12280 raft_consensus.cc:515] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.812422 12280 leader_election.cc:290] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.814637 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.815359 12200 raft_consensus.cc:2393] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3152286337cd4eee8254979af6c272ec in current term 1: Already voted for candidate 0e8199ed094d4061babcd1736d42ae84 in this term.
I20260709 12:17:22.816851 12276 raft_consensus.cc:515] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.818696 12278 consensus_queue.cc:1048] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:22.819656 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e8fcfce3cc43d38d3acc6b153569d3" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:22.820374 12126 raft_consensus.cc:3060] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.820955 12050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
I20260709 12:17:22.819831 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e8fcfce3cc43d38d3acc6b153569d3" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:22.821604 12200 raft_consensus.cc:3060] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.821707 12050 raft_consensus.cc:2393] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3152286337cd4eee8254979af6c272ec in current term 1: Already voted for candidate 6e1ec5a9e997487891c58dd73ac305b4 in this term.
I20260709 12:17:22.822863 12091 leader_election.cc:304] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3152286337cd4eee8254979af6c272ec; no voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:22.823951 12280 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.830307 12280 raft_consensus.cc:2749] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.833343 12278 consensus_queue.cc:1048] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:22.839466 12276 leader_election.cc:290] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.848035 12200 raft_consensus.cc:2468] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 1.
I20260709 12:17:22.848925 12126 raft_consensus.cc:2468] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 1.
I20260709 12:17:22.852792 12015 leader_election.cc:304] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:22.853490 12276 raft_consensus.cc:2804] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.854187 12276 raft_consensus.cc:697] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:22.855064 12276 consensus_queue.cc:237] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.874787 11946 catalog_manager.cc:5697] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:22.879664 12050 raft_consensus.cc:3060] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.890221 12280 consensus_queue.cc:1048] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:22.900645 12251 consensus_queue.cc:1048] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:22.924189 12251 raft_consensus.cc:493] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.924685 12251 raft_consensus.cc:515] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.926433 12251 leader_election.cc:290] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.927266 12050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
I20260709 12:17:22.927626 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.928000 12050 raft_consensus.cc:2393] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3152286337cd4eee8254979af6c272ec in current term 1: Already voted for candidate 0e8199ed094d4061babcd1736d42ae84 in this term.
I20260709 12:17:22.929168 12089 leader_election.cc:304] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3152286337cd4eee8254979af6c272ec; no voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:22.929206 12276 raft_consensus.cc:493] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.929931 12251 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.929807 12276 raft_consensus.cc:515] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.931718 12276 leader_election.cc:290] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.932389 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6976c9fe8e804edda4e5132efd393fe9" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
I20260709 12:17:22.932828 12126 raft_consensus.cc:2468] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 0.
I20260709 12:17:22.934912 12015 leader_election.cc:304] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:22.935668 12276 raft_consensus.cc:2804] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.936044 12276 raft_consensus.cc:493] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.936381 12276 raft_consensus.cc:3060] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.937420 12251 raft_consensus.cc:2749] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.938004 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6976c9fe8e804edda4e5132efd393fe9" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.938694 12200 raft_consensus.cc:2468] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 0.
I20260709 12:17:22.941850 12278 consensus_queue.cc:1048] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:22.942466 12276 raft_consensus.cc:515] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.944487 12276 leader_election.cc:290] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.945199 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6976c9fe8e804edda4e5132efd393fe9" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:22.945765 12125 raft_consensus.cc:3060] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.952334 12125 raft_consensus.cc:2468] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 1.
I20260709 12:17:22.952523 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6976c9fe8e804edda4e5132efd393fe9" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:22.953541 12200 raft_consensus.cc:3060] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.953588 12015 leader_election.cc:304] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:22.955657 12276 raft_consensus.cc:2804] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.956192 12276 raft_consensus.cc:697] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:22.957619 12276 consensus_queue.cc:237] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.961246 12247 raft_consensus.cc:493] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.961927 12247 raft_consensus.cc:515] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:22.964553 12247 leader_election.cc:290] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:22.966454 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
I20260709 12:17:22.968226 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8199ed094d4061babcd1736d42ae84" is_pre_election: true
I20260709 12:17:22.969064 12199 raft_consensus.cc:2393] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e1ec5a9e997487891c58dd73ac305b4 in current term 1: Already voted for candidate 3152286337cd4eee8254979af6c272ec in this term.
I20260709 12:17:22.968346 12200 raft_consensus.cc:2468] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 1.
I20260709 12:17:22.970712 12014 leader_election.cc:304] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e1ec5a9e997487891c58dd73ac305b4; no voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec
I20260709 12:17:22.972640 12247 raft_consensus.cc:3060] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.977095 11946 catalog_manager.cc:5697] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:22.981455 12281 consensus_queue.cc:1048] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:22.986562 12247 raft_consensus.cc:2749] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:23.032863 12276 consensus_queue.cc:1048] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.046017 12247 consensus_queue.cc:1048] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.083904 12251 consensus_queue.cc:1048] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.094781 12284 consensus_queue.cc:1048] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.286180 12284 consensus_queue.cc:1048] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.297636 12280 consensus_queue.cc:1048] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.395409 12247 consensus_queue.cc:1048] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:23.409530 12276 consensus_queue.cc:1048] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:23.412902 12276 consensus_queue.cc:1048] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.436859 12247 consensus_queue.cc:1048] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:23.588928 11995 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:24.269438 12278 raft_consensus.cc:493] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.270030 12278 raft_consensus.cc:515] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.271775 12278 leader_election.cc:290] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:24.272804 12049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4" is_pre_election: true
I20260709 12:17:24.272830 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec" is_pre_election: true
I20260709 12:17:24.273594 12049 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 1.
I20260709 12:17:24.273597 12125 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 1.
I20260709 12:17:24.274973 12165 leader_election.cc:304] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:24.275694 12278 raft_consensus.cc:2804] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:24.276081 12278 raft_consensus.cc:493] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.276394 12278 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.281340 12278 raft_consensus.cc:515] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.283223 12278 leader_election.cc:290] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 2 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:24.284179 12049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:24.284269 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:24.284760 12049 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.284827 12125 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.290091 12125 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 2.
I20260709 12:17:24.290223 12049 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 2.
I20260709 12:17:24.291206 12164 leader_election.cc:304] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec; no voters: 
I20260709 12:17:24.291983 12278 raft_consensus.cc:2804] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:24.292393 12278 raft_consensus.cc:697] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Becoming Leader. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:24.293031 12278 consensus_queue.cc:237] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.302100 11947 catalog_manager.cc:5697] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 reported cstate change: term changed from 0 to 2, leader changed from <none> to 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "0e8199ed094d4061babcd1736d42ae84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:24.606841 12200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28"
dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
mode: GRACEFUL
new_leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:40544
I20260709 12:17:24.607591 12200 raft_consensus.cc:606] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 1 LEADER]: Received request to transfer leadership to TS 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:24.613337 12200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed"
dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
mode: GRACEFUL
new_leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:40544
I20260709 12:17:24.613962 12200 raft_consensus.cc:606] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 1 LEADER]: Received request to transfer leadership to TS 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:24.622088 12200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074"
dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
mode: GRACEFUL
new_leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:40544
I20260709 12:17:24.622635 12200 raft_consensus.cc:606] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Received request to transfer leadership to TS 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:24.639281 12049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65e8fcfce3cc43d38d3acc6b153569d3"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
mode: GRACEFUL
new_leader_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:45222
I20260709 12:17:24.639904 12049 raft_consensus.cc:606] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Received request to transfer leadership to TS 3152286337cd4eee8254979af6c272ec
I20260709 12:17:24.650152 12049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6976c9fe8e804edda4e5132efd393fe9"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
mode: GRACEFUL
new_leader_uuid: "0e8199ed094d4061babcd1736d42ae84"
 from {username='slave'} at 127.0.0.1:45222
I20260709 12:17:24.650676 12049 raft_consensus.cc:606] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Received request to transfer leadership to TS 0e8199ed094d4061babcd1736d42ae84
I20260709 12:17:24.664058 12250 raft_consensus.cc:993] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84: : Instructing follower 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:24.664487 12278 raft_consensus.cc:1081] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 1 LEADER]: Signalling peer 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:24.666055 12049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:37490
I20260709 12:17:24.666503 12049 raft_consensus.cc:493] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:24.666770 12049 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.671219 12049 raft_consensus.cc:515] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.672940 12049 leader_election.cc:290] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 2 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:24.673945 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:24.674072 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:24.674644 12125 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.674750 12200 raft_consensus.cc:3055] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:24.675120 12200 raft_consensus.cc:740] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:24.675812 12200 consensus_queue.cc:260] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.677013 12200 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.679917 12125 raft_consensus.cc:2468] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 2.
I20260709 12:17:24.681089 12015 leader_election.cc:304] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:24.681881 12325 raft_consensus.cc:2804] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:24.681771 12200 raft_consensus.cc:2468] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 2.
I20260709 12:17:24.683272 12325 raft_consensus.cc:697] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 LEADER]: Becoming Leader. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:24.684293 12325 consensus_queue.cc:237] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.692061 11947 catalog_manager.cc:5697] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 reported cstate change: term changed from 1 to 2, leader changed from 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3) to 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:24.718250 11979 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 11919
W20260709 12:17:24.718938 11979 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 11982
W20260709 12:17:24.720216 11979 debug-util.cc:398] Leaking SignalData structure 0x7b0800097a20 after lost signal to thread 12150
I20260709 12:17:24.757465 12125 raft_consensus.cc:1275] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:24.758963 12278 consensus_queue.cc:1048] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:24.771657 12049 raft_consensus.cc:1275] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:24.773875 12250 consensus_queue.cc:1048] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:24.788863 12250 raft_consensus.cc:993] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84: : Instructing follower 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:24.789412 12278 raft_consensus.cc:1081] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Signalling peer 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:24.791356 12049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:37490
I20260709 12:17:24.792061 12049 raft_consensus.cc:493] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:24.792495 12049 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:24.799888 12049 raft_consensus.cc:515] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.803833 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:24.804469 12200 raft_consensus.cc:3055] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:24.804806 12200 raft_consensus.cc:740] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:24.805240 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:24.805909 12125 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:24.805685 12200 consensus_queue.cc:260] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.806901 12200 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:24.812165 12125 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 3.
I20260709 12:17:24.813004 12049 leader_election.cc:290] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 3 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:24.813510 12015 leader_election.cc:304] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:24.814389 12325 raft_consensus.cc:2804] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:24.814872 12325 raft_consensus.cc:697] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 LEADER]: Becoming Leader. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:24.815624 12200 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 3.
I20260709 12:17:24.815829 12325 consensus_queue.cc:237] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.823577 11948 catalog_manager.cc:5697] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 reported cstate change: term changed from 2 to 3, leader changed from 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3) to 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:24.867223 12250 raft_consensus.cc:993] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84: : Instructing follower 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:24.867787 12278 raft_consensus.cc:1081] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 1 LEADER]: Signalling peer 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:24.869437 12049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:37490
I20260709 12:17:24.870085 12049 raft_consensus.cc:493] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:24.870486 12049 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.878088 12049 raft_consensus.cc:515] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.880378 12049 leader_election.cc:290] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 2 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:24.881300 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:24.881748 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:24.881971 12125 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.882409 12200 raft_consensus.cc:3055] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:24.882807 12200 raft_consensus.cc:740] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:24.883805 12200 consensus_queue.cc:260] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.885165 12200 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.887825 12125 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 2.
I20260709 12:17:24.889006 12015 leader_election.cc:304] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:24.889813 12325 raft_consensus.cc:2804] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:24.890277 12325 raft_consensus.cc:697] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 LEADER]: Becoming Leader. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:24.891207 12325 consensus_queue.cc:237] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.892895 12200 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 2.
I20260709 12:17:24.900195 11948 catalog_manager.cc:5697] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 reported cstate change: term changed from 1 to 2, leader changed from 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3) to 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:24.979586 12335 raft_consensus.cc:993] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4: : Instructing follower 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:24.980069 12325 raft_consensus.cc:1081] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Signalling peer 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:24.981813 12125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65e8fcfce3cc43d38d3acc6b153569d3"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:50928
I20260709 12:17:24.982313 12125 raft_consensus.cc:493] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:24.982613 12125 raft_consensus.cc:3060] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.987149 12125 raft_consensus.cc:515] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.988974 12125 leader_election.cc:290] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 2 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:24.989815 12049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e8fcfce3cc43d38d3acc6b153569d3" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:24.990252 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e8fcfce3cc43d38d3acc6b153569d3" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:24.990496 12049 raft_consensus.cc:3055] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:24.990852 12200 raft_consensus.cc:3060] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.990866 12049 raft_consensus.cc:740] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:24.991899 12049 consensus_queue.cc:260] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:24.993198 12049 raft_consensus.cc:3060] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.996042 12200 raft_consensus.cc:2468] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 2.
I20260709 12:17:24.997015 12089 leader_election.cc:304] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec; no voters: 
I20260709 12:17:24.997706 12280 raft_consensus.cc:2804] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:24.999065 12280 raft_consensus.cc:697] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 2 LEADER]: Becoming Leader. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:25.000283 12280 consensus_queue.cc:237] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:25.000823 12049 raft_consensus.cc:2468] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 2.
I20260709 12:17:25.009810 11948 catalog_manager.cc:5697] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec reported cstate change: term changed from 1 to 2, leader changed from 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1) to 3152286337cd4eee8254979af6c272ec (127.11.163.2). New cstate: current_term: 2 leader_uuid: "3152286337cd4eee8254979af6c272ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:25.030547 12335 raft_consensus.cc:993] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4: : Instructing follower 0e8199ed094d4061babcd1736d42ae84 to start an election
I20260709 12:17:25.031198 12325 raft_consensus.cc:1081] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Signalling peer 0e8199ed094d4061babcd1736d42ae84 to start an election
I20260709 12:17:25.033425 12200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6976c9fe8e804edda4e5132efd393fe9"
dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
 from {username='slave'} at 127.0.0.1:43156
I20260709 12:17:25.034132 12200 raft_consensus.cc:493] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:25.034715 12200 raft_consensus.cc:3060] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:25.043104 12200 raft_consensus.cc:515] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:25.045532 12200 leader_election.cc:290] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 2 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:25.046590 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6976c9fe8e804edda4e5132efd393fe9" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:25.046516 12049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6976c9fe8e804edda4e5132efd393fe9" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:25.047299 12125 raft_consensus.cc:3060] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:25.047377 12049 raft_consensus.cc:3055] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:25.047804 12049 raft_consensus.cc:740] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:25.048681 12049 consensus_queue.cc:260] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:25.051371 12049 raft_consensus.cc:3060] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:25.054461 12125 raft_consensus.cc:2468] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 2.
I20260709 12:17:25.055682 12164 leader_election.cc:304] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec; no voters: 
I20260709 12:17:25.056592 12278 raft_consensus.cc:2804] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:25.057166 12278 raft_consensus.cc:697] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Becoming Leader. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:25.058125 12278 consensus_queue.cc:237] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:25.059602 12049 raft_consensus.cc:2468] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 2.
I20260709 12:17:25.066654 11948 catalog_manager.cc:5697] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 reported cstate change: term changed from 1 to 2, leader changed from 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1) to 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "0e8199ed094d4061babcd1736d42ae84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.113790 12125 raft_consensus.cc:1275] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:25.115363 12325 consensus_queue.cc:1048] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:25.127599 12200 raft_consensus.cc:1275] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:25.130463 12325 consensus_queue.cc:1048] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:25.233493 12125 raft_consensus.cc:1275] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:25.234928 12325 consensus_queue.cc:1048] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:25.245771 12200 raft_consensus.cc:1275] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:25.247272 12334 consensus_queue.cc:1048] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:25.289790 12125 raft_consensus.cc:1275] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:25.291390 12334 consensus_queue.cc:1048] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:25.298056 12200 raft_consensus.cc:1275] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:25.302485 12325 consensus_queue.cc:1048] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:25.416729 12200 raft_consensus.cc:1275] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:25.418193 12280 consensus_queue.cc:1048] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:25.428807 12049 raft_consensus.cc:1275] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:25.430866 12280 consensus_queue.cc:1048] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:25.505739 12049 raft_consensus.cc:1275] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:25.507117 12278 consensus_queue.cc:1048] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:25.517441 12125 raft_consensus.cc:1275] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:25.519315 12278 consensus_queue.cc:1048] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:27.681331 11916 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:17:27.682039 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:27.698168 12049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
mode: GRACEFUL
new_leader_uuid: "0e8199ed094d4061babcd1736d42ae84"
 from {username='slave'} at 127.0.0.1:45238
I20260709 12:17:27.698720 12049 raft_consensus.cc:606] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 LEADER]: Received request to transfer leadership to TS 0e8199ed094d4061babcd1736d42ae84
I20260709 12:17:27.709828 12125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
mode: GRACEFUL
new_leader_uuid: "0e8199ed094d4061babcd1736d42ae84"
 from {username='slave'} at 127.0.0.1:45890
I20260709 12:17:27.710306 12125 raft_consensus.cc:606] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Received request to transfer leadership to TS 0e8199ed094d4061babcd1736d42ae84
I20260709 12:17:27.711403 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:27.711944 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:28.015607 12280 raft_consensus.cc:993] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec: : Instructing follower 0e8199ed094d4061babcd1736d42ae84 to start an election
I20260709 12:17:28.016022 12363 raft_consensus.cc:1081] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Signalling peer 0e8199ed094d4061babcd1736d42ae84 to start an election
I20260709 12:17:28.017482 12200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4"
dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
 from {username='slave'} at 127.0.0.1:43158
I20260709 12:17:28.017939 12200 raft_consensus.cc:493] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:28.018265 12200 raft_consensus.cc:3060] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.022330 12200 raft_consensus.cc:515] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:28.023778 12200 leader_election.cc:290] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 2 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:28.024664 12049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:28.024875 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:28.025288 12049 raft_consensus.cc:3060] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.025377 12125 raft_consensus.cc:3055] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:28.025749 12125 raft_consensus.cc:740] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:28.026625 12125 consensus_queue.cc:260] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:28.027842 12125 raft_consensus.cc:3060] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.032097 12049 raft_consensus.cc:2468] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 2.
I20260709 12:17:28.033358 12165 leader_election.cc:304] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:28.033879 12125 raft_consensus.cc:2468] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 2.
I20260709 12:17:28.034037 12358 raft_consensus.cc:2804] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.035557 12358 raft_consensus.cc:697] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Becoming Leader. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:28.036387 12358 consensus_queue.cc:237] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:28.043747 11947 catalog_manager.cc:5697] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 reported cstate change: term changed from 1 to 2, leader changed from 3152286337cd4eee8254979af6c272ec (127.11.163.2) to 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "0e8199ed094d4061babcd1736d42ae84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:28.106424 12334 raft_consensus.cc:993] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4: : Instructing follower 0e8199ed094d4061babcd1736d42ae84 to start an election
I20260709 12:17:28.106869 12362 raft_consensus.cc:1081] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 LEADER]: Signalling peer 0e8199ed094d4061babcd1736d42ae84 to start an election
I20260709 12:17:28.108496 12200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28"
dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
 from {username='slave'} at 127.0.0.1:43156
I20260709 12:17:28.108902 12200 raft_consensus.cc:493] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:28.109124 12200 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:28.113116 12200 raft_consensus.cc:515] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:28.114455 12200 leader_election.cc:290] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 3 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865)
I20260709 12:17:28.115397 12125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:28.115561 12049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:28.115985 12125 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:28.116017 12049 raft_consensus.cc:3055] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:28.116422 12049 raft_consensus.cc:740] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:28.117225 12049 consensus_queue.cc:260] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:28.118381 12049 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:28.122251 12125 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 3.
I20260709 12:17:28.123351 12164 leader_election.cc:304] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec; no voters: 
I20260709 12:17:28.124439 12358 raft_consensus.cc:2804] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:28.124444 12049 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 3.
I20260709 12:17:28.125028 12358 raft_consensus.cc:697] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 3 LEADER]: Becoming Leader. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:28.125761 12358 consensus_queue.cc:237] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:28.132949 11947 catalog_manager.cc:5697] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 reported cstate change: term changed from 2 to 3, leader changed from 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1) to 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3). New cstate: current_term: 3 leader_uuid: "0e8199ed094d4061babcd1736d42ae84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:28.462226 12125 raft_consensus.cc:1275] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:28.463647 12358 consensus_queue.cc:1048] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:28.472574 12049 raft_consensus.cc:1275] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:28.474267 12358 consensus_queue.cc:1048] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:28.569512 12049 raft_consensus.cc:1275] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:28.570739 12364 consensus_queue.cc:1048] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.580958 12125 raft_consensus.cc:1275] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:28.582608 12377 consensus_queue.cc:1048] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.712894 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:28.717835 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:28.718335 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:29.719787 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:29.725145 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:29.725623 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:30.726826 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:30.732371 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:30.732849 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:31.733969 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:31.739621 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:31.740023 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:32.740921 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:32.745846 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:32.746307 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:33.747253 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:33.752573 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:33.753022 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:34.753894 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:34.759073 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:34.759562 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:35.760609 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:35.765544 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:35.765992 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:36.766898 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:36.772859 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:36.773289 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:37.800375 11916 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:17:37.805040 12200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28"
dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
mode: GRACEFUL
new_leader_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:40544
I20260709 12:17:37.805902 12200 raft_consensus.cc:606] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 3 LEADER]: Received request to transfer leadership to TS 3152286337cd4eee8254979af6c272ec
I20260709 12:17:37.811014 12049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
mode: GRACEFUL
new_leader_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:45222
I20260709 12:17:37.811488 12049 raft_consensus.cc:606] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 LEADER]: Received request to transfer leadership to TS 3152286337cd4eee8254979af6c272ec
I20260709 12:17:37.816084 12049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
mode: GRACEFUL
new_leader_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:45222
I20260709 12:17:37.816493 12049 raft_consensus.cc:606] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Received request to transfer leadership to TS 3152286337cd4eee8254979af6c272ec
I20260709 12:17:37.821075 12049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
mode: GRACEFUL
new_leader_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:45222
I20260709 12:17:37.821501 12049 raft_consensus.cc:606] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 LEADER]: Received request to transfer leadership to TS 3152286337cd4eee8254979af6c272ec
I20260709 12:17:37.833730 12200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4"
dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
mode: GRACEFUL
new_leader_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:40544
I20260709 12:17:37.834151 12200 raft_consensus.cc:606] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Received request to transfer leadership to TS 3152286337cd4eee8254979af6c272ec
I20260709 12:17:38.110147 12377 raft_consensus.cc:993] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84: : Instructing follower 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:38.110685 12386 raft_consensus.cc:1081] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Signalling peer 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:38.112264 12125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:50924
I20260709 12:17:38.112740 12125 raft_consensus.cc:493] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:38.113059 12125 raft_consensus.cc:3060] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:38.116852 12377 raft_consensus.cc:993] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84: : Instructing follower 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:38.117281 12386 raft_consensus.cc:1081] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 3 LEADER]: Signalling peer 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:38.118835 12126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:50924
I20260709 12:17:38.119316 12126 raft_consensus.cc:493] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:38.118911 12125 raft_consensus.cc:515] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.119702 12126 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.121693 12125 leader_election.cc:290] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 3 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:38.122840 12049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:38.123116 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc6cf67d5e84146b6ddf629af5462a4" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:38.123580 12049 raft_consensus.cc:3060] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:38.123756 12200 raft_consensus.cc:3055] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:38.124100 12200 raft_consensus.cc:740] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:38.124872 12200 consensus_queue.cc:260] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.126111 12200 raft_consensus.cc:3060] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:38.126660 12126 raft_consensus.cc:515] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.128365 12049 raft_consensus.cc:2468] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 3.
I20260709 12:17:38.129639 12048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:38.129923 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:38.130220 12048 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.130483 12199 raft_consensus.cc:3055] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:38.130831 12199 raft_consensus.cc:740] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:38.131640 12199 consensus_queue.cc:260] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.132753 12199 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.132651 12091 leader_election.cc:304] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:38.133831 12363 raft_consensus.cc:2804] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:38.134178 12200 raft_consensus.cc:2468] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 3.
I20260709 12:17:38.135254 12363 raft_consensus.cc:697] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 3 LEADER]: Becoming Leader. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:38.136109 12363 consensus_queue.cc:237] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.137185 12048 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 4.
I20260709 12:17:38.138264 12091 leader_election.cc:304] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:38.139250 12385 raft_consensus.cc:2804] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:38.139469 12199 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 4.
I20260709 12:17:38.140621 12126 leader_election.cc:290] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 4 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:38.144496 12385 raft_consensus.cc:697] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 4 LEADER]: Becoming Leader. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:38.144645 11947 catalog_manager.cc:5697] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec reported cstate change: term changed from 2 to 3, leader changed from 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3) to 3152286337cd4eee8254979af6c272ec (127.11.163.2). New cstate: current_term: 3 leader_uuid: "3152286337cd4eee8254979af6c272ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:38.145529 12385 consensus_queue.cc:237] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.151229 12388 raft_consensus.cc:993] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4: : Instructing follower 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:38.151927 12362 raft_consensus.cc:1081] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Signalling peer 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:38.153595 12126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:50928
I20260709 12:17:38.154093 12126 raft_consensus.cc:493] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:38.154450 12126 raft_consensus.cc:3060] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:38.160745 12126 raft_consensus.cc:515] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.162536 12126 leader_election.cc:290] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 2 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:38.163772 12048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:38.164002 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:38.164278 12048 raft_consensus.cc:3055] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:38.164549 12199 raft_consensus.cc:3060] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:38.164641 12048 raft_consensus.cc:740] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:38.165491 12048 consensus_queue.cc:260] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.166326 11947 catalog_manager.cc:5697] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec reported cstate change: term changed from 3 to 4, leader changed from 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3) to 3152286337cd4eee8254979af6c272ec (127.11.163.2). New cstate: current_term: 4 leader_uuid: "3152286337cd4eee8254979af6c272ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:38.166805 12048 raft_consensus.cc:3060] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:38.172559 12199 raft_consensus.cc:2468] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 2.
I20260709 12:17:38.173357 12388 raft_consensus.cc:993] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4: : Instructing follower 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:38.173858 12362 raft_consensus.cc:1081] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 LEADER]: Signalling peer 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:38.173810 12048 raft_consensus.cc:2468] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 2.
I20260709 12:17:38.175030 12089 leader_election.cc:304] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec; no voters: 
I20260709 12:17:38.175663 12126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:50928
I20260709 12:17:38.175854 12385 raft_consensus.cc:2804] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:38.176167 12126 raft_consensus.cc:493] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:38.176370 12385 raft_consensus.cc:697] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 2 LEADER]: Becoming Leader. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:38.176573 12126 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.177218 12385 consensus_queue.cc:237] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.181622 12126 raft_consensus.cc:515] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.183653 12126 leader_election.cc:290] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 4 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:38.184301 12048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:38.184695 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:38.184934 12048 raft_consensus.cc:3055] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:38.185330 12199 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.185295 12048 raft_consensus.cc:740] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:38.185143 11947 catalog_manager.cc:5697] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec reported cstate change: term changed from 1 to 2, leader changed from 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1) to 3152286337cd4eee8254979af6c272ec (127.11.163.2). New cstate: current_term: 2 leader_uuid: "3152286337cd4eee8254979af6c272ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:38.186383 12048 consensus_queue.cc:260] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.187610 12048 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.194067 12048 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 4.
I20260709 12:17:38.195349 12091 leader_election.cc:304] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:38.196033 12385 raft_consensus.cc:2804] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:38.196261 12199 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 4.
I20260709 12:17:38.196535 12385 raft_consensus.cc:697] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 4 LEADER]: Becoming Leader. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:38.197417 12385 consensus_queue.cc:237] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.204154 11947 catalog_manager.cc:5697] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec reported cstate change: term changed from 3 to 4, leader changed from 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1) to 3152286337cd4eee8254979af6c272ec (127.11.163.2). New cstate: current_term: 4 leader_uuid: "3152286337cd4eee8254979af6c272ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:38.369505 12388 raft_consensus.cc:993] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4: : Instructing follower 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:38.370095 12362 raft_consensus.cc:1081] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 LEADER]: Signalling peer 3152286337cd4eee8254979af6c272ec to start an election
I20260709 12:17:38.371531 12126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
 from {username='slave'} at 127.0.0.1:50928
I20260709 12:17:38.371968 12126 raft_consensus.cc:493] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:38.372282 12126 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:38.376938 12126 raft_consensus.cc:515] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.378497 12126 leader_election.cc:290] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 3 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:38.379350 12048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:38.379597 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "3152286337cd4eee8254979af6c272ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:38.379932 12048 raft_consensus.cc:3055] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:38.380200 12199 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:38.380298 12048 raft_consensus.cc:740] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:38.381011 12048 consensus_queue.cc:260] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.381976 12048 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:38.385056 12199 raft_consensus.cc:2468] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 3.
I20260709 12:17:38.386245 12089 leader_election.cc:304] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 3152286337cd4eee8254979af6c272ec; no voters: 
I20260709 12:17:38.386651 12048 raft_consensus.cc:2468] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3152286337cd4eee8254979af6c272ec in term 3.
I20260709 12:17:38.386945 12385 raft_consensus.cc:2804] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:38.387439 12385 raft_consensus.cc:697] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 3 LEADER]: Becoming Leader. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:38.388257 12385 consensus_queue.cc:237] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:38.394989 11947 catalog_manager.cc:5697] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec reported cstate change: term changed from 2 to 3, leader changed from 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1) to 3152286337cd4eee8254979af6c272ec (127.11.163.2). New cstate: current_term: 3 leader_uuid: "3152286337cd4eee8254979af6c272ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:38.542776 12199 raft_consensus.cc:1275] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:38.544207 12385 consensus_queue.cc:1048] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.557581 12048 raft_consensus.cc:1275] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:38.559336 12385 consensus_queue.cc:1048] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.561775 12199 raft_consensus.cc:1275] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 4 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:38.563488 12385 consensus_queue.cc:1048] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:38.578377 12048 raft_consensus.cc:1275] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:38.580086 12363 consensus_queue.cc:1048] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:38.588114 12048 raft_consensus.cc:1275] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:38.589273 12385 consensus_queue.cc:1048] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:38.602020 12199 raft_consensus.cc:1275] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:38.603346 12385 consensus_queue.cc:1048] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:38.664500 12199 raft_consensus.cc:1275] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 4 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:38.665722 12363 consensus_queue.cc:1048] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.675243 12048 raft_consensus.cc:1275] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:38.677065 12385 consensus_queue.cc:1048] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.801694 12048 raft_consensus.cc:1275] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:38.803395 12385 consensus_queue.cc:1048] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.812505 12199 raft_consensus.cc:1275] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Refusing update from remote peer 3152286337cd4eee8254979af6c272ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:38.813989 12389 consensus_queue.cc:1048] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:40.865298 11916 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:17:40.866124 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:40.872965 12126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
mode: GRACEFUL
new_leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:45890
I20260709 12:17:40.873754 12126 raft_consensus.cc:606] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 4 LEADER]: Received request to transfer leadership to TS 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:40.876319 12126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
mode: GRACEFUL
new_leader_uuid: "0e8199ed094d4061babcd1736d42ae84"
 from {username='slave'} at 127.0.0.1:45890
I20260709 12:17:40.876812 12126 raft_consensus.cc:606] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 2 LEADER]: Received request to transfer leadership to TS 0e8199ed094d4061babcd1736d42ae84
I20260709 12:17:40.879050 12126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
mode: GRACEFUL
new_leader_uuid: "0e8199ed094d4061babcd1736d42ae84"
 from {username='slave'} at 127.0.0.1:45890
I20260709 12:17:40.879544 12126 raft_consensus.cc:606] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Received request to transfer leadership to TS 0e8199ed094d4061babcd1736d42ae84
I20260709 12:17:40.881978 12126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
mode: GRACEFUL
new_leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:45890
I20260709 12:17:40.882532 12126 raft_consensus.cc:606] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 4 LEADER]: Received request to transfer leadership to TS 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:40.884585 12126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed"
dest_uuid: "3152286337cd4eee8254979af6c272ec"
mode: GRACEFUL
new_leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:45890
I20260709 12:17:40.885030 12126 raft_consensus.cc:606] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 3 LEADER]: Received request to transfer leadership to TS 6e1ec5a9e997487891c58dd73ac305b4
I20260709 12:17:40.886006 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:40.886464 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:40.919452 12385 raft_consensus.cc:993] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec: : Instructing follower 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:40.920181 12413 raft_consensus.cc:1081] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 4 LEADER]: Signalling peer 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:40.921851 12048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:37502
I20260709 12:17:40.922353 12048 raft_consensus.cc:493] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:40.922686 12048 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:40.928234 12048 raft_consensus.cc:515] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:40.930531 12048 leader_election.cc:290] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 5 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:40.931582 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:40.931996 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d7a6293a5e4645bca0099d889b3a28" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:40.932425 12126 raft_consensus.cc:3055] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:40.932503 12199 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:40.932740 12126 raft_consensus.cc:740] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:40.933590 12126 consensus_queue.cc:260] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:40.934608 12126 raft_consensus.cc:3060] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:40.937266 12199 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 5.
I20260709 12:17:40.938570 12014 leader_election.cc:304] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:40.940121 12414 raft_consensus.cc:2804] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:40.940322 12126 raft_consensus.cc:2468] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 5.
I20260709 12:17:40.941128 12414 raft_consensus.cc:697] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 5 LEADER]: Becoming Leader. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:40.942157 12414 consensus_queue.cc:237] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:40.949478 11947 catalog_manager.cc:5697] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 reported cstate change: term changed from 4 to 5, leader changed from 3152286337cd4eee8254979af6c272ec (127.11.163.2) to 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1). New cstate: current_term: 5 leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:41.012967 12385 raft_consensus.cc:993] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec: : Instructing follower 0e8199ed094d4061babcd1736d42ae84 to start an election
I20260709 12:17:41.013419 12413 raft_consensus.cc:1081] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Signalling peer 0e8199ed094d4061babcd1736d42ae84 to start an election
I20260709 12:17:41.014772 12199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca"
dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
 from {username='slave'} at 127.0.0.1:43158
I20260709 12:17:41.015218 12199 raft_consensus.cc:493] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:41.015532 12199 raft_consensus.cc:3060] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.019696 12199 raft_consensus.cc:515] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.021772 12199 leader_election.cc:290] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 2 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:41.022661 12048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:41.022927 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac52ca303c4bba8b7546d8b1374eca" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:41.023252 12048 raft_consensus.cc:3060] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.023566 12126 raft_consensus.cc:3055] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:41.023893 12126 raft_consensus.cc:740] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:41.024586 12126 consensus_queue.cc:260] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.025489 12126 raft_consensus.cc:3060] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.028290 12048 raft_consensus.cc:2468] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 2.
I20260709 12:17:41.029606 12165 leader_election.cc:304] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:41.030366 12386 raft_consensus.cc:2804] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:41.030571 12126 raft_consensus.cc:2468] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 2.
I20260709 12:17:41.031761 12386 raft_consensus.cc:697] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Becoming Leader. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:41.032577 12386 consensus_queue.cc:237] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.039674 11947 catalog_manager.cc:5697] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 reported cstate change: term changed from 1 to 2, leader changed from 3152286337cd4eee8254979af6c272ec (127.11.163.2) to 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "0e8199ed094d4061babcd1736d42ae84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:41.233585 12385 raft_consensus.cc:993] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec: : Instructing follower 0e8199ed094d4061babcd1736d42ae84 to start an election
I20260709 12:17:41.234063 12413 raft_consensus.cc:1081] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 2 LEADER]: Signalling peer 0e8199ed094d4061babcd1736d42ae84 to start an election
I20260709 12:17:41.235575 12199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243"
dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
 from {username='slave'} at 127.0.0.1:43158
I20260709 12:17:41.236017 12199 raft_consensus.cc:493] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:41.236291 12199 raft_consensus.cc:3060] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.240197 12199 raft_consensus.cc:515] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.241546 12199 leader_election.cc:290] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 3 election: Requested vote from peers 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865), 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267)
I20260709 12:17:41.242384 12048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
I20260709 12:17:41.242588 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc43ff619294a0ca8cc1001b0232243" candidate_uuid: "0e8199ed094d4061babcd1736d42ae84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:41.242898 12048 raft_consensus.cc:3060] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.243170 12126 raft_consensus.cc:3055] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:41.243531 12126 raft_consensus.cc:740] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:41.244135 12126 consensus_queue.cc:260] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.244992 12126 raft_consensus.cc:3060] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.247581 12048 raft_consensus.cc:2468] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 3.
I20260709 12:17:41.248524 12165 leader_election.cc:304] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:41.249249 12386 raft_consensus.cc:2804] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:41.249684 12386 raft_consensus.cc:697] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 3 LEADER]: Becoming Leader. State: Replica: 0e8199ed094d4061babcd1736d42ae84, State: Running, Role: LEADER
I20260709 12:17:41.250056 12126 raft_consensus.cc:2468] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e8199ed094d4061babcd1736d42ae84 in term 3.
I20260709 12:17:41.250653 12386 consensus_queue.cc:237] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.252068 12385 raft_consensus.cc:993] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec: : Instructing follower 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:41.252532 12385 raft_consensus.cc:1081] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 4 LEADER]: Signalling peer 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:41.254423 12048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:37502
I20260709 12:17:41.255144 12048 raft_consensus.cc:493] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:41.255613 12048 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:41.259258 11947 catalog_manager.cc:5697] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 reported cstate change: term changed from 2 to 3, leader changed from 3152286337cd4eee8254979af6c272ec (127.11.163.2) to 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3). New cstate: current_term: 3 leader_uuid: "0e8199ed094d4061babcd1736d42ae84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:41.260223 12048 raft_consensus.cc:515] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.261941 12048 leader_election.cc:290] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 5 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:41.263255 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:41.263309 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876ff9c6bd1847ebbd953859d7cca074" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:41.263914 12199 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:41.263968 12126 raft_consensus.cc:3055] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:41.264344 12126 raft_consensus.cc:740] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:41.265144 12126 consensus_queue.cc:260] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.266314 12126 raft_consensus.cc:3060] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:41.270612 12199 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 5.
I20260709 12:17:41.271687 12014 leader_election.cc:304] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8199ed094d4061babcd1736d42ae84, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:41.272377 12414 raft_consensus.cc:2804] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:41.272459 12126 raft_consensus.cc:2468] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 5.
I20260709 12:17:41.272903 12414 raft_consensus.cc:697] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 5 LEADER]: Becoming Leader. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:41.273658 12414 consensus_queue.cc:237] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.280123 11947 catalog_manager.cc:5697] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 reported cstate change: term changed from 4 to 5, leader changed from 3152286337cd4eee8254979af6c272ec (127.11.163.2) to 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1). New cstate: current_term: 5 leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:41.342191 12385 raft_consensus.cc:993] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec: : Instructing follower 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:41.342665 12413 raft_consensus.cc:1081] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 3 LEADER]: Signalling peer 6e1ec5a9e997487891c58dd73ac305b4 to start an election
I20260709 12:17:41.344247 12048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed"
dest_uuid: "6e1ec5a9e997487891c58dd73ac305b4"
 from {username='slave'} at 127.0.0.1:37502
I20260709 12:17:41.344877 12048 raft_consensus.cc:493] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:41.345230 12048 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.345640 12199 raft_consensus.cc:1275] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 5 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:41.346899 12414 consensus_queue.cc:1048] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:41.351857 12048 raft_consensus.cc:515] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.354583 12126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3152286337cd4eee8254979af6c272ec"
I20260709 12:17:41.355660 12126 raft_consensus.cc:3055] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:41.355981 12126 raft_consensus.cc:740] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3152286337cd4eee8254979af6c272ec, State: Running, Role: LEADER
I20260709 12:17:41.356670 12126 consensus_queue.cc:260] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.357893 12126 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.358875 12125 raft_consensus.cc:1275] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 5 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:41.361264 12415 consensus_queue.cc:1048] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:41.365959 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ac5b212184e0683a59fd95f12c5ed" candidate_uuid: "6e1ec5a9e997487891c58dd73ac305b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0e8199ed094d4061babcd1736d42ae84"
I20260709 12:17:41.372115 12199 raft_consensus.cc:3060] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.373813 12126 raft_consensus.cc:2468] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 4.
I20260709 12:17:41.375044 12015 leader_election.cc:304] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3152286337cd4eee8254979af6c272ec, 6e1ec5a9e997487891c58dd73ac305b4; no voters: 
I20260709 12:17:41.375983 12414 raft_consensus.cc:2804] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:41.376420 12414 raft_consensus.cc:697] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 LEADER]: Becoming Leader. State: Replica: 6e1ec5a9e997487891c58dd73ac305b4, State: Running, Role: LEADER
I20260709 12:17:41.354559 12048 leader_election.cc:290] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [CANDIDATE]: Term 4 election: Requested vote from peers 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267), 0e8199ed094d4061babcd1736d42ae84 (127.11.163.3:42781)
I20260709 12:17:41.377228 12414 consensus_queue.cc:237] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } }
I20260709 12:17:41.383916 12199 raft_consensus.cc:2468] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e1ec5a9e997487891c58dd73ac305b4 in term 4.
I20260709 12:17:41.384970 11946 catalog_manager.cc:5697] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 reported cstate change: term changed from 3 to 4, leader changed from 3152286337cd4eee8254979af6c272ec (127.11.163.2) to 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1). New cstate: current_term: 4 leader_uuid: "6e1ec5a9e997487891c58dd73ac305b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:41.459198 12126 raft_consensus.cc:1275] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:41.460675 12386 consensus_queue.cc:1048] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:41.470544 12048 raft_consensus.cc:1275] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:41.472007 12386 consensus_queue.cc:1048] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:41.742224 12048 raft_consensus.cc:1275] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:41.743537 12433 consensus_queue.cc:1048] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e1ec5a9e997487891c58dd73ac305b4" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:41.749056 12126 raft_consensus.cc:1275] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Refusing update from remote peer 0e8199ed094d4061babcd1736d42ae84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:41.750370 12433 consensus_queue.cc:1048] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:41.762359 12126 raft_consensus.cc:1275] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 5 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:41.763646 12428 consensus_queue.cc:1048] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:41.773502 12199 raft_consensus.cc:1275] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 5 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:41.775251 12415 consensus_queue.cc:1048] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:41.887954 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:41.889284 12199 raft_consensus.cc:1275] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 4 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:41.891543 12414 consensus_queue.cc:1048] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8199ed094d4061babcd1736d42ae84" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:41.896363 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:41.897010 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:41.901369 12126 raft_consensus.cc:1275] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 4 FOLLOWER]: Refusing update from remote peer 6e1ec5a9e997487891c58dd73ac305b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:41.903772 12415 consensus_queue.cc:1048] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3152286337cd4eee8254979af6c272ec" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:42.898149 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:42.904889 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:42.905268 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:43.906466 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:43.911271 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:43.911666 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:44.912590 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:44.917460 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:44.917811 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:45.918905 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:45.924459 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:45.924966 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:46.926043 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:46.930967 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:46.931411 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:47.932514 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:47.937738 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:47.938177 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:48.939234 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:48.944741 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:48.945163 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:49.946918 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:49.954267 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:49.954721 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:51.004539 11916 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:17:51.005113 11916 tablet_server.cc:179] TabletServer@127.11.163.1:0 shutting down...
I20260709 12:17:51.033816 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:51.034686 11916 tablet_replica.cc:333] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4: stopping tablet replica
I20260709 12:17:51.035909 11916 raft_consensus.cc:2243] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.036705 11916 raft_consensus.cc:2272] T 6cac52ca303c4bba8b7546d8b1374eca P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.039041 11916 tablet_replica.cc:333] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4: stopping tablet replica
I20260709 12:17:51.039570 11916 raft_consensus.cc:2243] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.040012 11916 raft_consensus.cc:2272] T 7e4c06558c1844528728331e2e261020 P 6e1ec5a9e997487891c58dd73ac305b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.041841 11916 tablet_replica.cc:333] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4: stopping tablet replica
I20260709 12:17:51.042285 11916 raft_consensus.cc:2243] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.042649 11916 raft_consensus.cc:2272] T 6976c9fe8e804edda4e5132efd393fe9 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.044204 11916 tablet_replica.cc:333] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4: stopping tablet replica
I20260709 12:17:51.044648 11916 raft_consensus.cc:2243] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.044997 11916 raft_consensus.cc:2272] T 3dc43ff619294a0ca8cc1001b0232243 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.046532 11916 tablet_replica.cc:333] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4: stopping tablet replica
I20260709 12:17:51.046941 11916 raft_consensus.cc:2243] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.047271 11916 raft_consensus.cc:2272] T 65e8fcfce3cc43d38d3acc6b153569d3 P 6e1ec5a9e997487891c58dd73ac305b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.048938 11916 tablet_replica.cc:333] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4: stopping tablet replica
I20260709 12:17:51.049486 11916 raft_consensus.cc:2243] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.050175 11916 raft_consensus.cc:2272] T 01d7a6293a5e4645bca0099d889b3a28 P 6e1ec5a9e997487891c58dd73ac305b4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.051838 11916 tablet_replica.cc:333] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4: stopping tablet replica
I20260709 12:17:51.052268 11916 raft_consensus.cc:2243] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.052616 11916 raft_consensus.cc:2272] T edc6cf67d5e84146b6ddf629af5462a4 P 6e1ec5a9e997487891c58dd73ac305b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.054183 11916 tablet_replica.cc:333] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4: stopping tablet replica
I20260709 12:17:51.054615 11916 raft_consensus.cc:2243] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.055285 11916 raft_consensus.cc:2272] T 876ff9c6bd1847ebbd953859d7cca074 P 6e1ec5a9e997487891c58dd73ac305b4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.056874 11916 tablet_replica.cc:333] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4: stopping tablet replica
I20260709 12:17:51.057256 11916 raft_consensus.cc:2243] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.057902 11916 raft_consensus.cc:2272] T bd6ac5b212184e0683a59fd95f12c5ed P 6e1ec5a9e997487891c58dd73ac305b4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:51.151661 12165 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.163.1:37865: connect: Connection refused (error 111)
I20260709 12:17:51.154212 11916 tablet_server.cc:196] TabletServer@127.11.163.1:0 shutdown complete.
W20260709 12:17:51.156360 12165 consensus_peers.cc:597] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 -> Peer 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865): Couldn't send request to peer 6e1ec5a9e997487891c58dd73ac305b4. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:51.161581 12091 consensus_peers.cc:597] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec -> Peer 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865): Couldn't send request to peer 6e1ec5a9e997487891c58dd73ac305b4. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:51.177105 11916 tablet_server.cc:179] TabletServer@127.11.163.2:0 shutting down...
W20260709 12:17:51.180953 12165 consensus_peers.cc:597] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 -> Peer 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865): Couldn't send request to peer 6e1ec5a9e997487891c58dd73ac305b4. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:51.203054 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:51.203996 11916 tablet_replica.cc:333] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec: stopping tablet replica
I20260709 12:17:51.204633 11916 raft_consensus.cc:2243] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.205122 11916 raft_consensus.cc:2272] T bd6ac5b212184e0683a59fd95f12c5ed P 3152286337cd4eee8254979af6c272ec [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.207026 11916 tablet_replica.cc:333] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec: stopping tablet replica
I20260709 12:17:51.207597 11916 raft_consensus.cc:2243] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.208045 11916 raft_consensus.cc:2272] T 876ff9c6bd1847ebbd953859d7cca074 P 3152286337cd4eee8254979af6c272ec [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.209669 11916 tablet_replica.cc:333] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec: stopping tablet replica
I20260709 12:17:51.210158 11916 raft_consensus.cc:2243] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.210572 11916 raft_consensus.cc:2272] T 3dc43ff619294a0ca8cc1001b0232243 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.212284 11916 tablet_replica.cc:333] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec: stopping tablet replica
I20260709 12:17:51.212786 11916 raft_consensus.cc:2243] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.213574 11916 raft_consensus.cc:2272] T 7e4c06558c1844528728331e2e261020 P 3152286337cd4eee8254979af6c272ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.215219 11916 tablet_replica.cc:333] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec: stopping tablet replica
I20260709 12:17:51.215755 11916 raft_consensus.cc:2243] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.216496 11916 raft_consensus.cc:2272] T edc6cf67d5e84146b6ddf629af5462a4 P 3152286337cd4eee8254979af6c272ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.218114 11916 tablet_replica.cc:333] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec: stopping tablet replica
I20260709 12:17:51.218597 11916 raft_consensus.cc:2243] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.219025 11916 raft_consensus.cc:2272] T 01d7a6293a5e4645bca0099d889b3a28 P 3152286337cd4eee8254979af6c272ec [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.220731 11916 tablet_replica.cc:333] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec: stopping tablet replica
I20260709 12:17:51.221189 11916 raft_consensus.cc:2243] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.221915 11916 raft_consensus.cc:2272] T 65e8fcfce3cc43d38d3acc6b153569d3 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.223582 11916 tablet_replica.cc:333] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec: stopping tablet replica
I20260709 12:17:51.224052 11916 raft_consensus.cc:2243] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.224454 11916 raft_consensus.cc:2272] T 6cac52ca303c4bba8b7546d8b1374eca P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.226055 11916 tablet_replica.cc:333] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec: stopping tablet replica
I20260709 12:17:51.226531 11916 raft_consensus.cc:2243] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.226951 11916 raft_consensus.cc:2272] T 6976c9fe8e804edda4e5132efd393fe9 P 3152286337cd4eee8254979af6c272ec [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:51.240470 12164 consensus_peers.cc:597] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 -> Peer 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267): Couldn't send request to peer 3152286337cd4eee8254979af6c272ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:51.257740 11916 tablet_server.cc:196] TabletServer@127.11.163.2:0 shutdown complete.
W20260709 12:17:51.277145 12164 consensus_peers.cc:597] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 -> Peer 3152286337cd4eee8254979af6c272ec (127.11.163.2:40267): Couldn't send request to peer 3152286337cd4eee8254979af6c272ec. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:40267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:51.278882 11916 tablet_server.cc:179] TabletServer@127.11.163.3:0 shutting down...
W20260709 12:17:51.294636 11979 debug-util.cc:398] Leaking SignalData structure 0x7b08000a09a0 after lost signal to thread 11919
W20260709 12:17:51.295692 11979 debug-util.cc:398] Leaking SignalData structure 0x7b080008bb20 after lost signal to thread 11982
W20260709 12:17:51.297991 11979 debug-util.cc:398] Leaking SignalData structure 0x7b08001ed140 after lost signal to thread 12224
W20260709 12:17:51.303045 12165 consensus_peers.cc:597] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 -> Peer 6e1ec5a9e997487891c58dd73ac305b4 (127.11.163.1:37865): Couldn't send request to peer 6e1ec5a9e997487891c58dd73ac305b4. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:37865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:51.315766 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:51.316646 11916 tablet_replica.cc:333] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84: stopping tablet replica
I20260709 12:17:51.317324 11916 raft_consensus.cc:2243] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.318184 11916 raft_consensus.cc:2272] T 6976c9fe8e804edda4e5132efd393fe9 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.320226 11916 tablet_replica.cc:333] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84: stopping tablet replica
I20260709 12:17:51.320905 11916 raft_consensus.cc:2243] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.321357 11916 raft_consensus.cc:2272] T 65e8fcfce3cc43d38d3acc6b153569d3 P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.323102 11916 tablet_replica.cc:333] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84: stopping tablet replica
I20260709 12:17:51.323657 11916 raft_consensus.cc:2243] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.324455 11916 raft_consensus.cc:2272] T 3dc43ff619294a0ca8cc1001b0232243 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.326285 11916 tablet_replica.cc:333] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84: stopping tablet replica
I20260709 12:17:51.326911 11916 raft_consensus.cc:2243] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.327339 11916 raft_consensus.cc:2272] T 7e4c06558c1844528728331e2e261020 P 0e8199ed094d4061babcd1736d42ae84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.329231 11916 tablet_replica.cc:333] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84: stopping tablet replica
I20260709 12:17:51.329732 11916 raft_consensus.cc:2243] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.330150 11916 raft_consensus.cc:2272] T edc6cf67d5e84146b6ddf629af5462a4 P 0e8199ed094d4061babcd1736d42ae84 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.331812 11916 tablet_replica.cc:333] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84: stopping tablet replica
I20260709 12:17:51.332288 11916 raft_consensus.cc:2243] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.332729 11916 raft_consensus.cc:2272] T 01d7a6293a5e4645bca0099d889b3a28 P 0e8199ed094d4061babcd1736d42ae84 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.334558 11916 tablet_replica.cc:333] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84: stopping tablet replica
I20260709 12:17:51.335018 11916 raft_consensus.cc:2243] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.335539 11916 raft_consensus.cc:2272] T 876ff9c6bd1847ebbd953859d7cca074 P 0e8199ed094d4061babcd1736d42ae84 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.337177 11916 tablet_replica.cc:333] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84: stopping tablet replica
I20260709 12:17:51.337628 11916 raft_consensus.cc:2243] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.338340 11916 raft_consensus.cc:2272] T 6cac52ca303c4bba8b7546d8b1374eca P 0e8199ed094d4061babcd1736d42ae84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.340145 11916 tablet_replica.cc:333] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84: stopping tablet replica
I20260709 12:17:51.340569 11916 raft_consensus.cc:2243] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.341010 11916 raft_consensus.cc:2272] T bd6ac5b212184e0683a59fd95f12c5ed P 0e8199ed094d4061babcd1736d42ae84 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.371495 11916 tablet_server.cc:196] TabletServer@127.11.163.3:0 shutdown complete.
I20260709 12:17:51.392091 11916 master.cc:562] Master@127.11.163.62:41373 shutting down...
I20260709 12:17:51.597466 11916 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:51.598037 11916 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.598320 11916 tablet_replica.cc:333] T 00000000000000000000000000000000 P b87ace67a6424f549f594eb7370ed9d1: stopping tablet replica
I20260709 12:17:51.641677 11916 master.cc:584] Master@127.11.163.62:41373 shutdown complete.
0e8199ed094d4061babcd1736d42ae84  1
3152286337cd4eee8254979af6c272ec  4
6e1ec5a9e997487891c58dd73ac305b4  4
0e8199ed094d4061babcd1736d42ae84  3
3152286337cd4eee8254979af6c272ec  3
6e1ec5a9e997487891c58dd73ac305b4  3
0e8199ed094d4061babcd1736d42ae84  1
3152286337cd4eee8254979af6c272ec  8
6e1ec5a9e997487891c58dd73ac305b4  0
0e8199ed094d4061babcd1736d42ae84  3
3152286337cd4eee8254979af6c272ec  3
6e1ec5a9e997487891c58dd73ac305b4  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32688 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:17:51.685710 11916 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.163.62:39741
I20260709 12:17:51.686821 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:51.692392 12458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:51.694020 12459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:51.694227 12461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:51.694860 11916 server_base.cc:1061] running on GCE node
I20260709 12:17:51.695849 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:51.696024 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:51.696138 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599471696128 us; error 0 us; skew 500 ppm
I20260709 12:17:51.696585 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:51.698773 11916 webserver.cc:533] Webserver started at http://127.11.163.62:34661/ using document root <none> and password file <none>
I20260709 12:17:51.699230 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:51.699396 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:51.699699 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:51.700773 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/master-0-root/instance:
uuid: "23d19e0f1d504b208faf2faeee8133c6"
format_stamp: "Formatted at 2026-07-09 12:17:51 on dist-test-slave-z9f9"
I20260709 12:17:51.705125 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:17:51.708384 12466 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:51.709115 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:17:51.709396 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/master-0-root
uuid: "23d19e0f1d504b208faf2faeee8133c6"
format_stamp: "Formatted at 2026-07-09 12:17:51 on dist-test-slave-z9f9"
I20260709 12:17:51.709637 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:51.732406 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:51.733635 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:51.771366 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.62:39741
I20260709 12:17:51.771637 12517 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.62:39741 every 8 connection(s)
I20260709 12:17:51.775266 12518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.784709 12518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6: Bootstrap starting.
I20260709 12:17:51.789319 12518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.793449 12518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6: No bootstrap required, opened a new log
I20260709 12:17:51.795707 12518 raft_consensus.cc:359] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d19e0f1d504b208faf2faeee8133c6" member_type: VOTER }
I20260709 12:17:51.796114 12518 raft_consensus.cc:385] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.796291 12518 raft_consensus.cc:740] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23d19e0f1d504b208faf2faeee8133c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.796859 12518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d19e0f1d504b208faf2faeee8133c6" member_type: VOTER }
I20260709 12:17:51.797286 12518 raft_consensus.cc:399] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:51.797485 12518 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:51.797690 12518 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.802062 12518 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d19e0f1d504b208faf2faeee8133c6" member_type: VOTER }
I20260709 12:17:51.802522 12518 leader_election.cc:304] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23d19e0f1d504b208faf2faeee8133c6; no voters: 
I20260709 12:17:51.803618 12518 leader_election.cc:290] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:51.804015 12521 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.805378 12521 raft_consensus.cc:697] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [term 1 LEADER]: Becoming Leader. State: Replica: 23d19e0f1d504b208faf2faeee8133c6, State: Running, Role: LEADER
I20260709 12:17:51.805994 12521 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d19e0f1d504b208faf2faeee8133c6" member_type: VOTER }
I20260709 12:17:51.806547 12518 sys_catalog.cc:565] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:51.811645 12522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23d19e0f1d504b208faf2faeee8133c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d19e0f1d504b208faf2faeee8133c6" member_type: VOTER } }
I20260709 12:17:51.812250 12522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:51.812067 12523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23d19e0f1d504b208faf2faeee8133c6. Latest consensus state: current_term: 1 leader_uuid: "23d19e0f1d504b208faf2faeee8133c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23d19e0f1d504b208faf2faeee8133c6" member_type: VOTER } }
I20260709 12:17:51.812783 12523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:51.814230 12528 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:51.819247 12528 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:51.823081 11916 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:51.828372 12528 catalog_manager.cc:1383] Generated new cluster ID: cd37f9caf7f5451db13103ce111cc437
I20260709 12:17:51.828723 12528 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:51.844367 12528 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:51.845583 12528 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:51.860934 12528 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6: Generated new TSK 0
I20260709 12:17:51.861550 12528 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:51.889765 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:51.895866 12539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:51.896845 12540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:51.898561 12542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:51.899003 11916 server_base.cc:1061] running on GCE node
I20260709 12:17:51.900080 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:51.900285 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:51.900467 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599471900447 us; error 0 us; skew 500 ppm
I20260709 12:17:51.901018 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:51.903276 11916 webserver.cc:533] Webserver started at http://127.11.163.1:39005/ using document root <none> and password file <none>
I20260709 12:17:51.903836 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:51.904007 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:51.904323 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:51.905400 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-0-root/instance:
uuid: "72de5314c0724365b7e9be8b9a310371"
format_stamp: "Formatted at 2026-07-09 12:17:51 on dist-test-slave-z9f9"
I20260709 12:17:51.909731 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:17:51.913105 12547 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:51.913879 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:17:51.914165 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-0-root
uuid: "72de5314c0724365b7e9be8b9a310371"
format_stamp: "Formatted at 2026-07-09 12:17:51 on dist-test-slave-z9f9"
I20260709 12:17:51.914463 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:51.935319 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:51.936630 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:51.938093 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:51.940445 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:51.940670 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:51.940953 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:51.941148 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:51.980681 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.1:43275
I20260709 12:17:51.980798 12609 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.1:43275 every 8 connection(s)
I20260709 12:17:51.985644 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:51.992591 12614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:51.995133 12615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:51.998045 12617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:51.998669 12610 heartbeater.cc:344] Connected to a master server at 127.11.163.62:39741
I20260709 12:17:51.998915 11916 server_base.cc:1061] running on GCE node
I20260709 12:17:51.999109 12610 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:52.000006 12610 heartbeater.cc:507] Master 127.11.163.62:39741 requested a full tablet report, sending...
I20260709 12:17:52.000530 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:52.000753 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:52.000952 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599472000930 us; error 0 us; skew 500 ppm
I20260709 12:17:52.001575 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:52.002322 12483 ts_manager.cc:194] Registered new tserver with Master: 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275)
I20260709 12:17:52.004406 11916 webserver.cc:533] Webserver started at http://127.11.163.2:38981/ using document root <none> and password file <none>
I20260709 12:17:52.004931 12483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60616
I20260709 12:17:52.005045 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:52.005362 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:52.005735 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:52.006932 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-1-root/instance:
uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
format_stamp: "Formatted at 2026-07-09 12:17:52 on dist-test-slave-z9f9"
I20260709 12:17:52.011711 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:17:52.014946 12622 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:52.015743 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:17:52.016083 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-1-root
uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
format_stamp: "Formatted at 2026-07-09 12:17:52 on dist-test-slave-z9f9"
I20260709 12:17:52.016376 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:52.033740 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:52.035391 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:52.037070 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:52.039333 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:52.039592 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:52.039839 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:52.040019 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:52.078835 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.2:35079
I20260709 12:17:52.078956 12684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.2:35079 every 8 connection(s)
I20260709 12:17:52.083647 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:52.090004 12688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:52.091686 12689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:52.093552 11916 server_base.cc:1061] running on GCE node
W20260709 12:17:52.094841 12691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:52.095196 12685 heartbeater.cc:344] Connected to a master server at 127.11.163.62:39741
I20260709 12:17:52.095739 12685 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:52.095928 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:52.096167 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:52.096339 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599472096306 us; error 0 us; skew 500 ppm
I20260709 12:17:52.096545 12685 heartbeater.cc:507] Master 127.11.163.62:39741 requested a full tablet report, sending...
I20260709 12:17:52.096933 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:52.098721 12483 ts_manager.cc:194] Registered new tserver with Master: f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:17:52.099766 11916 webserver.cc:533] Webserver started at http://127.11.163.3:41649/ using document root <none> and password file <none>
I20260709 12:17:52.100397 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:52.100631 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:52.100574 12483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60622
I20260709 12:17:52.101042 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:52.102381 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-2-root/instance:
uuid: "b162f67fa3b74f04a3424673bfb3862d"
format_stamp: "Formatted at 2026-07-09 12:17:52 on dist-test-slave-z9f9"
I20260709 12:17:52.106797 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:17:52.110203 12696 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:52.111121 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:17:52.111397 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-2-root
uuid: "b162f67fa3b74f04a3424673bfb3862d"
format_stamp: "Formatted at 2026-07-09 12:17:52 on dist-test-slave-z9f9"
I20260709 12:17:52.111722 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599438829268-11916-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:52.134822 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:52.136102 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:52.137612 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:52.140139 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:52.140334 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:52.140672 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:52.140849 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:52.182461 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.3:36185
I20260709 12:17:52.182550 12758 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.3:36185 every 8 connection(s)
I20260709 12:17:52.196910 12759 heartbeater.cc:344] Connected to a master server at 127.11.163.62:39741
I20260709 12:17:52.197229 12759 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:52.197980 12759 heartbeater.cc:507] Master 127.11.163.62:39741 requested a full tablet report, sending...
I20260709 12:17:52.199976 12483 ts_manager.cc:194] Registered new tserver with Master: b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.200304 11916 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014561743s
I20260709 12:17:52.201345 12483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60636
I20260709 12:17:52.226691 12483 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60648:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:52.229604 12483 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:52.297653 12575 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac9f950e9ec4d66a9552ab3b5b20797 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:52.300767 12574 tablet_service.cc:1511] Processing CreateTablet for tablet a8c764bc8c1149619efbee37157b7e15 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:52.299301 12575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac9f950e9ec4d66a9552ab3b5b20797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.303758 12573 tablet_service.cc:1511] Processing CreateTablet for tablet 8550130ad49e4eb5baa0a9b8b74e5a86 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:52.305436 12573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8550130ad49e4eb5baa0a9b8b74e5a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.307992 12574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c764bc8c1149619efbee37157b7e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.309412 12572 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff7da6340cc41388f09bd5414a82387 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:52.310809 12572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff7da6340cc41388f09bd5414a82387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.319468 12571 tablet_service.cc:1511] Processing CreateTablet for tablet 51fba4f59b5a4fd2bed6d7a1c4f07a9c (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:52.320276 12724 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac9f950e9ec4d66a9552ab3b5b20797 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:52.320959 12571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fba4f59b5a4fd2bed6d7a1c4f07a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.321596 12724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac9f950e9ec4d66a9552ab3b5b20797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.325314 12570 tablet_service.cc:1511] Processing CreateTablet for tablet e0e447db86a44533bb94a5dea94eddac (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:52.325637 12723 tablet_service.cc:1511] Processing CreateTablet for tablet a8c764bc8c1149619efbee37157b7e15 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:52.326767 12723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c764bc8c1149619efbee37157b7e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.326767 12570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e447db86a44533bb94a5dea94eddac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.341527 12722 tablet_service.cc:1511] Processing CreateTablet for tablet 8550130ad49e4eb5baa0a9b8b74e5a86 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:52.343007 12722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8550130ad49e4eb5baa0a9b8b74e5a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.342953 12569 tablet_service.cc:1511] Processing CreateTablet for tablet 97ba3508e121404d93be0617e39b4761 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:52.344511 12569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ba3508e121404d93be0617e39b4761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.348704 12568 tablet_service.cc:1511] Processing CreateTablet for tablet 05f6c5e91ca64d548d544dcc61cd58c9 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:52.349251 12721 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff7da6340cc41388f09bd5414a82387 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:52.350203 12568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f6c5e91ca64d548d544dcc61cd58c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.350818 12721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff7da6340cc41388f09bd5414a82387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.357609 12720 tablet_service.cc:1511] Processing CreateTablet for tablet 51fba4f59b5a4fd2bed6d7a1c4f07a9c (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:52.359122 12720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fba4f59b5a4fd2bed6d7a1c4f07a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.370731 12719 tablet_service.cc:1511] Processing CreateTablet for tablet e0e447db86a44533bb94a5dea94eddac (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:52.371326 12773 tablet_bootstrap.cc:492] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371: Bootstrap starting.
I20260709 12:17:52.372205 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e447db86a44533bb94a5dea94eddac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.376349 12718 tablet_service.cc:1511] Processing CreateTablet for tablet 97ba3508e121404d93be0617e39b4761 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:52.378038 12718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ba3508e121404d93be0617e39b4761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.376372 12717 tablet_service.cc:1511] Processing CreateTablet for tablet 05f6c5e91ca64d548d544dcc61cd58c9 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:52.384438 12717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f6c5e91ca64d548d544dcc61cd58c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.401976 12774 tablet_bootstrap.cc:492] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d: Bootstrap starting.
I20260709 12:17:52.402595 12650 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac9f950e9ec4d66a9552ab3b5b20797 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:52.403301 12773 tablet_bootstrap.cc:654] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.404408 12724 tablet_service.cc:1511] Processing CreateTablet for tablet 05ee51fe7dd94be09755c2d154bb04bc (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:52.406682 12649 tablet_service.cc:1511] Processing CreateTablet for tablet a8c764bc8c1149619efbee37157b7e15 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:52.406944 12648 tablet_service.cc:1511] Processing CreateTablet for tablet 8550130ad49e4eb5baa0a9b8b74e5a86 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:52.408272 12645 tablet_service.cc:1511] Processing CreateTablet for tablet e0e447db86a44533bb94a5dea94eddac (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:52.408690 12647 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff7da6340cc41388f09bd5414a82387 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:52.409279 12644 tablet_service.cc:1511] Processing CreateTablet for tablet 97ba3508e121404d93be0617e39b4761 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:52.410455 12646 tablet_service.cc:1511] Processing CreateTablet for tablet 51fba4f59b5a4fd2bed6d7a1c4f07a9c (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:52.410490 12643 tablet_service.cc:1511] Processing CreateTablet for tablet 05f6c5e91ca64d548d544dcc61cd58c9 (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:52.410941 12642 tablet_service.cc:1511] Processing CreateTablet for tablet e2d9b2d826a044f397d5372acbc7200b (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:52.404436 12719 tablet_service.cc:1511] Processing CreateTablet for tablet e2d9b2d826a044f397d5372acbc7200b (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:52.413371 12641 tablet_service.cc:1511] Processing CreateTablet for tablet 05ee51fe7dd94be09755c2d154bb04bc (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:52.416257 12650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac9f950e9ec4d66a9552ab3b5b20797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.399359 12571 tablet_service.cc:1511] Processing CreateTablet for tablet e2d9b2d826a044f397d5372acbc7200b (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:52.420898 12641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ee51fe7dd94be09755c2d154bb04bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.421231 12571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d9b2d826a044f397d5372acbc7200b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.421535 12648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8550130ad49e4eb5baa0a9b8b74e5a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.422326 12643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f6c5e91ca64d548d544dcc61cd58c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.422963 12649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c764bc8c1149619efbee37157b7e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.423655 12646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fba4f59b5a4fd2bed6d7a1c4f07a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.424283 12642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d9b2d826a044f397d5372acbc7200b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.425061 12644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ba3508e121404d93be0617e39b4761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.425209 12724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ee51fe7dd94be09755c2d154bb04bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.426258 12647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff7da6340cc41388f09bd5414a82387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.427640 12645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e447db86a44533bb94a5dea94eddac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.432508 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d9b2d826a044f397d5372acbc7200b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.443989 12573 tablet_service.cc:1511] Processing CreateTablet for tablet 05ee51fe7dd94be09755c2d154bb04bc (DEFAULT_TABLE table=test-workload [id=1a9f120cf9a0492793998680048502fb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:52.445860 12573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ee51fe7dd94be09755c2d154bb04bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.473604 12773 tablet_bootstrap.cc:492] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371: No bootstrap required, opened a new log
I20260709 12:17:52.474241 12773 ts_tablet_manager.cc:1403] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.000s
I20260709 12:17:52.477666 12773 raft_consensus.cc:359] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.494182 12773 raft_consensus.cc:385] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.494622 12773 raft_consensus.cc:740] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.493427 12774 tablet_bootstrap.cc:654] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.498167 12773 consensus_queue.cc:260] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.521597 12774 tablet_bootstrap.cc:492] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d: No bootstrap required, opened a new log
I20260709 12:17:52.522112 12774 ts_tablet_manager.cc:1403] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d: Time spent bootstrapping tablet: real 0.121s	user 0.005s	sys 0.010s
I20260709 12:17:52.525007 12774 raft_consensus.cc:359] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.525738 12774 raft_consensus.cc:385] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.526048 12774 raft_consensus.cc:740] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.528585 12778 tablet_bootstrap.cc:492] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24: Bootstrap starting.
I20260709 12:17:52.530858 12610 heartbeater.cc:499] Master 127.11.163.62:39741 was elected leader, sending a full tablet report...
I20260709 12:17:52.531544 12773 ts_tablet_manager.cc:1434] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 12:17:52.532593 12773 tablet_bootstrap.cc:492] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371: Bootstrap starting.
I20260709 12:17:52.535357 12778 tablet_bootstrap.cc:654] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.538306 12773 tablet_bootstrap.cc:654] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.526852 12774 consensus_queue.cc:260] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.543092 12778 tablet_bootstrap.cc:492] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24: No bootstrap required, opened a new log
I20260709 12:17:52.543637 12778 ts_tablet_manager.cc:1403] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:17:52.546550 12778 raft_consensus.cc:359] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.547315 12778 raft_consensus.cc:385] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.547794 12778 raft_consensus.cc:740] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.548744 12778 consensus_queue.cc:260] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.550974 12759 heartbeater.cc:499] Master 127.11.163.62:39741 was elected leader, sending a full tablet report...
I20260709 12:17:52.551671 12774 ts_tablet_manager.cc:1434] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.009s
I20260709 12:17:52.552742 12774 tablet_bootstrap.cc:492] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d: Bootstrap starting.
I20260709 12:17:52.553825 12773 tablet_bootstrap.cc:492] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371: No bootstrap required, opened a new log
I20260709 12:17:52.554380 12773 ts_tablet_manager.cc:1403] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.014s
I20260709 12:17:52.557251 12773 raft_consensus.cc:359] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.558014 12773 raft_consensus.cc:385] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.558323 12773 raft_consensus.cc:740] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.559041 12774 tablet_bootstrap.cc:654] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.559032 12773 consensus_queue.cc:260] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.564014 12685 heartbeater.cc:499] Master 127.11.163.62:39741 was elected leader, sending a full tablet report...
I20260709 12:17:52.564465 12778 ts_tablet_manager.cc:1434] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 12:17:52.565603 12778 tablet_bootstrap.cc:492] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24: Bootstrap starting.
I20260709 12:17:52.566111 12773 ts_tablet_manager.cc:1434] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:17:52.566983 12773 tablet_bootstrap.cc:492] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371: Bootstrap starting.
I20260709 12:17:52.571898 12778 tablet_bootstrap.cc:654] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.574914 12773 tablet_bootstrap.cc:654] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:52.582895 12686 tablet.cc:2406] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:17:52.585035 12778 tablet_bootstrap.cc:492] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24: No bootstrap required, opened a new log
I20260709 12:17:52.585693 12778 ts_tablet_manager.cc:1403] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:17:52.588140 12773 tablet_bootstrap.cc:492] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371: No bootstrap required, opened a new log
I20260709 12:17:52.588860 12773 ts_tablet_manager.cc:1403] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.014s
I20260709 12:17:52.588928 12778 raft_consensus.cc:359] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.589838 12778 raft_consensus.cc:385] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.590206 12778 raft_consensus.cc:740] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.591359 12778 consensus_queue.cc:260] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.592926 12773 raft_consensus.cc:359] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.593952 12773 raft_consensus.cc:385] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.594214 12778 ts_tablet_manager.cc:1434] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:17:52.594487 12773 raft_consensus.cc:740] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.595253 12778 tablet_bootstrap.cc:492] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24: Bootstrap starting.
I20260709 12:17:52.595420 12773 consensus_queue.cc:260] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.601881 12778 tablet_bootstrap.cc:654] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.601902 12773 ts_tablet_manager.cc:1434] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:17:52.604502 12773 tablet_bootstrap.cc:492] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371: Bootstrap starting.
I20260709 12:17:52.604642 12774 tablet_bootstrap.cc:492] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d: No bootstrap required, opened a new log
I20260709 12:17:52.605149 12774 ts_tablet_manager.cc:1403] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d: Time spent bootstrapping tablet: real 0.053s	user 0.037s	sys 0.010s
I20260709 12:17:52.608116 12774 raft_consensus.cc:359] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.608940 12774 raft_consensus.cc:385] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.610216 12780 raft_consensus.cc:493] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.610675 12780 raft_consensus.cc:515] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.611333 12773 tablet_bootstrap.cc:654] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.621388 12780 leader_election.cc:290] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:17:52.622893 12777 raft_consensus.cc:493] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.623565 12777 raft_consensus.cc:515] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.609678 12774 raft_consensus.cc:740] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.627890 12774 consensus_queue.cc:260] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.632908 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac9f950e9ec4d66a9552ab3b5b20797" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:17:52.634291 12777 leader_election.cc:290] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
W20260709 12:17:52.635912 12699 leader_election.cc:343] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.637192 12774 ts_tablet_manager.cc:1434] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:17:52.640574 12774 tablet_bootstrap.cc:492] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d: Bootstrap starting.
I20260709 12:17:52.643846 12778 tablet_bootstrap.cc:492] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24: No bootstrap required, opened a new log
I20260709 12:17:52.644421 12778 ts_tablet_manager.cc:1403] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.024s
I20260709 12:17:52.647480 12778 raft_consensus.cc:359] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.648241 12778 raft_consensus.cc:385] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.648583 12778 raft_consensus.cc:740] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.649473 12778 consensus_queue.cc:260] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.650213 12774 tablet_bootstrap.cc:654] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.655297 12782 raft_consensus.cc:493] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.655784 12773 tablet_bootstrap.cc:492] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371: No bootstrap required, opened a new log
I20260709 12:17:52.655805 12782 raft_consensus.cc:515] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.656512 12773 ts_tablet_manager.cc:1403] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.007s
I20260709 12:17:52.658726 12782 leader_election.cc:290] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.653713 12778 ts_tablet_manager.cc:1434] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:17:52.668335 12778 tablet_bootstrap.cc:492] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24: Bootstrap starting.
I20260709 12:17:52.676409 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac9f950e9ec4d66a9552ab3b5b20797" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
W20260709 12:17:52.678949 12700 leader_election.cc:343] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.679628 12700 leader_election.cc:304] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d; no voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:17:52.681273 12780 raft_consensus.cc:2749] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.701710 12774 tablet_bootstrap.cc:492] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d: No bootstrap required, opened a new log
I20260709 12:17:52.702387 12774 ts_tablet_manager.cc:1403] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.011s
I20260709 12:17:52.702251 12773 raft_consensus.cc:359] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.704183 12773 raft_consensus.cc:385] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.704639 12773 raft_consensus.cc:740] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.708279 12774 raft_consensus.cc:359] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.709384 12774 raft_consensus.cc:385] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.709810 12774 raft_consensus.cc:740] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.711661 12773 consensus_queue.cc:260] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.719292 12773 ts_tablet_manager.cc:1434] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.004s
I20260709 12:17:52.720772 12773 tablet_bootstrap.cc:492] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371: Bootstrap starting.
I20260709 12:17:52.720546 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fba4f59b5a4fd2bed6d7a1c4f07a9c" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:17:52.721261 12660 raft_consensus.cc:2468] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 0.
I20260709 12:17:52.723719 12551 leader_election.cc:304] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:52.724906 12777 raft_consensus.cc:2804] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.725157 12778 tablet_bootstrap.cc:654] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.725361 12777 raft_consensus.cc:493] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.725770 12777 raft_consensus.cc:3060] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.728303 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:52.729053 12734 raft_consensus.cc:2468] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 0.
I20260709 12:17:52.730509 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:17:52.730582 12626 leader_election.cc:304] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:52.731706 12773 tablet_bootstrap.cc:654] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.731752 12782 raft_consensus.cc:2804] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:17:52.732139 12625 leader_election.cc:343] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.732255 12782 raft_consensus.cc:493] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.732722 12782 raft_consensus.cc:3060] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.739578 12777 raft_consensus.cc:515] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.740409 12782 raft_consensus.cc:515] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.741801 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fba4f59b5a4fd2bed6d7a1c4f07a9c" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:52.742132 12773 tablet_bootstrap.cc:492] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371: No bootstrap required, opened a new log
I20260709 12:17:52.743247 12773 ts_tablet_manager.cc:1403] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 12:17:52.744200 12777 leader_election.cc:290] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.719563 12774 consensus_queue.cc:260] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.744771 12777 raft_consensus.cc:493] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.744825 12780 raft_consensus.cc:493] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.745430 12780 raft_consensus.cc:515] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.745818 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:17:52.746254 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:17:52.746888 12734 raft_consensus.cc:3060] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:52.747229 12625 leader_election.cc:343] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.747920 12773 raft_consensus.cc:359] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.748946 12773 raft_consensus.cc:385] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.749406 12773 raft_consensus.cc:740] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.750414 12773 consensus_queue.cc:260] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.751559 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
W20260709 12:17:52.753160 12700 leader_election.cc:343] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.753785 12773 ts_tablet_manager.cc:1434] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:17:52.753939 12780 leader_election.cc:290] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:17:52.754753 12734 raft_consensus.cc:2468] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 1.
I20260709 12:17:52.755337 12773 tablet_bootstrap.cc:492] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371: Bootstrap starting.
I20260709 12:17:52.756064 12626 leader_election.cc:304] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 72de5314c0724365b7e9be8b9a310371
I20260709 12:17:52.763504 12782 leader_election.cc:290] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.764230 12782 raft_consensus.cc:2804] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.764838 12782 raft_consensus.cc:697] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 LEADER]: Becoming Leader. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Running, Role: LEADER
I20260709 12:17:52.766287 12773 tablet_bootstrap.cc:654] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.767830 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
W20260709 12:17:52.769399 12699 leader_election.cc:343] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.765846 12782 consensus_queue.cc:237] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.770016 12699 leader_election.cc:304] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d; no voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:17:52.771926 12780 raft_consensus.cc:2749] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.775770 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fba4f59b5a4fd2bed6d7a1c4f07a9c" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:17:52.776417 12660 raft_consensus.cc:3060] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.784703 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fba4f59b5a4fd2bed6d7a1c4f07a9c" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:17:52.771466 12777 raft_consensus.cc:515] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
W20260709 12:17:52.786170 12551 leader_election.cc:343] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.787504 12777 leader_election.cc:290] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.788029 12777 raft_consensus.cc:493] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.788619 12660 raft_consensus.cc:2468] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 1.
I20260709 12:17:52.788502 12777 raft_consensus.cc:515] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
W20260709 12:17:52.787140 12551 leader_election.cc:343] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.790699 12777 leader_election.cc:290] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.791965 12774 ts_tablet_manager.cc:1434] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d: Time spent starting tablet: real 0.089s	user 0.013s	sys 0.003s
I20260709 12:17:52.792889 12551 leader_election.cc:304] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: b162f67fa3b74f04a3424673bfb3862d
I20260709 12:17:52.793102 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:52.791136 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:17:52.793124 12774 tablet_bootstrap.cc:492] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d: Bootstrap starting.
I20260709 12:17:52.794981 12659 raft_consensus.cc:2468] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 0.
I20260709 12:17:52.796276 12778 tablet_bootstrap.cc:492] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24: No bootstrap required, opened a new log
I20260709 12:17:52.796808 12778 ts_tablet_manager.cc:1403] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent bootstrapping tablet: real 0.131s	user 0.031s	sys 0.027s
I20260709 12:17:52.796818 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:17:52.799154 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:52.800504 12798 raft_consensus.cc:2804] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.801047 12798 raft_consensus.cc:697] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:17:52.800886 12778 raft_consensus.cc:359] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.801669 12778 raft_consensus.cc:385] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.801996 12778 raft_consensus.cc:740] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.802874 12778 consensus_queue.cc:260] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.802043 12798 consensus_queue.cc:237] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.804281 12551 leader_election.cc:304] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:52.805142 12777 raft_consensus.cc:2804] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:17:52.805186 12551 leader_election.cc:343] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.805554 12778 ts_tablet_manager.cc:1434] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:17:52.805636 12777 raft_consensus.cc:493] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:52.805979 12551 leader_election.cc:343] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.806093 12777 raft_consensus.cc:3060] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.806685 12778 tablet_bootstrap.cc:492] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24: Bootstrap starting.
W20260709 12:17:52.806916 12551 leader_election.cc:343] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.807350 12551 leader_election.cc:304] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371; no voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:17:52.808307 12774 tablet_bootstrap.cc:654] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.814219 12773 tablet_bootstrap.cc:492] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371: No bootstrap required, opened a new log
I20260709 12:17:52.814446 12778 tablet_bootstrap.cc:654] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.815006 12773 ts_tablet_manager.cc:1403] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371: Time spent bootstrapping tablet: real 0.060s	user 0.023s	sys 0.006s
I20260709 12:17:52.817054 12777 raft_consensus.cc:515] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.819780 12803 raft_consensus.cc:2749] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.827256 12773 raft_consensus.cc:359] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.828397 12773 raft_consensus.cc:385] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.828786 12773 raft_consensus.cc:740] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.829771 12773 consensus_queue.cc:260] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.832896 12773 ts_tablet_manager.cc:1434] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:17:52.834091 12773 tablet_bootstrap.cc:492] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371: Bootstrap starting.
W20260709 12:17:52.835639 12531 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:52.838054 12777 leader_election.cc:290] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.838549 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:17:52.839169 12659 raft_consensus.cc:3060] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.835350 12482 catalog_manager.cc:5697] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.842749 12773 tablet_bootstrap.cc:654] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.843600 12777 raft_consensus.cc:493] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.844282 12777 raft_consensus.cc:515] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.846210 12659 raft_consensus.cc:2468] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 1.
I20260709 12:17:52.848085 12551 leader_election.cc:304] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:52.848654 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac9f950e9ec4d66a9552ab3b5b20797" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:52.849123 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:17:52.849265 12733 raft_consensus.cc:2468] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 0.
I20260709 12:17:52.850036 12798 raft_consensus.cc:2804] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.852684 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac9f950e9ec4d66a9552ab3b5b20797" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:17:52.853456 12659 raft_consensus.cc:2468] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 0.
I20260709 12:17:52.847209 12777 leader_election.cc:290] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.857583 12777 raft_consensus.cc:493] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.858541 12777 raft_consensus.cc:515] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
W20260709 12:17:52.856045 12551 leader_election.cc:343] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.860777 12778 tablet_bootstrap.cc:492] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24: No bootstrap required, opened a new log
I20260709 12:17:52.860642 12777 leader_election.cc:290] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.860574 12551 leader_election.cc:304] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:52.861351 12778 ts_tablet_manager.cc:1403] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.022s
I20260709 12:17:52.861887 12777 raft_consensus.cc:2804] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.862241 12777 raft_consensus.cc:493] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.862566 12777 raft_consensus.cc:3060] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.863750 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:17:52.864393 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:52.864390 12778 raft_consensus.cc:359] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.865444 12778 raft_consensus.cc:385] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.865727 12778 raft_consensus.cc:740] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.866565 12778 consensus_queue.cc:260] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.854033 12483 catalog_manager.cc:5697] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.869007 12778 ts_tablet_manager.cc:1434] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:17:52.870007 12778 tablet_bootstrap.cc:492] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24: Bootstrap starting.
I20260709 12:17:52.857105 12798 raft_consensus.cc:697] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:17:52.871199 12798 consensus_queue.cc:237] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.872433 12777 raft_consensus.cc:515] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.874512 12777 leader_election.cc:290] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.876415 12778 tablet_bootstrap.cc:654] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:52.866930 12551 leader_election.cc:343] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.877539 12774 tablet_bootstrap.cc:492] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d: No bootstrap required, opened a new log
W20260709 12:17:52.877683 12551 leader_election.cc:343] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.878232 12551 leader_election.cc:304] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371; no voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:17:52.878429 12774 ts_tablet_manager.cc:1403] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.018s
I20260709 12:17:52.878898 12782 raft_consensus.cc:493] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.879376 12782 raft_consensus.cc:515] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.880261 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac9f950e9ec4d66a9552ab3b5b20797" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:17:52.880827 12659 raft_consensus.cc:3060] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.881523 12782 leader_election.cc:290] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.883152 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:17:52.883844 12585 raft_consensus.cc:2468] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 0.
I20260709 12:17:52.883315 12774 raft_consensus.cc:359] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.884709 12774 raft_consensus.cc:385] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.885227 12774 raft_consensus.cc:740] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.886101 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:52.886765 12774 consensus_queue.cc:260] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.887631 12625 leader_election.cc:304] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:52.887948 12659 raft_consensus.cc:2468] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 1.
W20260709 12:17:52.888705 12626 leader_election.cc:343] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.891180 12782 raft_consensus.cc:2804] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.892328 12782 raft_consensus.cc:493] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.892521 12773 tablet_bootstrap.cc:492] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371: No bootstrap required, opened a new log
I20260709 12:17:52.892762 12782 raft_consensus.cc:3060] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.892993 12774 ts_tablet_manager.cc:1434] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:17:52.894394 12774 tablet_bootstrap.cc:492] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d: Bootstrap starting.
I20260709 12:17:52.893049 12773 ts_tablet_manager.cc:1403] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371: Time spent bootstrapping tablet: real 0.059s	user 0.021s	sys 0.025s
I20260709 12:17:52.891108 12777 raft_consensus.cc:2749] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.906363 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac9f950e9ec4d66a9552ab3b5b20797" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:17:52.906997 12733 raft_consensus.cc:3060] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.907094 12778 tablet_bootstrap.cc:492] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24: No bootstrap required, opened a new log
I20260709 12:17:52.906997 12773 raft_consensus.cc:359] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.908033 12778 ts_tablet_manager.cc:1403] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.001s
I20260709 12:17:52.908051 12773 raft_consensus.cc:385] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.908636 12773 raft_consensus.cc:740] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.909509 12773 consensus_queue.cc:260] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.910486 12774 tablet_bootstrap.cc:654] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.911823 12782 raft_consensus.cc:515] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.914301 12773 ts_tablet_manager.cc:1434] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:17:52.915462 12773 tablet_bootstrap.cc:492] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371: Bootstrap starting.
I20260709 12:17:52.915621 12551 leader_election.cc:304] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:52.916667 12807 raft_consensus.cc:2804] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.917310 12807 raft_consensus.cc:697] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:17:52.918190 12807 consensus_queue.cc:237] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.919186 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:17:52.914683 12778 raft_consensus.cc:359] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.919890 12585 raft_consensus.cc:3060] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.920104 12778 raft_consensus.cc:385] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.920603 12778 raft_consensus.cc:740] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.923772 12778 consensus_queue.cc:260] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.926623 12778 ts_tablet_manager.cc:1434] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:17:52.914788 12733 raft_consensus.cc:2468] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 1.
I20260709 12:17:52.927942 12774 tablet_bootstrap.cc:492] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d: No bootstrap required, opened a new log
I20260709 12:17:52.928361 12778 tablet_bootstrap.cc:492] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24: Bootstrap starting.
I20260709 12:17:52.928526 12774 ts_tablet_manager.cc:1403] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.000s
I20260709 12:17:52.927327 12585 raft_consensus.cc:2468] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 1.
I20260709 12:17:52.930042 12625 leader_election.cc:304] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:52.931038 12782 leader_election.cc:290] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:52.931083 12799 raft_consensus.cc:2804] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.932161 12799 raft_consensus.cc:697] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 LEADER]: Becoming Leader. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Running, Role: LEADER
I20260709 12:17:52.933082 12799 consensus_queue.cc:237] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.934525 12773 tablet_bootstrap.cc:654] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.935274 12774 raft_consensus.cc:359] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.936124 12774 raft_consensus.cc:385] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.936358 12778 tablet_bootstrap.cc:654] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.936498 12774 raft_consensus.cc:740] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.937333 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
W20260709 12:17:52.938699 12626 leader_election.cc:343] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.949642 12774 consensus_queue.cc:260] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.951258 12780 raft_consensus.cc:493] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.951833 12780 raft_consensus.cc:515] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.954882 12780 leader_election.cc:290] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:17:52.955874 12778 tablet_bootstrap.cc:492] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24: No bootstrap required, opened a new log
I20260709 12:17:52.956424 12778 ts_tablet_manager.cc:1403] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.001s
I20260709 12:17:52.959954 12778 raft_consensus.cc:359] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.960731 12778 raft_consensus.cc:385] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.961061 12778 raft_consensus.cc:740] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.963683 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:17:52.964394 12585 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 0.
I20260709 12:17:52.965552 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:17:52.968066 12699 leader_election.cc:304] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d; no voters: 
I20260709 12:17:52.969269 12780 raft_consensus.cc:2804] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.969707 12780 raft_consensus.cc:493] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.968884 12482 catalog_manager.cc:5697] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.970088 12780 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.970609 12774 ts_tablet_manager.cc:1434] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d: Time spent starting tablet: real 0.042s	user 0.013s	sys 0.011s
I20260709 12:17:52.971374 12482 catalog_manager.cc:5697] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.972613 12774 tablet_bootstrap.cc:492] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d: Bootstrap starting.
I20260709 12:17:52.979532 12773 tablet_bootstrap.cc:492] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371: No bootstrap required, opened a new log
I20260709 12:17:52.980024 12773 ts_tablet_manager.cc:1403] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371: Time spent bootstrapping tablet: real 0.065s	user 0.024s	sys 0.024s
I20260709 12:17:52.981256 12774 tablet_bootstrap.cc:654] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.982700 12773 raft_consensus.cc:359] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.983392 12773 raft_consensus.cc:385] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.983675 12773 raft_consensus.cc:740] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.984563 12773 consensus_queue.cc:260] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.968158 12778 consensus_queue.cc:260] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.987111 12659 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 0.
I20260709 12:17:52.988406 12778 ts_tablet_manager.cc:1434] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent starting tablet: real 0.032s	user 0.001s	sys 0.007s
I20260709 12:17:52.987943 12483 catalog_manager.cc:5697] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.989449 12778 tablet_bootstrap.cc:492] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24: Bootstrap starting.
I20260709 12:17:52.991091 12773 ts_tablet_manager.cc:1434] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:17:52.992012 12773 tablet_bootstrap.cc:492] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371: Bootstrap starting.
I20260709 12:17:52.992130 12774 tablet_bootstrap.cc:492] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d: No bootstrap required, opened a new log
I20260709 12:17:52.992766 12774 ts_tablet_manager.cc:1403] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 12:17:52.996193 12774 raft_consensus.cc:359] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.997089 12774 raft_consensus.cc:385] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.997489 12773 tablet_bootstrap.cc:654] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.997490 12774 raft_consensus.cc:740] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.997401 12780 raft_consensus.cc:515] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.998894 12799 raft_consensus.cc:493] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.999379 12799 raft_consensus.cc:515] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.999449 12774 consensus_queue.cc:260] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:52.998930 12778 tablet_bootstrap.cc:654] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.001665 12799 leader_election.cc:290] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.003118 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:17:53.003341 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
W20260709 12:17:53.004860 12625 leader_election.cc:343] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.005520 12774 ts_tablet_manager.cc:1434] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
W20260709 12:17:53.005564 12626 leader_election.cc:343] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.006162 12626 leader_election.cc:304] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0e8f62f8c54440980e06cf6aaec0d24; no voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d
I20260709 12:17:53.006532 12774 tablet_bootstrap.cc:492] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d: Bootstrap starting.
I20260709 12:17:53.007369 12799 raft_consensus.cc:2749] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.008852 12798 raft_consensus.cc:493] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.009310 12798 raft_consensus.cc:515] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.010448 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:17:53.011104 12585 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.011605 12798 leader_election.cc:290] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.013391 12774 tablet_bootstrap.cc:654] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.016454 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:53.017155 12733 raft_consensus.cc:2468] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 0.
I20260709 12:17:53.018692 12551 leader_election.cc:304] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d; no voters: 
I20260709 12:17:53.019701 12798 raft_consensus.cc:2804] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.020098 12798 raft_consensus.cc:493] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.020480 12798 raft_consensus.cc:3060] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.024577 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:17:53.025741 12773 tablet_bootstrap.cc:492] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371: No bootstrap required, opened a new log
W20260709 12:17:53.026373 12551 leader_election.cc:343] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.026655 12774 tablet_bootstrap.cc:492] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d: No bootstrap required, opened a new log
I20260709 12:17:53.027159 12774 ts_tablet_manager.cc:1403] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 12:17:53.026371 12773 ts_tablet_manager.cc:1403] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.003s
I20260709 12:17:53.030418 12773 raft_consensus.cc:359] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.030388 12774 raft_consensus.cc:359] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.031380 12773 raft_consensus.cc:385] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.031391 12774 raft_consensus.cc:385] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.032006 12773 raft_consensus.cc:740] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.032015 12774 raft_consensus.cc:740] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.033095 12774 consensus_queue.cc:260] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.033285 12773 consensus_queue.cc:260] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.033591 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:17:53.034365 12659 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.035691 12773 ts_tablet_manager.cc:1434] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:17:53.035694 12774 ts_tablet_manager.cc:1434] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:53.036950 12773 tablet_bootstrap.cc:492] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371: Bootstrap starting.
I20260709 12:17:53.036950 12774 tablet_bootstrap.cc:492] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d: Bootstrap starting.
I20260709 12:17:53.039592 12780 leader_election.cc:290] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:17:53.044544 12659 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 1.
I20260709 12:17:53.044921 12773 tablet_bootstrap.cc:654] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.048338 12585 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 1.
I20260709 12:17:53.053251 12774 tablet_bootstrap.cc:654] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.048368 12700 leader_election.cc:304] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:53.056396 12780 raft_consensus.cc:2804] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.056937 12780 raft_consensus.cc:697] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 1 LEADER]: Becoming Leader. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:17:53.057794 12780 consensus_queue.cc:237] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.059510 12798 raft_consensus.cc:515] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.062253 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
W20260709 12:17:53.063737 12551 leader_election.cc:343] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.065066 12798 leader_election.cc:290] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.066325 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:17:53.067166 12733 raft_consensus.cc:3060] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.068027 12778 tablet_bootstrap.cc:492] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24: No bootstrap required, opened a new log
I20260709 12:17:53.068513 12778 ts_tablet_manager.cc:1403] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.028s
I20260709 12:17:53.071069 12778 raft_consensus.cc:359] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.071745 12778 raft_consensus.cc:385] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.072005 12778 raft_consensus.cc:740] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.072726 12778 consensus_queue.cc:260] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.075397 12778 ts_tablet_manager.cc:1434] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:53.076639 12778 tablet_bootstrap.cc:492] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24: Bootstrap starting.
I20260709 12:17:53.081841 12774 tablet_bootstrap.cc:492] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d: No bootstrap required, opened a new log
I20260709 12:17:53.082398 12774 ts_tablet_manager.cc:1403] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.017s
I20260709 12:17:53.084127 12778 tablet_bootstrap.cc:654] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.085409 12774 raft_consensus.cc:359] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.086215 12774 raft_consensus.cc:385] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.086529 12774 raft_consensus.cc:740] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.085635 12481 catalog_manager.cc:5697] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d reported cstate change: term changed from 0 to 1, leader changed from <none> to b162f67fa3b74f04a3424673bfb3862d (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b162f67fa3b74f04a3424673bfb3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:53.087257 12774 consensus_queue.cc:260] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.082008 12733 raft_consensus.cc:2468] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 1.
I20260709 12:17:53.089464 12774 ts_tablet_manager.cc:1434] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:53.090413 12774 tablet_bootstrap.cc:492] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d: Bootstrap starting.
I20260709 12:17:53.090390 12551 leader_election.cc:304] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d; no voters: f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:17:53.091387 12798 raft_consensus.cc:2804] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.091890 12798 raft_consensus.cc:697] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:17:53.092720 12798 consensus_queue.cc:237] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.098970 12773 tablet_bootstrap.cc:492] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371: No bootstrap required, opened a new log
I20260709 12:17:53.098865 12807 raft_consensus.cc:493] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.099685 12773 ts_tablet_manager.cc:1403] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371: Time spent bootstrapping tablet: real 0.063s	user 0.022s	sys 0.008s
I20260709 12:17:53.099653 12807 raft_consensus.cc:515] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.101374 12774 tablet_bootstrap.cc:654] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.101859 12807 leader_election.cc:290] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.102006 12778 tablet_bootstrap.cc:492] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24: No bootstrap required, opened a new log
I20260709 12:17:53.102646 12778 ts_tablet_manager.cc:1403] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.004s
I20260709 12:17:53.104259 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:17:53.105346 12778 raft_consensus.cc:359] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.106009 12778 raft_consensus.cc:385] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.106269 12778 raft_consensus.cc:740] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.106609 12773 raft_consensus.cc:359] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.107527 12773 raft_consensus.cc:385] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.107997 12773 raft_consensus.cc:740] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.109722 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:53.110539 12733 raft_consensus.cc:2393] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72de5314c0724365b7e9be8b9a310371 in current term 1: Already voted for candidate f0e8f62f8c54440980e06cf6aaec0d24 in this term.
I20260709 12:17:53.111690 12551 leader_election.cc:304] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371; no voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:17:53.112793 12774 tablet_bootstrap.cc:492] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d: No bootstrap required, opened a new log
I20260709 12:17:53.112958 12807 raft_consensus.cc:3060] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.113322 12774 ts_tablet_manager.cc:1403] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 12:17:53.112638 12480 catalog_manager.cc:5697] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.112694 12773 consensus_queue.cc:260] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.116448 12774 raft_consensus.cc:359] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.117126 12774 raft_consensus.cc:385] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.117421 12774 raft_consensus.cc:740] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.117990 12777 raft_consensus.cc:493] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.118134 12774 consensus_queue.cc:260] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.118481 12777 raft_consensus.cc:515] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.120674 12777 leader_election.cc:290] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.122473 12773 ts_tablet_manager.cc:1434] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:17:53.123297 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c764bc8c1149619efbee37157b7e15" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:17:53.124083 12774 ts_tablet_manager.cc:1434] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:17:53.124583 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c764bc8c1149619efbee37157b7e15" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:53.125049 12774 tablet_bootstrap.cc:492] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d: Bootstrap starting.
I20260709 12:17:53.125198 12733 raft_consensus.cc:2468] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 0.
I20260709 12:17:53.126441 12551 leader_election.cc:304] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d; no voters: 
I20260709 12:17:53.127233 12777 raft_consensus.cc:2804] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.122857 12807 raft_consensus.cc:2749] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.120671 12778 consensus_queue.cc:260] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.127630 12777 raft_consensus.cc:493] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.128793 12777 raft_consensus.cc:3060] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.131829 12774 tablet_bootstrap.cc:654] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.136209 12778 ts_tablet_manager.cc:1434] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:17:53.136431 12777 raft_consensus.cc:515] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.136998 12659 raft_consensus.cc:2468] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 0.
I20260709 12:17:53.138559 12777 leader_election.cc:290] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.139498 12778 tablet_bootstrap.cc:492] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24: Bootstrap starting.
I20260709 12:17:53.140832 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c764bc8c1149619efbee37157b7e15" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:17:53.141986 12774 tablet_bootstrap.cc:492] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d: No bootstrap required, opened a new log
I20260709 12:17:53.142124 12659 raft_consensus.cc:3060] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.143290 12774 ts_tablet_manager.cc:1403] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 12:17:53.145781 12778 tablet_bootstrap.cc:654] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.146384 12774 raft_consensus.cc:359] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.147117 12774 raft_consensus.cc:385] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.147392 12774 raft_consensus.cc:740] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.147951 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c764bc8c1149619efbee37157b7e15" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:17:53.148636 12733 raft_consensus.cc:3060] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.148289 12774 consensus_queue.cc:260] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.151886 12659 raft_consensus.cc:2468] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 1.
I20260709 12:17:53.154376 12774 ts_tablet_manager.cc:1434] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:17:53.159230 12733 raft_consensus.cc:2468] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 1.
I20260709 12:17:53.159345 12551 leader_election.cc:304] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:53.160632 12777 raft_consensus.cc:2804] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.161124 12777 raft_consensus.cc:697] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:17:53.161965 12777 consensus_queue.cc:237] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.164513 12778 tablet_bootstrap.cc:492] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24: No bootstrap required, opened a new log
I20260709 12:17:53.165006 12778 ts_tablet_manager.cc:1403] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.002s
I20260709 12:17:53.167102 12778 raft_consensus.cc:359] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.167683 12778 raft_consensus.cc:385] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.167923 12778 raft_consensus.cc:740] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.168435 12778 consensus_queue.cc:260] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.170306 12778 ts_tablet_manager.cc:1434] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:17:53.170914 12481 catalog_manager.cc:5697] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.177428 12780 raft_consensus.cc:493] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.177897 12780 raft_consensus.cc:515] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.179834 12780 leader_election.cc:290] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:17:53.180549 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d9b2d826a044f397d5372acbc7200b" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:17:53.181188 12585 raft_consensus.cc:2468] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 0.
I20260709 12:17:53.182077 12699 leader_election.cc:304] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d; no voters: 
I20260709 12:17:53.182901 12780 raft_consensus.cc:2804] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.183068 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d9b2d826a044f397d5372acbc7200b" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:17:53.183231 12780 raft_consensus.cc:493] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.183677 12780 raft_consensus.cc:3060] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.183720 12659 raft_consensus.cc:2468] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 0.
I20260709 12:17:53.189284 12780 raft_consensus.cc:515] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.190189 12777 raft_consensus.cc:493] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.190713 12777 raft_consensus.cc:515] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.192600 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d9b2d826a044f397d5372acbc7200b" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:17:53.193007 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d9b2d826a044f397d5372acbc7200b" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:17:53.193279 12659 raft_consensus.cc:3060] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.193707 12585 raft_consensus.cc:3060] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.192350 12780 leader_election.cc:290] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:17:53.193759 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:17:53.194478 12660 raft_consensus.cc:2468] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 0.
I20260709 12:17:53.194607 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:53.195231 12733 raft_consensus.cc:2468] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 0.
I20260709 12:17:53.195952 12551 leader_election.cc:304] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:53.196812 12807 raft_consensus.cc:2804] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.197180 12807 raft_consensus.cc:493] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.197512 12807 raft_consensus.cc:3060] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.200145 12659 raft_consensus.cc:2468] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 1.
I20260709 12:17:53.193054 12777 leader_election.cc:290] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.200604 12585 raft_consensus.cc:2468] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 1.
I20260709 12:17:53.201386 12700 leader_election.cc:304] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:53.202271 12780 raft_consensus.cc:2804] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.202751 12780 raft_consensus.cc:697] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 1 LEADER]: Becoming Leader. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:17:53.203609 12780 consensus_queue.cc:237] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.204145 12807 raft_consensus.cc:515] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.206231 12807 leader_election.cc:290] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.206995 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:17:53.207407 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:17:53.207715 12659 raft_consensus.cc:3060] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.208039 12733 raft_consensus.cc:3060] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.212386 12480 catalog_manager.cc:5697] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d reported cstate change: term changed from 0 to 1, leader changed from <none> to b162f67fa3b74f04a3424673bfb3862d (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b162f67fa3b74f04a3424673bfb3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:53.214941 12659 raft_consensus.cc:2468] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 1.
I20260709 12:17:53.215142 12733 raft_consensus.cc:2468] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 1.
I20260709 12:17:53.216205 12551 leader_election.cc:304] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d; no voters: 
I20260709 12:17:53.216886 12807 raft_consensus.cc:2804] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.217372 12807 raft_consensus.cc:697] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:17:53.218200 12807 consensus_queue.cc:237] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.225459 12480 catalog_manager.cc:5697] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.263556 12733 raft_consensus.cc:3060] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.269402 12807 consensus_queue.cc:1048] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.280308 12807 consensus_queue.cc:1048] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.311834 12799 consensus_queue.cc:1048] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.322269 12782 consensus_queue.cc:1048] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.327283 12733 raft_consensus.cc:3060] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.333844 12807 consensus_queue.cc:1048] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.346892 12777 consensus_queue.cc:1048] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.406811 12782 consensus_queue.cc:1048] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.418439 12734 raft_consensus.cc:3060] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.427937 12782 consensus_queue.cc:1048] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.439685 12733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86"
dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
mode: GRACEFUL
new_leader_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:36006
I20260709 12:17:53.440376 12733 raft_consensus.cc:606] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 1 LEADER]: Received request to transfer leadership to TS 72de5314c0724365b7e9be8b9a310371
I20260709 12:17:53.449757 12782 raft_consensus.cc:493] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.450222 12782 raft_consensus.cc:515] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.452175 12782 leader_election.cc:290] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.453087 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:17:53.453281 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:17:53.454085 12733 raft_consensus.cc:2393] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0e8f62f8c54440980e06cf6aaec0d24 in current term 1: Already voted for candidate 72de5314c0724365b7e9be8b9a310371 in this term.
I20260709 12:17:53.455026 12626 leader_election.cc:304] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0e8f62f8c54440980e06cf6aaec0d24; no voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d
I20260709 12:17:53.455775 12782 raft_consensus.cc:3060] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.461299 12782 raft_consensus.cc:2749] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.464608 12585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ba3508e121404d93be0617e39b4761"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
mode: GRACEFUL
new_leader_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
 from {username='slave'} at 127.0.0.1:53108
I20260709 12:17:53.465174 12585 raft_consensus.cc:606] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Received request to transfer leadership to TS f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:17:53.472920 12733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2d9b2d826a044f397d5372acbc7200b"
dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
mode: GRACEFUL
new_leader_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
 from {username='slave'} at 127.0.0.1:36006
I20260709 12:17:53.473538 12733 raft_consensus.cc:606] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 1 LEADER]: Received request to transfer leadership to TS f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:17:53.478673 12585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
mode: GRACEFUL
new_leader_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:53108
I20260709 12:17:53.479250 12585 raft_consensus.cc:606] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Received request to transfer leadership to TS b162f67fa3b74f04a3424673bfb3862d
I20260709 12:17:53.479559 12798 consensus_queue.cc:1048] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.490643 12780 consensus_queue.cc:1048] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.492918 12798 consensus_queue.cc:1048] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.501538 12818 raft_consensus.cc:993] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d: : Instructing follower 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:17:53.504182 12780 raft_consensus.cc:1081] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 1 LEADER]: Signalling peer 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:17:53.506608 12584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:53098
I20260709 12:17:53.507308 12584 raft_consensus.cc:493] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:53.507791 12584 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.509991 12777 consensus_queue.cc:1048] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.511710 12852 consensus_queue.cc:1048] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:53.515492 12584 raft_consensus.cc:515] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.516618 12585 raft_consensus.cc:1240] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Rejecting Update request from peer b162f67fa3b74f04a3424673bfb3862d for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:53.518527 12584 leader_election.cc:290] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 2 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.521013 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:17:53.521577 12733 raft_consensus.cc:3055] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:53.521889 12733 raft_consensus.cc:740] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:17:53.522696 12733 consensus_queue.cc:260] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.526185 12733 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.527412 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:17:53.528020 12660 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.531740 12803 consensus_queue.cc:1048] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.534813 12660 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 2.
I20260709 12:17:53.535914 12551 leader_election.cc:304] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:53.538059 12733 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 2.
I20260709 12:17:53.538575 12803 raft_consensus.cc:2804] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:53.539072 12803 raft_consensus.cc:697] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:17:53.539911 12803 consensus_queue.cc:237] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.548784 12481 catalog_manager.cc:5697] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 1 to 2, leader changed from b162f67fa3b74f04a3424673bfb3862d (127.11.163.3) to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.624513 12852 consensus_queue.cc:1048] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:53.624513 12803 consensus_queue.cc:1048] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:53.636965 12818 consensus_queue.cc:1048] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.650400 12818 raft_consensus.cc:993] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d: : Instructing follower f0e8f62f8c54440980e06cf6aaec0d24 to start an election
I20260709 12:17:53.650854 12818 raft_consensus.cc:1081] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 1 LEADER]: Signalling peer f0e8f62f8c54440980e06cf6aaec0d24 to start an election
I20260709 12:17:53.651995 12803 consensus_queue.cc:1048] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.652736 12659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2d9b2d826a044f397d5372acbc7200b"
dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
 from {username='slave'} at 127.0.0.1:54674
I20260709 12:17:53.653326 12659 raft_consensus.cc:493] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:53.653730 12659 raft_consensus.cc:3060] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.661648 12659 raft_consensus.cc:515] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.663463 12659 leader_election.cc:290] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 2 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.664260 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d9b2d826a044f397d5372acbc7200b" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:17:53.664912 12585 raft_consensus.cc:3060] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.665063 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d9b2d826a044f397d5372acbc7200b" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:17:53.665723 12734 raft_consensus.cc:3055] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:53.666050 12734 raft_consensus.cc:740] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:17:53.666841 12734 consensus_queue.cc:260] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.668135 12734 raft_consensus.cc:3060] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.671362 12585 raft_consensus.cc:2468] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 2.
I20260709 12:17:53.672674 12625 leader_election.cc:304] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:53.673571 12782 raft_consensus.cc:2804] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:53.673647 12734 raft_consensus.cc:2468] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 2.
I20260709 12:17:53.674046 12782 raft_consensus.cc:697] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 LEADER]: Becoming Leader. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Running, Role: LEADER
I20260709 12:17:53.674947 12782 consensus_queue.cc:237] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.681546 12481 catalog_manager.cc:5697] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 reported cstate change: term changed from 1 to 2, leader changed from b162f67fa3b74f04a3424673bfb3862d (127.11.163.3) to f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2). New cstate: current_term: 2 leader_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.738758 12803 consensus_queue.cc:1048] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.744980 12798 raft_consensus.cc:993] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371: : Instructing follower b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:17:53.745471 12807 raft_consensus.cc:1081] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Signalling peer b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:17:53.747187 12733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc"
dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:36002
I20260709 12:17:53.747753 12733 raft_consensus.cc:493] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:53.748111 12733 raft_consensus.cc:3060] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.750658 12807 consensus_queue.cc:1048] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.754918 12733 raft_consensus.cc:515] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.756099 12734 raft_consensus.cc:1240] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Rejecting Update request from peer 72de5314c0724365b7e9be8b9a310371 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:53.758550 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:17:53.759524 12659 raft_consensus.cc:3060] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.757534 12733 leader_election.cc:290] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 2 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:17:53.758136 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:17:53.761004 12585 raft_consensus.cc:3055] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:53.761329 12585 raft_consensus.cc:740] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:17:53.762130 12585 consensus_queue.cc:260] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.763037 12807 consensus_queue.cc:1059] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.764281 12585 raft_consensus.cc:3060] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.766556 12659 raft_consensus.cc:2468] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 2.
I20260709 12:17:53.767843 12700 leader_election.cc:304] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:53.768639 12852 raft_consensus.cc:2804] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:53.769142 12852 raft_consensus.cc:697] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 2 LEADER]: Becoming Leader. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:17:53.769897 12852 consensus_queue.cc:237] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.771833 12585 raft_consensus.cc:2468] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 2.
I20260709 12:17:53.776844 12482 catalog_manager.cc:5697] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d reported cstate change: term changed from 1 to 2, leader changed from 72de5314c0724365b7e9be8b9a310371 (127.11.163.1) to b162f67fa3b74f04a3424673bfb3862d (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b162f67fa3b74f04a3424673bfb3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:53.871356 12798 raft_consensus.cc:993] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371: : Instructing follower f0e8f62f8c54440980e06cf6aaec0d24 to start an election
I20260709 12:17:53.871915 12777 raft_consensus.cc:1081] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Signalling peer f0e8f62f8c54440980e06cf6aaec0d24 to start an election
I20260709 12:17:53.873395 12659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97ba3508e121404d93be0617e39b4761"
dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
 from {username='slave'} at 127.0.0.1:54686
I20260709 12:17:53.873875 12659 raft_consensus.cc:493] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:53.874169 12659 raft_consensus.cc:3060] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.878983 12659 raft_consensus.cc:515] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.880581 12659 leader_election.cc:290] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 2 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:17:53.881572 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:17:53.881582 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:17:53.882153 12585 raft_consensus.cc:3055] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:53.882215 12734 raft_consensus.cc:3060] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.882570 12585 raft_consensus.cc:740] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:17:53.883277 12585 consensus_queue.cc:260] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.884215 12585 raft_consensus.cc:3060] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.887615 12734 raft_consensus.cc:2468] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 2.
I20260709 12:17:53.888689 12626 leader_election.cc:304] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:53.888774 12585 raft_consensus.cc:2468] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 2.
I20260709 12:17:53.889420 12782 raft_consensus.cc:2804] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:53.889882 12782 raft_consensus.cc:697] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 LEADER]: Becoming Leader. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Running, Role: LEADER
I20260709 12:17:53.890594 12782 consensus_queue.cc:237] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:53.896611 12482 catalog_manager.cc:5697] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 reported cstate change: term changed from 1 to 2, leader changed from 72de5314c0724365b7e9be8b9a310371 (127.11.163.1) to f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2). New cstate: current_term: 2 leader_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.454141 12734 raft_consensus.cc:1275] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:54.461566 12865 consensus_queue.cc:1048] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:54.468017 12659 raft_consensus.cc:1275] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:54.474977 12867 consensus_queue.cc:1048] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:54.490545 12585 raft_consensus.cc:1275] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:54.493559 12863 consensus_queue.cc:1048] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:54.526712 12583 raft_consensus.cc:1275] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Refusing update from remote peer f0e8f62f8c54440980e06cf6aaec0d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:54.548816 12583 raft_consensus.cc:1275] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Refusing update from remote peer f0e8f62f8c54440980e06cf6aaec0d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:54.551167 12874 consensus_queue.cc:1048] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:54.551357 12875 consensus_queue.cc:1048] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:54.554544 12660 raft_consensus.cc:1275] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:54.565379 12862 consensus_queue.cc:1048] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:54.593317 12732 raft_consensus.cc:1275] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Refusing update from remote peer f0e8f62f8c54440980e06cf6aaec0d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:54.594707 12869 consensus_queue.cc:1048] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:54.596448 12731 raft_consensus.cc:1275] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Refusing update from remote peer f0e8f62f8c54440980e06cf6aaec0d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:54.597749 12869 consensus_queue.cc:1048] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:17:55.534333 12681 debug-util.cc:398] Leaking SignalData structure 0x7b08000ecd20 after lost signal to thread 11919
W20260709 12:17:55.535185 12681 debug-util.cc:398] Leaking SignalData structure 0x7b080012fe00 after lost signal to thread 12517
W20260709 12:17:55.536057 12681 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9cc0 after lost signal to thread 12609
W20260709 12:17:55.536785 12681 debug-util.cc:398] Leaking SignalData structure 0x7b08001591a0 after lost signal to thread 12684
W20260709 12:17:55.537498 12681 debug-util.cc:398] Leaking SignalData structure 0x7b0800108660 after lost signal to thread 12758
I20260709 12:17:57.096868 11916 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:17:57.097543 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:57.116050 12583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
mode: GRACEFUL
new_leader_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:53116
I20260709 12:17:57.116567 12583 raft_consensus.cc:606] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Received request to transfer leadership to TS b162f67fa3b74f04a3424673bfb3862d
I20260709 12:17:57.119102 12583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
mode: GRACEFUL
new_leader_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:53116
I20260709 12:17:57.119596 12583 raft_consensus.cc:606] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Received request to transfer leadership to TS b162f67fa3b74f04a3424673bfb3862d
I20260709 12:17:57.120657 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:57.121098 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:57.130754 12888 raft_consensus.cc:993] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371: : Instructing follower b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:17:57.131222 12884 raft_consensus.cc:1081] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Signalling peer b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:17:57.132867 12731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86"
dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:36002
I20260709 12:17:57.133471 12731 raft_consensus.cc:493] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:57.133854 12731 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.141893 12731 raft_consensus.cc:515] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:57.144176 12731 leader_election.cc:290] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 3 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:17:57.144975 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:17:57.145635 12583 raft_consensus.cc:3055] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:57.145753 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:17:57.146049 12583 raft_consensus.cc:740] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:17:57.146322 12660 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.146970 12583 consensus_queue.cc:260] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:57.148203 12583 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.153970 12660 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 3.
I20260709 12:17:57.155169 12700 leader_election.cc:304] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:57.155685 12583 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 3.
I20260709 12:17:57.156088 12885 raft_consensus.cc:2804] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:57.157244 12885 raft_consensus.cc:697] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 3 LEADER]: Becoming Leader. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:17:57.158177 12885 consensus_queue.cc:237] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:57.168524 12482 catalog_manager.cc:5697] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d reported cstate change: term changed from 2 to 3, leader changed from 72de5314c0724365b7e9be8b9a310371 (127.11.163.1) to b162f67fa3b74f04a3424673bfb3862d (127.11.163.3). New cstate: current_term: 3 leader_uuid: "b162f67fa3b74f04a3424673bfb3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:57.354907 12888 raft_consensus.cc:993] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371: : Instructing follower b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:17:57.355355 12884 raft_consensus.cc:1081] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Signalling peer b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:17:57.356961 12731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387"
dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:36002
I20260709 12:17:57.357586 12731 raft_consensus.cc:493] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:57.357999 12731 raft_consensus.cc:3060] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.365859 12731 raft_consensus.cc:515] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:57.368131 12731 leader_election.cc:290] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 2 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:17:57.369077 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:17:57.369509 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:17:57.369796 12583 raft_consensus.cc:3055] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:57.370131 12660 raft_consensus.cc:3060] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.375638 12660 raft_consensus.cc:2468] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 2.
I20260709 12:17:57.370184 12583 raft_consensus.cc:740] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:17:57.376752 12700 leader_election.cc:304] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:17:57.376660 12583 consensus_queue.cc:260] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:57.377592 12885 raft_consensus.cc:2804] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:57.378113 12885 raft_consensus.cc:697] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 2 LEADER]: Becoming Leader. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:17:57.378121 12583 raft_consensus.cc:3060] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.379195 12885 consensus_queue.cc:237] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:17:57.386631 12583 raft_consensus.cc:2468] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 2.
I20260709 12:17:57.390352 12482 catalog_manager.cc:5697] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d reported cstate change: term changed from 1 to 2, leader changed from 72de5314c0724365b7e9be8b9a310371 (127.11.163.1) to b162f67fa3b74f04a3424673bfb3862d (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b162f67fa3b74f04a3424673bfb3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:57.665251 12658 raft_consensus.cc:1275] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:57.666815 12889 consensus_queue.cc:1048] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:57.681011 12583 raft_consensus.cc:1275] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:57.682479 12889 consensus_queue.cc:1048] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:57.882747 12658 raft_consensus.cc:1275] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:57.884003 12889 consensus_queue.cc:1048] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:57.892436 12583 raft_consensus.cc:1275] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:57.894345 12885 consensus_queue.cc:1048] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:58.122009 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:58.127403 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:58.127918 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:59.152388 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:59.163054 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:59.163511 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:00.164598 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:00.171075 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:00.171473 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:01.250584 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:01.266402 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:01.267083 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:02.252427 12606 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1f80 after lost signal to thread 11919
W20260709 12:18:02.253214 12606 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6c40 after lost signal to thread 12517
W20260709 12:18:02.253994 12606 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5c40 after lost signal to thread 12609
W20260709 12:18:02.254678 12606 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2d80 after lost signal to thread 12684
W20260709 12:18:02.255312 12606 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa300 after lost signal to thread 12758
I20260709 12:18:02.268041 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:02.273574 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:02.274019 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:03.275185 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:03.284590 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:03.285224 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:04.286425 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:04.295461 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:04.296075 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:05.297042 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:05.302423 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:05.302799 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:06.303905 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:06.309422 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:06.309836 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:07.340123 11916 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:18:07.349330 12731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86"
dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
mode: GRACEFUL
new_leader_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:36006
I20260709 12:18:07.349977 12731 raft_consensus.cc:606] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 3 LEADER]: Received request to transfer leadership to TS 72de5314c0724365b7e9be8b9a310371
I20260709 12:18:07.354712 12731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387"
dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
mode: GRACEFUL
new_leader_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:36006
I20260709 12:18:07.355165 12731 raft_consensus.cc:606] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 2 LEADER]: Received request to transfer leadership to TS 72de5314c0724365b7e9be8b9a310371
I20260709 12:18:07.380612 12658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac"
dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
mode: GRACEFUL
new_leader_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:45616
I20260709 12:18:07.381088 12658 raft_consensus.cc:606] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 LEADER]: Received request to transfer leadership to TS 72de5314c0724365b7e9be8b9a310371
I20260709 12:18:07.386080 12658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ba3508e121404d93be0617e39b4761"
dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
mode: GRACEFUL
new_leader_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:45616
I20260709 12:18:07.386534 12658 raft_consensus.cc:606] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 LEADER]: Received request to transfer leadership to TS 72de5314c0724365b7e9be8b9a310371
I20260709 12:18:07.391096 12658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9"
dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
mode: GRACEFUL
new_leader_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:45616
I20260709 12:18:07.391592 12658 raft_consensus.cc:606] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 LEADER]: Received request to transfer leadership to TS 72de5314c0724365b7e9be8b9a310371
I20260709 12:18:07.585650 12912 raft_consensus.cc:993] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24: : Instructing follower 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:18:07.586300 12915 raft_consensus.cc:1081] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 LEADER]: Signalling peer 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:18:07.588076 12584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:53104
I20260709 12:18:07.588587 12584 raft_consensus.cc:493] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:07.588917 12584 raft_consensus.cc:3060] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.595702 12584 raft_consensus.cc:515] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.597404 12584 leader_election.cc:290] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 2 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:07.598546 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:18:07.598241 12658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:18:07.599092 12731 raft_consensus.cc:3060] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.599222 12658 raft_consensus.cc:3055] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:07.599706 12658 raft_consensus.cc:740] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Running, Role: LEADER
I20260709 12:18:07.600414 12658 consensus_queue.cc:260] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.601640 12658 raft_consensus.cc:3060] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.605944 12731 raft_consensus.cc:2468] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 2.
I20260709 12:18:07.607354 12551 leader_election.cc:304] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d; no voters: 
I20260709 12:18:07.608479 12908 raft_consensus.cc:2804] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:07.609033 12658 raft_consensus.cc:2468] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 2.
I20260709 12:18:07.609737 12908 raft_consensus.cc:697] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:18:07.610788 12908 consensus_queue.cc:237] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.616160 12909 raft_consensus.cc:993] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d: : Instructing follower 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:18:07.617336 12909 raft_consensus.cc:1081] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 3 LEADER]: Signalling peer 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:18:07.618831 12584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:53098
I20260709 12:18:07.619350 12584 raft_consensus.cc:493] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:07.619743 12584 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.623075 12482 catalog_manager.cc:5697] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 1 to 2, leader changed from f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2) to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:07.627152 12584 raft_consensus.cc:515] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.630353 12584 leader_election.cc:290] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 4 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:07.631022 12658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:18:07.631822 12658 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.635205 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:18:07.635856 12731 raft_consensus.cc:3055] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:07.636186 12731 raft_consensus.cc:740] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:18:07.637022 12731 consensus_queue.cc:260] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.638322 12731 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.639813 12658 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 4.
I20260709 12:18:07.641069 12551 leader_election.cc:304] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:18:07.641858 12908 raft_consensus.cc:2804] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:07.642289 12908 raft_consensus.cc:697] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 4 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:18:07.643177 12908 consensus_queue.cc:237] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.644726 12731 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 4.
I20260709 12:18:07.650731 12482 catalog_manager.cc:5697] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 3 to 4, leader changed from b162f67fa3b74f04a3424673bfb3862d (127.11.163.3) to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 4 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:07.679452 12916 raft_consensus.cc:993] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d: : Instructing follower 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:18:07.679896 12909 raft_consensus.cc:1081] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 2 LEADER]: Signalling peer 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:18:07.681272 12584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:53098
I20260709 12:18:07.681767 12584 raft_consensus.cc:493] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:07.682068 12584 raft_consensus.cc:3060] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.686904 12584 raft_consensus.cc:515] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.688465 12584 leader_election.cc:290] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 3 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:07.689289 12658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:18:07.689544 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:18:07.689755 12658 raft_consensus.cc:3060] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.690061 12731 raft_consensus.cc:3055] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:07.690317 12731 raft_consensus.cc:740] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:18:07.690933 12731 consensus_queue.cc:260] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.691787 12731 raft_consensus.cc:3060] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.694141 12658 raft_consensus.cc:2468] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 3.
I20260709 12:18:07.695037 12551 leader_election.cc:304] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:18:07.695688 12908 raft_consensus.cc:2804] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:07.696012 12731 raft_consensus.cc:2468] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 3.
I20260709 12:18:07.696060 12908 raft_consensus.cc:697] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 3 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:18:07.697152 12908 consensus_queue.cc:237] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.703816 12482 catalog_manager.cc:5697] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 2 to 3, leader changed from b162f67fa3b74f04a3424673bfb3862d (127.11.163.3) to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:07.845098 12912 raft_consensus.cc:993] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24: : Instructing follower 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:18:07.845541 12915 raft_consensus.cc:1081] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 LEADER]: Signalling peer 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:18:07.847254 12584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97ba3508e121404d93be0617e39b4761"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:53104
I20260709 12:18:07.847738 12584 raft_consensus.cc:493] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:07.848037 12584 raft_consensus.cc:3060] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.852744 12912 raft_consensus.cc:993] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24: : Instructing follower 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:18:07.853226 12915 raft_consensus.cc:1081] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 LEADER]: Signalling peer 72de5314c0724365b7e9be8b9a310371 to start an election
I20260709 12:18:07.853945 12584 raft_consensus.cc:515] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.854794 12583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
 from {username='slave'} at 127.0.0.1:53104
I20260709 12:18:07.855268 12583 raft_consensus.cc:493] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:07.855603 12583 raft_consensus.cc:3060] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.855913 12584 leader_election.cc:290] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 3 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:07.856431 12658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:18:07.856869 12731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:18:07.857242 12658 raft_consensus.cc:3055] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:07.857303 12731 raft_consensus.cc:3060] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.857630 12658 raft_consensus.cc:740] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Running, Role: LEADER
I20260709 12:18:07.858387 12658 consensus_queue.cc:260] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.859558 12658 raft_consensus.cc:3060] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.861450 12583 raft_consensus.cc:515] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.863152 12583 leader_election.cc:290] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 2 election: Requested vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:07.863505 12731 raft_consensus.cc:2468] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 3.
I20260709 12:18:07.864224 12732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:18:07.864784 12732 raft_consensus.cc:3060] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.864836 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:18:07.865260 12551 leader_election.cc:304] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d; no voters: 
I20260709 12:18:07.865442 12660 raft_consensus.cc:3055] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:07.865779 12660 raft_consensus.cc:740] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Running, Role: LEADER
I20260709 12:18:07.866065 12658 raft_consensus.cc:2468] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 3.
I20260709 12:18:07.866133 12908 raft_consensus.cc:2804] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:07.866675 12660 consensus_queue.cc:260] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.867209 12908 raft_consensus.cc:697] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 3 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:18:07.867990 12660 raft_consensus.cc:3060] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.868271 12908 consensus_queue.cc:237] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.874642 12660 raft_consensus.cc:2468] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 2.
I20260709 12:18:07.875712 12551 leader_election.cc:304] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:18:07.876168 12732 raft_consensus.cc:2468] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72de5314c0724365b7e9be8b9a310371 in term 2.
I20260709 12:18:07.876783 12908 raft_consensus.cc:2804] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:07.877364 12908 raft_consensus.cc:697] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Becoming Leader. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:18:07.878129 12908 consensus_queue.cc:237] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:07.878854 12482 catalog_manager.cc:5697] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 2 to 3, leader changed from f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2) to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:07.891111 12482 catalog_manager.cc:5697] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 reported cstate change: term changed from 1 to 2, leader changed from f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2) to 72de5314c0724365b7e9be8b9a310371 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "72de5314c0724365b7e9be8b9a310371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:07.991719 12660 raft_consensus.cc:1275] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:07.993111 12908 consensus_queue.cc:1048] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:08.007548 12732 raft_consensus.cc:1275] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:08.012188 12932 consensus_queue.cc:1048] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:08.216578 12660 raft_consensus.cc:1275] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:08.217770 12931 consensus_queue.cc:1048] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:08.224311 12660 raft_consensus.cc:1275] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 4 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:08.226475 12931 consensus_queue.cc:1048] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:08.226735 12732 raft_consensus.cc:1275] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:08.228372 12908 consensus_queue.cc:1048] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:08.241043 12732 raft_consensus.cc:1275] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 4 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:08.242425 12931 consensus_queue.cc:1048] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:08.273567 12731 raft_consensus.cc:1275] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:08.274718 12931 consensus_queue.cc:1048] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:08.282776 12660 raft_consensus.cc:1275] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:08.284637 12932 consensus_queue.cc:1048] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:08.312451 12731 raft_consensus.cc:1275] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:08.313593 12932 consensus_queue.cc:1048] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:08.322010 12660 raft_consensus.cc:1275] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Refusing update from remote peer 72de5314c0724365b7e9be8b9a310371: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:08.323489 12931 consensus_queue.cc:1048] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:11.458806 12945 raft_consensus.cc:493] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72de5314c0724365b7e9be8b9a310371)
I20260709 12:18:11.460175 12945 raft_consensus.cc:515] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:11.465425 12945 leader_election.cc:290] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:11.545516 12948 raft_consensus.cc:493] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f0e8f62f8c54440980e06cf6aaec0d24)
I20260709 12:18:11.546216 12948 raft_consensus.cc:515] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:11.546634 12947 raft_consensus.cc:493] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b162f67fa3b74f04a3424673bfb3862d)
I20260709 12:18:11.547194 12947 raft_consensus.cc:515] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:11.549331 12945 raft_consensus.cc:493] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72de5314c0724365b7e9be8b9a310371)
I20260709 12:18:11.549465 12947 leader_election.cc:290] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:11.549958 12945 raft_consensus.cc:515] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:11.551473 12945 leader_election.cc:290] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:11.548943 12948 leader_election.cc:290] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:11.552644 12945 raft_consensus.cc:493] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b162f67fa3b74f04a3424673bfb3862d)
I20260709 12:18:11.553157 12945 raft_consensus.cc:515] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:11.555415 12945 leader_election.cc:290] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:11.569715 12951 raft_consensus.cc:493] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72de5314c0724365b7e9be8b9a310371)
I20260709 12:18:11.570078 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c764bc8c1149619efbee37157b7e15" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:18:11.570464 12951 raft_consensus.cc:515] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:11.572135 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:18:11.573491 12951 leader_election.cc:290] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:18:11.573786 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:18:11.574234 12951 raft_consensus.cc:493] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72de5314c0724365b7e9be8b9a310371)
I20260709 12:18:11.574433 12583 raft_consensus.cc:2468] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 2.
I20260709 12:18:11.576465 12625 leader_election.cc:304] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:18:11.577327 12945 raft_consensus.cc:2804] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:11.577773 12945 raft_consensus.cc:493] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b162f67fa3b74f04a3424673bfb3862d)
I20260709 12:18:11.578234 12945 raft_consensus.cc:3060] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.574808 12951 raft_consensus.cc:515] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:11.588443 12657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d9b2d826a044f397d5372acbc7200b" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:18:11.589258 12951 leader_election.cc:290] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:18:11.596799 12657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:18:11.597915 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d9b2d826a044f397d5372acbc7200b" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:18:11.601418 12584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff7da6340cc41388f09bd5414a82387" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:18:11.602303 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:18:11.605621 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:18:11.607678 12699 leader_election.cc:304] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d; no voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:18:11.611485 12951 raft_consensus.cc:2749] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:11.612201 12656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "72de5314c0724365b7e9be8b9a310371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:18:11.614959 12551 leader_election.cc:304] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371; no voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:18:11.620324 12949 raft_consensus.cc:2749] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:11.620620 12733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c764bc8c1149619efbee37157b7e15" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:18:11.621294 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:18:11.597304 12945 raft_consensus.cc:515] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:11.618518 12658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" is_pre_election: true
I20260709 12:18:11.621997 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ba3508e121404d93be0617e39b4761" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:18:11.622592 12660 raft_consensus.cc:1240] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Rejecting Update request from peer b162f67fa3b74f04a3424673bfb3862d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:11.623792 12700 leader_election.cc:304] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d; no voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:18:11.624449 12626 leader_election.cc:304] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0e8f62f8c54440980e06cf6aaec0d24; no voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d
I20260709 12:18:11.624766 12945 leader_election.cc:290] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 3 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:11.625308 12946 raft_consensus.cc:2749] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:11.626358 12626 leader_election.cc:304] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0e8f62f8c54440980e06cf6aaec0d24; no voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d
I20260709 12:18:11.626758 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:18:11.630291 12953 consensus_queue.cc:1059] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:11.625063 12951 raft_consensus.cc:2749] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:11.631388 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:18:11.630326 12946 raft_consensus.cc:2749] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:11.633764 12951 raft_consensus.cc:3055] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:11.633987 12626 leader_election.cc:304] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0e8f62f8c54440980e06cf6aaec0d24; no voters: 72de5314c0724365b7e9be8b9a310371, b162f67fa3b74f04a3424673bfb3862d
I20260709 12:18:11.634159 12951 raft_consensus.cc:740] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:18:11.634758 12946 raft_consensus.cc:2749] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:11.635468 12951 consensus_queue.cc:260] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:11.636160 12551 leader_election.cc:304] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371; no voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:18:11.636943 12947 raft_consensus.cc:2749] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:11.636958 12951 raft_consensus.cc:3060] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.654333 11916 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:18:11.654982 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:11.662256 12583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
mode: GRACEFUL
new_leader_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:53116
I20260709 12:18:11.662892 12583 raft_consensus.cc:606] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Received request to transfer leadership to TS b162f67fa3b74f04a3424673bfb3862d
I20260709 12:18:11.665339 12583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac9f950e9ec4d66a9552ab3b5b20797"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
mode: GRACEFUL
new_leader_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:53116
I20260709 12:18:11.665762 12583 raft_consensus.cc:606] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Received request to transfer leadership to TS b162f67fa3b74f04a3424673bfb3862d
I20260709 12:18:11.667824 12583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c764bc8c1149619efbee37157b7e15"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
mode: GRACEFUL
new_leader_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
 from {username='slave'} at 127.0.0.1:53116
I20260709 12:18:11.668255 12583 raft_consensus.cc:606] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Received request to transfer leadership to TS f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:18:11.670300 12583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
mode: GRACEFUL
new_leader_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
 from {username='slave'} at 127.0.0.1:53116
I20260709 12:18:11.670702 12583 raft_consensus.cc:606] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Received request to transfer leadership to TS f0e8f62f8c54440980e06cf6aaec0d24
I20260709 12:18:11.671754 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:11.672215 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:11.973464 12952 raft_consensus.cc:993] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371: : Instructing follower b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:18:11.973932 12947 raft_consensus.cc:1081] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Signalling peer b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:18:11.975327 12728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ac9f950e9ec4d66a9552ab3b5b20797"
dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:36002
I20260709 12:18:11.975910 12728 raft_consensus.cc:493] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:11.976244 12728 raft_consensus.cc:3060] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.981689 12728 raft_consensus.cc:515] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:11.983415 12728 leader_election.cc:290] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 2 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:18:11.984130 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac9f950e9ec4d66a9552ab3b5b20797" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:18:11.984539 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac9f950e9ec4d66a9552ab3b5b20797" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:18:11.984757 12583 raft_consensus.cc:3055] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:11.985091 12583 raft_consensus.cc:740] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:18:11.985114 12660 raft_consensus.cc:3060] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.985792 12583 consensus_queue.cc:260] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:11.986688 12583 raft_consensus.cc:3060] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.990279 12660 raft_consensus.cc:2468] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 2.
I20260709 12:18:11.991317 12700 leader_election.cc:304] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:18:11.991441 12583 raft_consensus.cc:2468] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 2.
I20260709 12:18:11.992283 12951 raft_consensus.cc:2804] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:11.992794 12951 raft_consensus.cc:697] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 2 LEADER]: Becoming Leader. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:18:11.993690 12951 consensus_queue.cc:237] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:12.003782 12480 catalog_manager.cc:5697] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d reported cstate change: term changed from 1 to 2, leader changed from 72de5314c0724365b7e9be8b9a310371 (127.11.163.1) to b162f67fa3b74f04a3424673bfb3862d (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b162f67fa3b74f04a3424673bfb3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:12.014834 12952 raft_consensus.cc:993] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371: : Instructing follower f0e8f62f8c54440980e06cf6aaec0d24 to start an election
I20260709 12:18:12.015340 12947 raft_consensus.cc:1081] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Signalling peer f0e8f62f8c54440980e06cf6aaec0d24 to start an election
I20260709 12:18:12.016937 12660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8c764bc8c1149619efbee37157b7e15"
dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
 from {username='slave'} at 127.0.0.1:54686
I20260709 12:18:12.017409 12660 raft_consensus.cc:493] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:12.017793 12660 raft_consensus.cc:3060] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:12.023075 12660 raft_consensus.cc:515] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:12.024818 12660 leader_election.cc:290] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 2 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:12.025655 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c764bc8c1149619efbee37157b7e15" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:18:12.025835 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c764bc8c1149619efbee37157b7e15" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:18:12.026259 12583 raft_consensus.cc:3055] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:12.026369 12728 raft_consensus.cc:3060] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:12.026553 12583 raft_consensus.cc:740] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:18:12.027315 12583 consensus_queue.cc:260] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:12.028249 12583 raft_consensus.cc:3060] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:12.031219 12728 raft_consensus.cc:2468] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 2.
I20260709 12:18:12.032236 12626 leader_election.cc:304] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:18:12.032320 12583 raft_consensus.cc:2468] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 2.
I20260709 12:18:12.032914 12945 raft_consensus.cc:2804] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:12.033380 12945 raft_consensus.cc:697] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 LEADER]: Becoming Leader. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Running, Role: LEADER
I20260709 12:18:12.034148 12945 consensus_queue.cc:237] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:12.041641 12480 catalog_manager.cc:5697] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 reported cstate change: term changed from 1 to 2, leader changed from 72de5314c0724365b7e9be8b9a310371 (127.11.163.1) to f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2). New cstate: current_term: 2 leader_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:12.055384 12952 raft_consensus.cc:993] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371: : Instructing follower b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:18:12.055817 12947 raft_consensus.cc:1081] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Signalling peer b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:18:12.057281 12728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9"
dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:36002
I20260709 12:18:12.057709 12728 raft_consensus.cc:493] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:12.058012 12728 raft_consensus.cc:3060] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.063041 12728 raft_consensus.cc:515] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:12.064957 12728 leader_election.cc:290] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 3 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:18:12.065675 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:18:12.065954 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f6c5e91ca64d548d544dcc61cd58c9" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:18:12.066238 12583 raft_consensus.cc:3055] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:12.066430 12660 raft_consensus.cc:3060] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.066543 12583 raft_consensus.cc:740] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:18:12.067288 12583 consensus_queue.cc:260] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:12.068375 12583 raft_consensus.cc:3060] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.072757 12660 raft_consensus.cc:2468] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 3.
I20260709 12:18:12.073911 12700 leader_election.cc:304] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:18:12.074168 12583 raft_consensus.cc:2468] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 3.
I20260709 12:18:12.074744 12951 raft_consensus.cc:2804] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:12.075279 12951 raft_consensus.cc:697] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 3 LEADER]: Becoming Leader. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:18:12.076249 12951 consensus_queue.cc:237] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:12.084019 12480 catalog_manager.cc:5697] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d reported cstate change: term changed from 2 to 3, leader changed from 72de5314c0724365b7e9be8b9a310371 (127.11.163.1) to b162f67fa3b74f04a3424673bfb3862d (127.11.163.3). New cstate: current_term: 3 leader_uuid: "b162f67fa3b74f04a3424673bfb3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:12.189154 12952 raft_consensus.cc:993] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371: : Instructing follower f0e8f62f8c54440980e06cf6aaec0d24 to start an election
I20260709 12:18:12.189611 12947 raft_consensus.cc:1081] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Signalling peer f0e8f62f8c54440980e06cf6aaec0d24 to start an election
I20260709 12:18:12.190857 12660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac"
dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
 from {username='slave'} at 127.0.0.1:54686
I20260709 12:18:12.191239 12660 raft_consensus.cc:493] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:12.191522 12660 raft_consensus.cc:3060] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.195492 12660 raft_consensus.cc:515] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:12.197199 12660 leader_election.cc:290] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 3 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:12.197824 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:18:12.198357 12583 raft_consensus.cc:3055] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:12.198671 12583 raft_consensus.cc:740] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:18:12.198786 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e447db86a44533bb94a5dea94eddac" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:18:12.199769 12728 raft_consensus.cc:3060] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.199848 12583 consensus_queue.cc:260] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:12.200742 12583 raft_consensus.cc:3060] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.204532 12728 raft_consensus.cc:2468] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 3.
I20260709 12:18:12.204957 12583 raft_consensus.cc:2468] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 3.
I20260709 12:18:12.205567 12626 leader_election.cc:304] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:18:12.206331 12945 raft_consensus.cc:2804] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:12.206761 12945 raft_consensus.cc:697] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 LEADER]: Becoming Leader. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Running, Role: LEADER
I20260709 12:18:12.207535 12945 consensus_queue.cc:237] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:12.214485 12480 catalog_manager.cc:5697] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 reported cstate change: term changed from 2 to 3, leader changed from 72de5314c0724365b7e9be8b9a310371 (127.11.163.1) to f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2). New cstate: current_term: 3 leader_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:12.416483 12660 raft_consensus.cc:1275] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:12.417654 12951 consensus_queue.cc:1048] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:12.427062 12583 raft_consensus.cc:1275] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:12.428517 12951 consensus_queue.cc:1048] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:12.538877 12755 debug-util.cc:398] Leaking SignalData structure 0x7b08000b3840 after lost signal to thread 11919
W20260709 12:18:12.539772 12755 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6240 after lost signal to thread 12517
W20260709 12:18:12.540659 12755 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9ca0 after lost signal to thread 12609
W20260709 12:18:12.541481 12755 debug-util.cc:398] Leaking SignalData structure 0x7b08001b83c0 after lost signal to thread 12684
W20260709 12:18:12.542222 12755 debug-util.cc:398] Leaking SignalData structure 0x7b08000fcd00 after lost signal to thread 12758
I20260709 12:18:12.581256 12583 raft_consensus.cc:1275] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:12.582671 12951 consensus_queue.cc:1048] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:12.593243 12660 raft_consensus.cc:1275] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:12.594816 12951 consensus_queue.cc:1048] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:12.602370 12728 raft_consensus.cc:1275] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Refusing update from remote peer f0e8f62f8c54440980e06cf6aaec0d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:12.604226 12946 consensus_queue.cc:1048] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:12.617550 12583 raft_consensus.cc:1275] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Refusing update from remote peer f0e8f62f8c54440980e06cf6aaec0d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:12.619077 12945 consensus_queue.cc:1048] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:12.638725 12729 raft_consensus.cc:1275] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Refusing update from remote peer f0e8f62f8c54440980e06cf6aaec0d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:12.640611 12945 consensus_queue.cc:1048] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:12.653981 12583 raft_consensus.cc:1275] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Refusing update from remote peer f0e8f62f8c54440980e06cf6aaec0d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:12.655709 12945 consensus_queue.cc:1048] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:12.673249 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:12.682191 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:12.682662 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:13.142467 12946 raft_consensus.cc:493] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.143044 12946 raft_consensus.cc:515] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:13.145392 12946 leader_election.cc:290] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:13.145931 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371" is_pre_election: true
I20260709 12:18:13.146342 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d" is_pre_election: true
I20260709 12:18:13.146531 12583 raft_consensus.cc:2468] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 2.
I20260709 12:18:13.146992 12729 raft_consensus.cc:2468] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 3.
I20260709 12:18:13.147563 12625 leader_election.cc:304] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:18:13.148337 12946 raft_consensus.cc:2804] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:13.148733 12946 raft_consensus.cc:493] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.149009 12946 raft_consensus.cc:3060] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:13.156466 12946 raft_consensus.cc:515] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:13.158655 12946 leader_election.cc:290] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 4 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), b162f67fa3b74f04a3424673bfb3862d (127.11.163.3:36185)
I20260709 12:18:13.159278 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:18:13.159626 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ee51fe7dd94be09755c2d154bb04bc" candidate_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
I20260709 12:18:13.159929 12583 raft_consensus.cc:3060] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:13.160267 12729 raft_consensus.cc:3060] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:13.164721 12583 raft_consensus.cc:2468] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 4.
I20260709 12:18:13.165684 12625 leader_election.cc:304] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72de5314c0724365b7e9be8b9a310371, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:18:13.166350 12946 raft_consensus.cc:2804] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:13.166774 12946 raft_consensus.cc:697] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 4 LEADER]: Becoming Leader. State: Replica: f0e8f62f8c54440980e06cf6aaec0d24, State: Running, Role: LEADER
I20260709 12:18:13.167675 12946 consensus_queue.cc:237] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:13.167954 12729 raft_consensus.cc:2468] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e8f62f8c54440980e06cf6aaec0d24 in term 4.
I20260709 12:18:13.175868 12480 catalog_manager.cc:5697] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 reported cstate change: term changed from 2 to 4, leader changed from b162f67fa3b74f04a3424673bfb3862d (127.11.163.3) to f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2). New cstate: current_term: 4 leader_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:13.564458 12583 raft_consensus.cc:1275] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 4 FOLLOWER]: Refusing update from remote peer f0e8f62f8c54440980e06cf6aaec0d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:13.565820 12946 consensus_queue.cc:1048] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:13.584154 12729 raft_consensus.cc:1275] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 4 FOLLOWER]: Refusing update from remote peer f0e8f62f8c54440980e06cf6aaec0d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:13.585692 12946 consensus_queue.cc:1048] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:13.683843 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:13.693101 12583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86"
dest_uuid: "72de5314c0724365b7e9be8b9a310371"
mode: GRACEFUL
new_leader_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:53116
I20260709 12:18:13.693638 12583 raft_consensus.cc:606] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 4 LEADER]: Received request to transfer leadership to TS b162f67fa3b74f04a3424673bfb3862d
I20260709 12:18:13.694826 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:18:13.695302 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:14.037009 12986 raft_consensus.cc:993] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371: : Instructing follower b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:18:14.037533 12947 raft_consensus.cc:1081] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 4 LEADER]: Signalling peer b162f67fa3b74f04a3424673bfb3862d to start an election
I20260709 12:18:14.039254 12729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86"
dest_uuid: "b162f67fa3b74f04a3424673bfb3862d"
 from {username='slave'} at 127.0.0.1:36002
I20260709 12:18:14.039831 12729 raft_consensus.cc:493] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:14.040154 12729 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.047142 12729 raft_consensus.cc:515] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:14.049081 12729 leader_election.cc:290] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 5 election: Requested vote from peers 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275), f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079)
I20260709 12:18:14.049873 12583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "72de5314c0724365b7e9be8b9a310371"
I20260709 12:18:14.050055 12658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550130ad49e4eb5baa0a9b8b74e5a86" candidate_uuid: "b162f67fa3b74f04a3424673bfb3862d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f0e8f62f8c54440980e06cf6aaec0d24"
I20260709 12:18:14.050490 12583 raft_consensus.cc:3055] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:14.050591 12658 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.050846 12583 raft_consensus.cc:740] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72de5314c0724365b7e9be8b9a310371, State: Running, Role: LEADER
I20260709 12:18:14.051764 12583 consensus_queue.cc:260] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:14.052995 12583 raft_consensus.cc:3060] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.055568 12658 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 5.
I20260709 12:18:14.056870 12700 leader_election.cc:304] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b162f67fa3b74f04a3424673bfb3862d, f0e8f62f8c54440980e06cf6aaec0d24; no voters: 
I20260709 12:18:14.058333 12985 raft_consensus.cc:2804] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:14.058853 12985 raft_consensus.cc:697] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 5 LEADER]: Becoming Leader. State: Replica: b162f67fa3b74f04a3424673bfb3862d, State: Running, Role: LEADER
I20260709 12:18:14.059971 12985 consensus_queue.cc:237] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } }
I20260709 12:18:14.061491 12583 raft_consensus.cc:2468] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b162f67fa3b74f04a3424673bfb3862d in term 5.
I20260709 12:18:14.067930 12481 catalog_manager.cc:5697] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d reported cstate change: term changed from 4 to 5, leader changed from 72de5314c0724365b7e9be8b9a310371 (127.11.163.1) to b162f67fa3b74f04a3424673bfb3862d (127.11.163.3). New cstate: current_term: 5 leader_uuid: "b162f67fa3b74f04a3424673bfb3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b162f67fa3b74f04a3424673bfb3862d" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 36185 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:14.530649 12658 raft_consensus.cc:1275] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 5 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:14.531980 12985 consensus_queue.cc:1048] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e8f62f8c54440980e06cf6aaec0d24" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:14.551043 12583 raft_consensus.cc:1275] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 5 FOLLOWER]: Refusing update from remote peer b162f67fa3b74f04a3424673bfb3862d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:14.559068 12995 consensus_queue.cc:1048] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72de5314c0724365b7e9be8b9a310371" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:14.696475 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:14.704818 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:14.705466 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:15.706485 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:15.711920 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:15.712378 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:16.713341 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:16.719265 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:16.719782 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:17.720641 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:17.726161 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:17.726593 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:18.727561 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:18.732937 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:18.733357 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:19.734632 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:19.741966 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:19.742413 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:20.743381 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:20.748834 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:20.749372 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:21.781569 11916 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:18:21.782106 11916 tablet_server.cc:179] TabletServer@127.11.163.1:0 shutting down...
W20260709 12:18:21.798906 12625 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 12:18:21.804311 12625 consensus_peers.cc:597] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 -> Peer 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275): Couldn't send request to peer 72de5314c0724365b7e9be8b9a310371. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.810757 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:21.811512 11916 tablet_replica.cc:333] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371: stopping tablet replica
I20260709 12:18:21.812268 11916 raft_consensus.cc:2243] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.812950 11916 raft_consensus.cc:2272] T e2d9b2d826a044f397d5372acbc7200b P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.815372 11916 tablet_replica.cc:333] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371: stopping tablet replica
I20260709 12:18:21.816115 11916 raft_consensus.cc:2243] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.816601 11916 raft_consensus.cc:2272] T a8c764bc8c1149619efbee37157b7e15 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.818778 11916 tablet_replica.cc:333] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371: stopping tablet replica
I20260709 12:18:21.819288 11916 raft_consensus.cc:2243] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.819747 11916 raft_consensus.cc:2272] T 6ac9f950e9ec4d66a9552ab3b5b20797 P 72de5314c0724365b7e9be8b9a310371 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.821476 11916 tablet_replica.cc:333] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371: stopping tablet replica
I20260709 12:18:21.821910 11916 raft_consensus.cc:2243] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.822631 11916 raft_consensus.cc:2272] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P 72de5314c0724365b7e9be8b9a310371 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.824618 11916 tablet_replica.cc:333] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371: stopping tablet replica
I20260709 12:18:21.825093 11916 raft_consensus.cc:2243] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.825485 11916 raft_consensus.cc:2272] T 05f6c5e91ca64d548d544dcc61cd58c9 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.827193 11916 tablet_replica.cc:333] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371: stopping tablet replica
I20260709 12:18:21.827688 11916 raft_consensus.cc:2243] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.828114 11916 raft_consensus.cc:2272] T 05ee51fe7dd94be09755c2d154bb04bc P 72de5314c0724365b7e9be8b9a310371 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.829687 11916 tablet_replica.cc:333] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371: stopping tablet replica
I20260709 12:18:21.830111 11916 raft_consensus.cc:2243] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.830487 11916 raft_consensus.cc:2272] T e0e447db86a44533bb94a5dea94eddac P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.832177 11916 tablet_replica.cc:333] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371: stopping tablet replica
I20260709 12:18:21.832602 11916 raft_consensus.cc:2243] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.833307 11916 raft_consensus.cc:2272] T 97ba3508e121404d93be0617e39b4761 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.835007 11916 tablet_replica.cc:333] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371: stopping tablet replica
I20260709 12:18:21.835493 11916 raft_consensus.cc:2243] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.836229 11916 raft_consensus.cc:2272] T 4ff7da6340cc41388f09bd5414a82387 P 72de5314c0724365b7e9be8b9a310371 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.837815 11916 tablet_replica.cc:333] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371: stopping tablet replica
I20260709 12:18:21.838207 11916 raft_consensus.cc:2243] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.838547 11916 raft_consensus.cc:2272] T 8550130ad49e4eb5baa0a9b8b74e5a86 P 72de5314c0724365b7e9be8b9a310371 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:21.843811 12625 consensus_peers.cc:597] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 -> Peer 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275): Couldn't send request to peer 72de5314c0724365b7e9be8b9a310371. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.887164 11916 tablet_server.cc:196] TabletServer@127.11.163.1:0 shutdown complete.
W20260709 12:18:21.894362 12699 consensus_peers.cc:597] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d -> Peer 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275): Couldn't send request to peer 72de5314c0724365b7e9be8b9a310371. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.909271 11916 tablet_server.cc:179] TabletServer@127.11.163.2:0 shutting down...
I20260709 12:18:21.937314 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:21.938026 11916 tablet_replica.cc:333] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24: stopping tablet replica
I20260709 12:18:21.938669 11916 raft_consensus.cc:2243] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.939688 11916 raft_consensus.cc:2272] T e2d9b2d826a044f397d5372acbc7200b P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.942087 11916 tablet_replica.cc:333] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24: stopping tablet replica
I20260709 12:18:21.942761 11916 raft_consensus.cc:2243] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.943691 11916 raft_consensus.cc:2272] T a8c764bc8c1149619efbee37157b7e15 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.945513 11916 tablet_replica.cc:333] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24: stopping tablet replica
I20260709 12:18:21.946069 11916 raft_consensus.cc:2243] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.946532 11916 raft_consensus.cc:2272] T 4ff7da6340cc41388f09bd5414a82387 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.948314 11916 tablet_replica.cc:333] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24: stopping tablet replica
I20260709 12:18:21.948845 11916 raft_consensus.cc:2243] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.949307 11916 raft_consensus.cc:2272] T 8550130ad49e4eb5baa0a9b8b74e5a86 P f0e8f62f8c54440980e06cf6aaec0d24 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.950939 11916 tablet_replica.cc:333] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24: stopping tablet replica
I20260709 12:18:21.951529 11916 raft_consensus.cc:2243] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.951925 11916 raft_consensus.cc:2272] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P f0e8f62f8c54440980e06cf6aaec0d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.953585 11916 tablet_replica.cc:333] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24: stopping tablet replica
I20260709 12:18:21.954059 11916 raft_consensus.cc:2243] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.954490 11916 raft_consensus.cc:2272] T 05f6c5e91ca64d548d544dcc61cd58c9 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.956785 11916 tablet_replica.cc:333] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24: stopping tablet replica
I20260709 12:18:21.957428 11916 raft_consensus.cc:2243] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.957983 11916 raft_consensus.cc:2272] T 6ac9f950e9ec4d66a9552ab3b5b20797 P f0e8f62f8c54440980e06cf6aaec0d24 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:21.959638 12699 consensus_peers.cc:597] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d -> Peer 72de5314c0724365b7e9be8b9a310371 (127.11.163.1:43275): Couldn't send request to peer 72de5314c0724365b7e9be8b9a310371. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.960156 11916 tablet_replica.cc:333] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24: stopping tablet replica
I20260709 12:18:21.960659 11916 raft_consensus.cc:2243] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.961369 11916 raft_consensus.cc:2272] T 05ee51fe7dd94be09755c2d154bb04bc P f0e8f62f8c54440980e06cf6aaec0d24 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.962972 11916 tablet_replica.cc:333] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24: stopping tablet replica
I20260709 12:18:21.963480 11916 raft_consensus.cc:2243] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.964223 11916 raft_consensus.cc:2272] T e0e447db86a44533bb94a5dea94eddac P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.965790 11916 tablet_replica.cc:333] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24: stopping tablet replica
I20260709 12:18:21.966224 11916 raft_consensus.cc:2243] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.966620 11916 raft_consensus.cc:2272] T 97ba3508e121404d93be0617e39b4761 P f0e8f62f8c54440980e06cf6aaec0d24 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:21.982311 12624 connection.cc:466] server connection from 127.0.0.1:54674 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54674 (request call id 160) could send its response
W20260709 12:18:21.983222 12700 consensus_peers.cc:597] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d -> Peer f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079): Couldn't send request to peer f0e8f62f8c54440980e06cf6aaec0d24. Status: Network error: recv got EOF from 127.11.163.2:35079 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:22.019598 11916 tablet_server.cc:196] TabletServer@127.11.163.2:0 shutdown complete.
I20260709 12:18:22.039217 11916 tablet_server.cc:179] TabletServer@127.11.163.3:0 shutting down...
W20260709 12:18:22.053185 12700 consensus_peers.cc:597] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d -> Peer f0e8f62f8c54440980e06cf6aaec0d24 (127.11.163.2:35079): Couldn't send request to peer f0e8f62f8c54440980e06cf6aaec0d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:35079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:22.071564 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:22.072207 11916 tablet_replica.cc:333] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d: stopping tablet replica
I20260709 12:18:22.072940 11916 raft_consensus.cc:2243] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:22.073436 11916 raft_consensus.cc:2272] T e2d9b2d826a044f397d5372acbc7200b P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:22.075280 11916 tablet_replica.cc:333] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d: stopping tablet replica
I20260709 12:18:22.075865 11916 raft_consensus.cc:2243] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:22.076656 11916 raft_consensus.cc:2272] T 05f6c5e91ca64d548d544dcc61cd58c9 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:22.078343 11916 tablet_replica.cc:333] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d: stopping tablet replica
I20260709 12:18:22.078837 11916 raft_consensus.cc:2243] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:22.079221 11916 raft_consensus.cc:2272] T 51fba4f59b5a4fd2bed6d7a1c4f07a9c P b162f67fa3b74f04a3424673bfb3862d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:22.080894 11916 tablet_replica.cc:333] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d: stopping tablet replica
I20260709 12:18:22.081403 11916 raft_consensus.cc:2243] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:22.081823 11916 raft_consensus.cc:2272] T 97ba3508e121404d93be0617e39b4761 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:22.083393 11916 tablet_replica.cc:333] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d: stopping tablet replica
I20260709 12:18:22.083933 11916 raft_consensus.cc:2243] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:22.084365 11916 raft_consensus.cc:2272] T a8c764bc8c1149619efbee37157b7e15 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:22.086200 11916 tablet_replica.cc:333] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d: stopping tablet replica
I20260709 12:18:22.086694 11916 raft_consensus.cc:2243] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:22.087126 11916 raft_consensus.cc:2272] T 4ff7da6340cc41388f09bd5414a82387 P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:22.088829 11916 tablet_replica.cc:333] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d: stopping tablet replica
I20260709 12:18:22.089417 11916 raft_consensus.cc:2243] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:22.090314 11916 raft_consensus.cc:2272] T 8550130ad49e4eb5baa0a9b8b74e5a86 P b162f67fa3b74f04a3424673bfb3862d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:22.091940 11916 tablet_replica.cc:333] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d: stopping tablet replica
I20260709 12:18:22.092411 11916 raft_consensus.cc:2243] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:22.092832 11916 raft_consensus.cc:2272] T 05ee51fe7dd94be09755c2d154bb04bc P b162f67fa3b74f04a3424673bfb3862d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:22.094340 11916 tablet_replica.cc:333] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d: stopping tablet replica
I20260709 12:18:22.094769 11916 raft_consensus.cc:2243] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:22.095206 11916 raft_consensus.cc:2272] T e0e447db86a44533bb94a5dea94eddac P b162f67fa3b74f04a3424673bfb3862d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:22.097160 11916 tablet_replica.cc:333] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d: stopping tablet replica
I20260709 12:18:22.097537 11916 raft_consensus.cc:2243] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:22.098217 11916 raft_consensus.cc:2272] T 6ac9f950e9ec4d66a9552ab3b5b20797 P b162f67fa3b74f04a3424673bfb3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:22.142215 11916 tablet_server.cc:196] TabletServer@127.11.163.3:0 shutdown complete.
I20260709 12:18:22.161664 11916 master.cc:562] Master@127.11.163.62:39741 shutting down...
I20260709 12:18:22.193861 11916 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:22.194434 11916 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:22.194720 11916 tablet_replica.cc:333] T 00000000000000000000000000000000 P 23d19e0f1d504b208faf2faeee8133c6: stopping tablet replica
I20260709 12:18:22.214917 11916 master.cc:584] Master@127.11.163.62:39741 shutdown complete.
72de5314c0724365b7e9be8b9a310371  5
b162f67fa3b74f04a3424673bfb3862d  1
f0e8f62f8c54440980e06cf6aaec0d24  4
72de5314c0724365b7e9be8b9a310371  3
b162f67fa3b74f04a3424673bfb3862d  3
f0e8f62f8c54440980e06cf6aaec0d24  4
72de5314c0724365b7e9be8b9a310371  8
b162f67fa3b74f04a3424673bfb3862d  1
f0e8f62f8c54440980e06cf6aaec0d24  1
72de5314c0724365b7e9be8b9a310371  3
b162f67fa3b74f04a3424673bfb3862d  3
f0e8f62f8c54440980e06cf6aaec0d24  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (30573 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:18:22.258646 11916 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.163.62:33937
I20260709 12:18:22.259838 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:22.265810 13010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:22.266189 13011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:22.267050 11916 server_base.cc:1061] running on GCE node
W20260709 12:18:22.267505 13013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:22.268433 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:22.268642 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:22.268834 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599502268815 us; error 0 us; skew 500 ppm
I20260709 12:18:22.269343 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:22.271878 11916 webserver.cc:533] Webserver started at http://127.11.163.62:43629/ using document root <none> and password file <none>
I20260709 12:18:22.272360 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:22.272554 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:22.272837 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:22.274024 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/master-0-root/instance:
uuid: "98cf96dd74f448d18b23072207e1dc85"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-z9f9"
I20260709 12:18:22.278492 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:18:22.282338 13018 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.283093 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:18:22.283383 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/master-0-root
uuid: "98cf96dd74f448d18b23072207e1dc85"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-z9f9"
I20260709 12:18:22.283761 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:22.303042 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:22.304373 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:22.343396 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.62:33937
I20260709 12:18:22.343529 13069 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.62:33937 every 8 connection(s)
I20260709 12:18:22.347373 13070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.357142 13070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Bootstrap starting.
I20260709 12:18:22.361805 13070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.366027 13070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: No bootstrap required, opened a new log
I20260709 12:18:22.368299 13070 raft_consensus.cc:359] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98cf96dd74f448d18b23072207e1dc85" member_type: VOTER }
I20260709 12:18:22.368738 13070 raft_consensus.cc:385] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.368922 13070 raft_consensus.cc:740] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98cf96dd74f448d18b23072207e1dc85, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.369532 13070 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98cf96dd74f448d18b23072207e1dc85" member_type: VOTER }
I20260709 12:18:22.369956 13070 raft_consensus.cc:399] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:22.370151 13070 raft_consensus.cc:493] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:22.370378 13070 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:22.374713 13070 raft_consensus.cc:515] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98cf96dd74f448d18b23072207e1dc85" member_type: VOTER }
I20260709 12:18:22.375216 13070 leader_election.cc:304] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98cf96dd74f448d18b23072207e1dc85; no voters: 
I20260709 12:18:22.376403 13070 leader_election.cc:290] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:22.376936 13073 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:22.378268 13073 raft_consensus.cc:697] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [term 1 LEADER]: Becoming Leader. State: Replica: 98cf96dd74f448d18b23072207e1dc85, State: Running, Role: LEADER
I20260709 12:18:22.378986 13073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98cf96dd74f448d18b23072207e1dc85" member_type: VOTER }
I20260709 12:18:22.379657 13070 sys_catalog.cc:565] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:22.384455 13075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98cf96dd74f448d18b23072207e1dc85. Latest consensus state: current_term: 1 leader_uuid: "98cf96dd74f448d18b23072207e1dc85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98cf96dd74f448d18b23072207e1dc85" member_type: VOTER } }
I20260709 12:18:22.385371 13075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:22.384606 13074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98cf96dd74f448d18b23072207e1dc85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98cf96dd74f448d18b23072207e1dc85" member_type: VOTER } }
I20260709 12:18:22.386615 13074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:22.387806 13080 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:22.392748 13080 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:22.397459 11916 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:22.401603 13080 catalog_manager.cc:1383] Generated new cluster ID: 9576b2cd5b8f4f5b9ed231eaee6f6166
I20260709 12:18:22.401895 13080 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:22.418157 13080 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:22.419667 13080 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:22.435879 13080 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Generated new TSK 0
I20260709 12:18:22.436489 13080 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:22.464898 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:22.471271 13091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:22.472440 13092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:22.473789 13094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:22.474400 11916 server_base.cc:1061] running on GCE node
I20260709 12:18:22.475353 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:22.475627 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:22.475757 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599502475745 us; error 0 us; skew 500 ppm
I20260709 12:18:22.476230 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:22.478425 11916 webserver.cc:533] Webserver started at http://127.11.163.1:44935/ using document root <none> and password file <none>
I20260709 12:18:22.478852 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:22.479007 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:22.479233 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:22.480373 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/instance:
uuid: "af3f42f0797349058724e0cb2e637d24"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-z9f9"
I20260709 12:18:22.484823 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:18:22.488466 13099 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.489282 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:18:22.489596 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root
uuid: "af3f42f0797349058724e0cb2e637d24"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-z9f9"
I20260709 12:18:22.489953 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:22.507302 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:22.508615 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:22.510066 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:22.512418 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:22.512629 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.512884 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:22.513063 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.554519 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.1:35201
I20260709 12:18:22.554622 13161 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.1:35201 every 8 connection(s)
I20260709 12:18:22.559412 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:22.566948 13166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:22.567889 13167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:22.570035 11916 server_base.cc:1061] running on GCE node
W20260709 12:18:22.571866 13170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:22.572964 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:22.573248 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:22.573468 13162 heartbeater.cc:344] Connected to a master server at 127.11.163.62:33937
I20260709 12:18:22.573482 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599502573462 us; error 0 us; skew 500 ppm
I20260709 12:18:22.573987 13162 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:22.574467 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:22.574885 13162 heartbeater.cc:507] Master 127.11.163.62:33937 requested a full tablet report, sending...
I20260709 12:18:22.577312 11916 webserver.cc:533] Webserver started at http://127.11.163.2:32783/ using document root <none> and password file <none>
I20260709 12:18:22.577549 13035 ts_manager.cc:194] Registered new tserver with Master: af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:22.577848 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:22.578094 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:22.578364 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:22.579409 13035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42062
I20260709 12:18:22.579532 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/instance:
uuid: "a99436c294734e5cbc3657b2517cefca"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-z9f9"
I20260709 12:18:22.584690 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:18:22.588093 13174 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.588871 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:18:22.589174 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root
uuid: "a99436c294734e5cbc3657b2517cefca"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-z9f9"
I20260709 12:18:22.589421 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:22.611621 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:22.613004 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:22.614516 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:22.616813 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:22.617053 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.617295 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:22.617463 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.657473 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.2:34605
I20260709 12:18:22.657575 13236 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.2:34605 every 8 connection(s)
I20260709 12:18:22.662218 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:22.670356 13241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:22.670274 13240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:22.673969 13243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:22.674721 11916 server_base.cc:1061] running on GCE node
I20260709 12:18:22.675639 13237 heartbeater.cc:344] Connected to a master server at 127.11.163.62:33937
I20260709 12:18:22.675802 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:18:22.676066 13237 heartbeater.cc:461] Registering TS with master...
W20260709 12:18:22.676095 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:22.676476 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599502676453 us; error 0 us; skew 500 ppm
I20260709 12:18:22.676937 13237 heartbeater.cc:507] Master 127.11.163.62:33937 requested a full tablet report, sending...
I20260709 12:18:22.677057 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:22.679468 13035 ts_manager.cc:194] Registered new tserver with Master: a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:22.679929 11916 webserver.cc:533] Webserver started at http://127.11.163.3:42753/ using document root <none> and password file <none>
I20260709 12:18:22.680563 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:22.680804 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:22.681134 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:22.681401 13035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42064
I20260709 12:18:22.682734 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/instance:
uuid: "b190224a708b4f068a6dda4006c3a133"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-z9f9"
I20260709 12:18:22.687335 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:18:22.690670 13248 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.691756 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:18:22.692052 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root
uuid: "b190224a708b4f068a6dda4006c3a133"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-z9f9"
I20260709 12:18:22.692324 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:22.701771 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:22.703008 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:22.704538 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:22.706804 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:22.707049 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.707288 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:22.707473 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:18:22.746673 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.3:35631
I20260709 12:18:22.746775 13310 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.3:35631 every 8 connection(s)
I20260709 12:18:22.761298 13311 heartbeater.cc:344] Connected to a master server at 127.11.163.62:33937
I20260709 12:18:22.761677 13311 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:22.762476 13311 heartbeater.cc:507] Master 127.11.163.62:33937 requested a full tablet report, sending...
I20260709 12:18:22.764421 13035 ts_manager.cc:194] Registered new tserver with Master: b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:22.764901 11916 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01507964s
I20260709 12:18:22.765823 13035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42070
I20260709 12:18:22.790968 13035 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42076:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:22.799306 13035 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:23.015686 13202 tablet_service.cc:1511] Processing CreateTablet for tablet f042aff5e3084d5e8bd6fcb5335160f5 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:18:23.016040 13127 tablet_service.cc:1511] Processing CreateTablet for tablet f042aff5e3084d5e8bd6fcb5335160f5 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:18:23.016407 13276 tablet_service.cc:1511] Processing CreateTablet for tablet f042aff5e3084d5e8bd6fcb5335160f5 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:18:23.017194 13202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f042aff5e3084d5e8bd6fcb5335160f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.017457 13127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f042aff5e3084d5e8bd6fcb5335160f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.017596 13276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f042aff5e3084d5e8bd6fcb5335160f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.018229 13201 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2a264a18f24b6b9933300ddcde0f4e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:18:23.019560 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2a264a18f24b6b9933300ddcde0f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.020613 13274 tablet_service.cc:1511] Processing CreateTablet for tablet 937887e1967840639df25a74d4e57bfd (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:18:23.021931 13274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937887e1967840639df25a74d4e57bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.023913 13272 tablet_service.cc:1511] Processing CreateTablet for tablet 95ba4ee627684f4ea7e32e683e7bcd72 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:18:23.025291 13272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ba4ee627684f4ea7e32e683e7bcd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.028631 13126 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2a264a18f24b6b9933300ddcde0f4e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:18:23.029991 13126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2a264a18f24b6b9933300ddcde0f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.032634 13125 tablet_service.cc:1511] Processing CreateTablet for tablet 937887e1967840639df25a74d4e57bfd (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:18:23.033949 13125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937887e1967840639df25a74d4e57bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.047988 13269 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef464caba794ab4955c661c56df278f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:18:23.049338 13269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef464caba794ab4955c661c56df278f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.050837 13119 tablet_service.cc:1511] Processing CreateTablet for tablet 8719253f6e514245b49fd2d6cf3d0ad4 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:18:23.052229 13119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8719253f6e514245b49fd2d6cf3d0ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.055683 13268 tablet_service.cc:1511] Processing CreateTablet for tablet 8719253f6e514245b49fd2d6cf3d0ad4 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:18:23.057029 13268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8719253f6e514245b49fd2d6cf3d0ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.035363 13124 tablet_service.cc:1511] Processing CreateTablet for tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:18:23.058805 13118 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7a6bb73699404e86b7d94b6633703c (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:18:23.060297 13124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.037132 13123 tablet_service.cc:1511] Processing CreateTablet for tablet 95ba4ee627684f4ea7e32e683e7bcd72 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:18:23.039253 13122 tablet_service.cc:1511] Processing CreateTablet for tablet 9ad86a9f99c849fa9efa50969bc43d9a (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:18:23.041465 13121 tablet_service.cc:1511] Processing CreateTablet for tablet a3da01ae07634adb9184db323ba32a1c (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:18:23.044394 13120 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef464caba794ab4955c661c56df278f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:18:23.065236 13123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ba4ee627684f4ea7e32e683e7bcd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.065552 13267 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7a6bb73699404e86b7d94b6633703c (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:18:23.066844 13267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7a6bb73699404e86b7d94b6633703c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.044569 13270 tablet_service.cc:1511] Processing CreateTablet for tablet a3da01ae07634adb9184db323ba32a1c (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:18:23.068032 13122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ad86a9f99c849fa9efa50969bc43d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.068277 13270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3da01ae07634adb9184db323ba32a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.070878 13121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3da01ae07634adb9184db323ba32a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.045665 13271 tablet_service.cc:1511] Processing CreateTablet for tablet 9ad86a9f99c849fa9efa50969bc43d9a (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:18:23.073714 13120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef464caba794ab4955c661c56df278f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.073923 13271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ad86a9f99c849fa9efa50969bc43d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.046116 13273 tablet_service.cc:1511] Processing CreateTablet for tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:18:23.076226 13273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.047382 13275 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2a264a18f24b6b9933300ddcde0f4e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:18:23.079478 13275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2a264a18f24b6b9933300ddcde0f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.082319 13118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7a6bb73699404e86b7d94b6633703c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.107616 13193 tablet_service.cc:1511] Processing CreateTablet for tablet ca13f9e740914dfbb5008f9905f1da76 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:18:23.108412 13201 tablet_service.cc:1511] Processing CreateTablet for tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:18:23.109086 13193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca13f9e740914dfbb5008f9905f1da76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.109699 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.112630 13199 tablet_service.cc:1511] Processing CreateTablet for tablet 95ba4ee627684f4ea7e32e683e7bcd72 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:18:23.113991 13199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ba4ee627684f4ea7e32e683e7bcd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.116670 13198 tablet_service.cc:1511] Processing CreateTablet for tablet 9ad86a9f99c849fa9efa50969bc43d9a (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:18:23.118031 13198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ad86a9f99c849fa9efa50969bc43d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.120620 13197 tablet_service.cc:1511] Processing CreateTablet for tablet a3da01ae07634adb9184db323ba32a1c (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:18:23.122865 13197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3da01ae07634adb9184db323ba32a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.128664 13196 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef464caba794ab4955c661c56df278f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:18:23.130110 13196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef464caba794ab4955c661c56df278f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.132673 13195 tablet_service.cc:1511] Processing CreateTablet for tablet 8719253f6e514245b49fd2d6cf3d0ad4 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:18:23.134066 13195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8719253f6e514245b49fd2d6cf3d0ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.136665 13194 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7a6bb73699404e86b7d94b6633703c (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:18:23.141606 13194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7a6bb73699404e86b7d94b6633703c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.153115 13200 tablet_service.cc:1511] Processing CreateTablet for tablet 937887e1967840639df25a74d4e57bfd (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:18:23.154596 13200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937887e1967840639df25a74d4e57bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.175751 13275 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:18:23.177536 13275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.154994 13274 tablet_service.cc:1511] Processing CreateTablet for tablet ca13f9e740914dfbb5008f9905f1da76 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:18:23.189476 13327 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:23.192850 13326 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:23.193361 13202 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:18:23.194828 13202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.202749 13328 tablet_bootstrap.cc:492] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:23.214525 13326 tablet_bootstrap.cc:654] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:23.221776 13202 tablet_service.cc:1511] Processing CreateTablet for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:18:23.235590 13124 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:18:23.236977 13124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.238232 13327 tablet_bootstrap.cc:654] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:23.240854 13123 tablet_service.cc:1511] Processing CreateTablet for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:18:23.242116 13126 tablet_service.cc:1511] Processing CreateTablet for tablet 6b675043435441bb980d9a219c4d3450 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:18:23.252538 13127 tablet_service.cc:1511] Processing CreateTablet for tablet ca13f9e740914dfbb5008f9905f1da76 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:18:23.229580 13274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca13f9e740914dfbb5008f9905f1da76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.263616 13276 tablet_service.cc:1511] Processing CreateTablet for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:18:23.242146 13123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a3fa2c26ae4d9a8803582f91f9cff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.267807 13267 tablet_service.cc:1511] Processing CreateTablet for tablet 6b675043435441bb980d9a219c4d3450 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:18:23.263983 13125 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb24dc556e54ae2bb5b9d6900ea82f5 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:18:23.269296 13202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a3fa2c26ae4d9a8803582f91f9cff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.267807 13270 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb24dc556e54ae2bb5b9d6900ea82f5 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:18:23.271355 13199 tablet_service.cc:1511] Processing CreateTablet for tablet 6b675043435441bb980d9a219c4d3450 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:18:23.272790 13268 tablet_service.cc:1511] Processing CreateTablet for tablet c8df593339524328b819bd096f86f17d (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:18:23.286934 13119 tablet_service.cc:1511] Processing CreateTablet for tablet c8df593339524328b819bd096f86f17d (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:18:23.273128 13201 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb24dc556e54ae2bb5b9d6900ea82f5 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:18:23.281231 13276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a3fa2c26ae4d9a8803582f91f9cff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.282065 13271 tablet_service.cc:1511] Processing CreateTablet for tablet 5372f0f4e82241658d5d891336a8b6d4 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:18:23.290827 13271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5372f0f4e82241658d5d891336a8b6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.291373 13119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8df593339524328b819bd096f86f17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.296818 13269 tablet_service.cc:1511] Processing CreateTablet for tablet 09b7d0dede2b49f5ba99e11fa703541e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:18:23.298163 13269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b7d0dede2b49f5ba99e11fa703541e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.279254 13118 tablet_service.cc:1511] Processing CreateTablet for tablet 09b7d0dede2b49f5ba99e11fa703541e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:18:23.300462 13118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b7d0dede2b49f5ba99e11fa703541e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.303283 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb24dc556e54ae2bb5b9d6900ea82f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.311538 13199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b675043435441bb980d9a219c4d3450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.313697 13273 tablet_service.cc:1511] Processing CreateTablet for tablet b5031b82872c430cbd03772ba96480ff (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:18:23.315030 13273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5031b82872c430cbd03772ba96480ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.320309 13126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b675043435441bb980d9a219c4d3450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.300565 13120 tablet_service.cc:1511] Processing CreateTablet for tablet 5372f0f4e82241658d5d891336a8b6d4 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:18:23.320648 13268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8df593339524328b819bd096f86f17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.323477 13120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5372f0f4e82241658d5d891336a8b6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.327759 13127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca13f9e740914dfbb5008f9905f1da76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.329723 13328 tablet_bootstrap.cc:654] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:23.335390 13270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb24dc556e54ae2bb5b9d6900ea82f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.336002 13267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b675043435441bb980d9a219c4d3450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.333264 13125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb24dc556e54ae2bb5b9d6900ea82f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.361461 13326 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:23.361953 13326 ts_tablet_manager.cc:1403] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.169s	user 0.011s	sys 0.016s
I20260709 12:18:23.365031 13326 raft_consensus.cc:359] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:18:23.365839 13326 raft_consensus.cc:385] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:23.366204 13326 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:23.361101 13195 tablet_service.cc:1511] Processing CreateTablet for tablet 09b7d0dede2b49f5ba99e11fa703541e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:18:23.310140 13198 tablet_service.cc:1511] Processing CreateTablet for tablet c8df593339524328b819bd096f86f17d (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:18:23.368193 13326 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:18:23.368566 13267 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc9abc16270419796fe8ad939321769 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:18:23.367724 13195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b7d0dede2b49f5ba99e11fa703541e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.369349 13271 tablet_service.cc:1511] Processing CreateTablet for tablet 25bd867e44d047eeb41637598bf8d7fc (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:18:23.369871 13267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc9abc16270419796fe8ad939321769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.369916 13193 tablet_service.cc:1511] Processing CreateTablet for tablet 5372f0f4e82241658d5d891336a8b6d4 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:18:23.371249 13193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5372f0f4e82241658d5d891336a8b6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.372987 13200 tablet_service.cc:1511] Processing CreateTablet for tablet b5031b82872c430cbd03772ba96480ff (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:18:23.379108 13118 tablet_service.cc:1511] Processing CreateTablet for tablet b5031b82872c430cbd03772ba96480ff (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:18:23.380280 13275 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:18:23.381481 13327 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:23.381625 13275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.381939 13327 ts_tablet_manager.cc:1403] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.193s	user 0.020s	sys 0.003s
I20260709 12:18:23.385038 13327 raft_consensus.cc:359] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:18:23.385706 13327 raft_consensus.cc:385] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:23.385972 13327 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:23.386698 13327 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:18:23.387916 13118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5031b82872c430cbd03772ba96480ff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:23.392585 13083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:23.395619 13196 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc9abc16270419796fe8ad939321769 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:18:23.373492 13268 tablet_service.cc:1511] Processing CreateTablet for tablet bac590852a8a4f4ea0a35528a7ae147d (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:18:23.411360 13271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bd867e44d047eeb41637598bf8d7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.413967 13272 tablet_service.cc:1511] Processing CreateTablet for tablet 7285cfe46adb4975a532c3df36e5203e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:18:23.422364 13237 heartbeater.cc:499] Master 127.11.163.62:33937 was elected leader, sending a full tablet report...
I20260709 12:18:23.415113 13121 tablet_service.cc:1511] Processing CreateTablet for tablet 25bd867e44d047eeb41637598bf8d7fc (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:18:23.449072 13121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bd867e44d047eeb41637598bf8d7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.451086 13120 tablet_service.cc:1511] Processing CreateTablet for tablet bac590852a8a4f4ea0a35528a7ae147d (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:18:23.424609 13122 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc9abc16270419796fe8ad939321769 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:18:23.423266 13201 tablet_service.cc:1511] Processing CreateTablet for tablet 25bd867e44d047eeb41637598bf8d7fc (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:18:23.456089 13120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac590852a8a4f4ea0a35528a7ae147d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.444372 13328 tablet_bootstrap.cc:492] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:23.460017 13328 ts_tablet_manager.cc:1403] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.258s	user 0.014s	sys 0.015s
I20260709 12:18:23.432269 13197 tablet_service.cc:1511] Processing CreateTablet for tablet bac590852a8a4f4ea0a35528a7ae147d (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:18:23.447260 13326 ts_tablet_manager.cc:1434] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.085s	user 0.010s	sys 0.005s
I20260709 12:18:23.423977 13268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac590852a8a4f4ea0a35528a7ae147d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.446033 13274 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6b052993424c29a7d49943db353a08 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:18:23.463318 13328 raft_consensus.cc:359] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:23.458943 13267 tablet_service.cc:1511] Processing CreateTablet for tablet e58a8c3577014cf6ba54f48ffedf7594 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:18:23.464874 13272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7285cfe46adb4975a532c3df36e5203e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.405781 13196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc9abc16270419796fe8ad939321769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.465153 13328 raft_consensus.cc:385] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:23.467326 13122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc9abc16270419796fe8ad939321769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.470327 13194 tablet_service.cc:1511] Processing CreateTablet for tablet 7285cfe46adb4975a532c3df36e5203e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:18:23.470980 13195 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:18:23.478120 13326 tablet_bootstrap.cc:492] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:23.479269 13274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6b052993424c29a7d49943db353a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.479662 13198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8df593339524328b819bd096f86f17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.480904 13195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.481603 13194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7285cfe46adb4975a532c3df36e5203e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.483774 13200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5031b82872c430cbd03772ba96480ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.491704 13197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac590852a8a4f4ea0a35528a7ae147d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.493573 13326 tablet_bootstrap.cc:654] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:23.497133 13199 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6b052993424c29a7d49943db353a08 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:18:23.498656 13199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6b052993424c29a7d49943db353a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.500005 13125 tablet_service.cc:1511] Processing CreateTablet for tablet 7285cfe46adb4975a532c3df36e5203e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:18:23.472683 13328 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:23.501926 13328 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:23.502442 13125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7285cfe46adb4975a532c3df36e5203e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.465360 13124 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:18:23.508679 13124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.516871 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bd867e44d047eeb41637598bf8d7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.470664 13119 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6b052993424c29a7d49943db353a08 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:18:23.524029 13123 tablet_service.cc:1511] Processing CreateTablet for tablet 1622215fe6114b4b80c6430c2cbf33d0 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:18:23.537010 13267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58a8c3577014cf6ba54f48ffedf7594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.548444 13269 tablet_service.cc:1511] Processing CreateTablet for tablet 1622215fe6114b4b80c6430c2cbf33d0 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:18:23.553475 13311 heartbeater.cc:499] Master 127.11.163.62:33937 was elected leader, sending a full tablet report...
I20260709 12:18:23.555927 13276 tablet_service.cc:1511] Processing CreateTablet for tablet 35e9975f4caa4eb7be07cf7ee3aed8b3 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:18:23.557331 13276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e9975f4caa4eb7be07cf7ee3aed8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.559917 13119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6b052993424c29a7d49943db353a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.560182 13126 tablet_service.cc:1511] Processing CreateTablet for tablet 35e9975f4caa4eb7be07cf7ee3aed8b3 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:18:23.560849 13162 heartbeater.cc:499] Master 127.11.163.62:33937 was elected leader, sending a full tablet report...
I20260709 12:18:23.563681 13333 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.564188 13333 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:18:23.566876 13126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e9975f4caa4eb7be07cf7ee3aed8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.576551 13327 ts_tablet_manager.cc:1434] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.194s	user 0.017s	sys 0.016s
I20260709 12:18:23.600392 13328 ts_tablet_manager.cc:1434] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.140s	user 0.005s	sys 0.011s
I20260709 12:18:23.585395 13269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1622215fe6114b4b80c6430c2cbf33d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.571547 13127 tablet_service.cc:1511] Processing CreateTablet for tablet e58a8c3577014cf6ba54f48ffedf7594 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:18:23.619333 13268 tablet_service.cc:1511] Processing CreateTablet for tablet 06fdf45f6d794f90a80b05b5fe3f2316 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:18:23.632102 13202 tablet_service.cc:1511] Processing CreateTablet for tablet e58a8c3577014cf6ba54f48ffedf7594 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:18:23.633476 13270 tablet_service.cc:1511] Processing CreateTablet for tablet 62f45cc6bc2f488697756a90edeec54e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:18:23.641834 13332 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.642407 13332 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:18:23.633538 13202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58a8c3577014cf6ba54f48ffedf7594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.605365 13123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1622215fe6114b4b80c6430c2cbf33d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.665488 13195 tablet_service.cc:1511] Processing CreateTablet for tablet 44133e1a03bc4412a20badffb41bb55e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:18:23.666306 13194 tablet_service.cc:1511] Processing CreateTablet for tablet 06fdf45f6d794f90a80b05b5fe3f2316 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
W20260709 12:18:23.666955 13238 tablet.cc:2406] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:18:23.580122 13273 tablet_service.cc:1511] Processing CreateTablet for tablet 44133e1a03bc4412a20badffb41bb55e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:18:23.606482 13333 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:23.669521 13327 tablet_bootstrap.cc:492] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:23.659837 13328 tablet_bootstrap.cc:492] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:23.671878 13268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fdf45f6d794f90a80b05b5fe3f2316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.703660 13201 tablet_service.cc:1511] Processing CreateTablet for tablet 1622215fe6114b4b80c6430c2cbf33d0 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:18:23.703987 13121 tablet_service.cc:1511] Processing CreateTablet for tablet 44133e1a03bc4412a20badffb41bb55e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:18:23.696940 13195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44133e1a03bc4412a20badffb41bb55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.701488 13272 tablet_service.cc:1511] Processing CreateTablet for tablet 75e2a455a56d445bb7942e9f0b3f7f49 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:18:23.709615 13326 tablet_bootstrap.cc:492] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:23.710361 13326 ts_tablet_manager.cc:1403] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.232s	user 0.009s	sys 0.008s
I20260709 12:18:23.670755 13332 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:23.700747 13127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58a8c3577014cf6ba54f48ffedf7594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.723054 13270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f45cc6bc2f488697756a90edeec54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.732267 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1622215fe6114b4b80c6430c2cbf33d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.736485 13200 tablet_service.cc:1511] Processing CreateTablet for tablet 62f45cc6bc2f488697756a90edeec54e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:18:23.737872 13200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f45cc6bc2f488697756a90edeec54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.739851 13194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fdf45f6d794f90a80b05b5fe3f2316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.745035 13274 tablet_service.cc:1511] Processing CreateTablet for tablet 86b4311504b54b2c8d99d43a9b057e8f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:18:23.748606 13272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e2a455a56d445bb7942e9f0b3f7f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.751876 13273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44133e1a03bc4412a20badffb41bb55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.757720 13201 tablet_service.cc:1511] Processing CreateTablet for tablet 1505ff0869734d74a99b739df5b0530a (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:18:23.766793 13198 tablet_service.cc:1511] Processing CreateTablet for tablet 86b4311504b54b2c8d99d43a9b057e8f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:18:23.769510 13197 tablet_service.cc:1511] Processing CreateTablet for tablet 35e9975f4caa4eb7be07cf7ee3aed8b3 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:18:23.774014 13274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b4311504b54b2c8d99d43a9b057e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.774546 13124 tablet_service.cc:1511] Processing CreateTablet for tablet 06fdf45f6d794f90a80b05b5fe3f2316 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:18:23.774781 13267 tablet_service.cc:1511] Processing CreateTablet for tablet 1505ff0869734d74a99b739df5b0530a (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:18:23.776203 13267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1505ff0869734d74a99b739df5b0530a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.781116 13118 tablet_service.cc:1511] Processing CreateTablet for tablet 75e2a455a56d445bb7942e9f0b3f7f49 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:18:23.785652 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:23.787467 13102 leader_election.cc:343] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:23.789354 13275 tablet_service.cc:1511] Processing CreateTablet for tablet f9377aea669547028ee8449f654c60b7 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:18:23.790721 13275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9377aea669547028ee8449f654c60b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.793260 13121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44133e1a03bc4412a20badffb41bb55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.793092 13326 raft_consensus.cc:359] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:23.793871 13326 raft_consensus.cc:385] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:23.794190 13326 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:23.799947 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1505ff0869734d74a99b739df5b0530a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.803843 13197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e9975f4caa4eb7be07cf7ee3aed8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.810837 13118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e2a455a56d445bb7942e9f0b3f7f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.794953 13326 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:23.817514 13326 ts_tablet_manager.cc:1434] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.002s
I20260709 12:18:23.818498 13326 tablet_bootstrap.cc:492] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:23.828230 13327 tablet_bootstrap.cc:654] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:23.829708 13196 tablet_service.cc:1511] Processing CreateTablet for tablet f9377aea669547028ee8449f654c60b7 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:18:23.815482 13193 tablet_service.cc:1511] Processing CreateTablet for tablet 75e2a455a56d445bb7942e9f0b3f7f49 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:18:23.839718 13124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fdf45f6d794f90a80b05b5fe3f2316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.840009 13326 tablet_bootstrap.cc:654] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:23.845997 13271 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:18:23.852200 13274 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4c4238ca2d414dbdb755c1217ef912 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:18:23.853677 13196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9377aea669547028ee8449f654c60b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.854388 13198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b4311504b54b2c8d99d43a9b057e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.858601 13119 tablet_service.cc:1511] Processing CreateTablet for tablet 86b4311504b54b2c8d99d43a9b057e8f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:18:23.866802 13271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.870796 13120 tablet_service.cc:1511] Processing CreateTablet for tablet 1505ff0869734d74a99b739df5b0530a (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:18:23.872146 13120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1505ff0869734d74a99b739df5b0530a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.873850 13122 tablet_service.cc:1511] Processing CreateTablet for tablet f9377aea669547028ee8449f654c60b7 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:18:23.878073 13126 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:18:23.878434 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:23.879086 13212 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:23.858628 13125 tablet_service.cc:1511] Processing CreateTablet for tablet 62f45cc6bc2f488697756a90edeec54e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:18:23.875283 13122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9377aea669547028ee8449f654c60b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.886472 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:23.886559 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:23.887895 13333 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:23.888230 13274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4c4238ca2d414dbdb755c1217ef912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.888245 13333 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.888818 13333 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:23.890586 13177 leader_election.cc:343] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:23.893872 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:23.902061 13201 tablet_service.cc:1511] Processing CreateTablet for tablet b2b4bbf33578469487ada15907f2483a (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:18:23.910841 13119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b4311504b54b2c8d99d43a9b057e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.912974 13333 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:18:23.915779 13137 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:23.916854 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:23.917465 13212 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:23.919957 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:18:23.921370 13102 leader_election.cc:343] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:23.921424 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:23.922398 13328 tablet_bootstrap.cc:654] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:23.923103 13125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f45cc6bc2f488697756a90edeec54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.924495 13126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.927665 13127 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4c4238ca2d414dbdb755c1217ef912 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:18:23.928947 13127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4c4238ca2d414dbdb755c1217ef912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.930682 13334 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.930784 13195 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4a8424978a43d1ba67730ec2d91f76 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:18:23.931202 13334 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:23.933934 13334 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:23.906649 13268 tablet_service.cc:1511] Processing CreateTablet for tablet 53ab219d48754e9b883a85ef2a514a1e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:18:23.886087 13193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e2a455a56d445bb7942e9f0b3f7f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.942164 13273 tablet_service.cc:1511] Processing CreateTablet for tablet b2b4bbf33578469487ada15907f2483a (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:18:23.952577 13121 tablet_service.cc:1511] Processing CreateTablet for tablet 53ab219d48754e9b883a85ef2a514a1e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:18:23.953914 13121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ab219d48754e9b883a85ef2a514a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.949945 13268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ab219d48754e9b883a85ef2a514a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.964280 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b4bbf33578469487ada15907f2483a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.966113 13199 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:18:23.971698 13200 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4c4238ca2d414dbdb755c1217ef912 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:18:23.915313 13333 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:23.974627 13199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.984117 13118 tablet_service.cc:1511] Processing CreateTablet for tablet b2b4bbf33578469487ada15907f2483a (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:18:23.975569 13212 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:23.986001 13273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b4bbf33578469487ada15907f2483a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.990890 13332 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:23.994105 13326 tablet_bootstrap.cc:492] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:23.994652 13326 ts_tablet_manager.cc:1403] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.003s
I20260709 12:18:23.997752 13326 raft_consensus.cc:359] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:23.998459 13326 raft_consensus.cc:385] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:23.998781 13326 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:23.978014 13123 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4a8424978a43d1ba67730ec2d91f76 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:18:24.000466 13123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4a8424978a43d1ba67730ec2d91f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.006333 13327 tablet_bootstrap.cc:492] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:24.006970 13327 ts_tablet_manager.cc:1403] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.359s	user 0.018s	sys 0.006s
I20260709 12:18:24.007118 13197 tablet_service.cc:1511] Processing CreateTablet for tablet a9b25f727caf4a5598422d510a2e6868 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:18:24.008940 13276 tablet_service.cc:1511] Processing CreateTablet for tablet a9b25f727caf4a5598422d510a2e6868 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:18:24.010262 13276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b25f727caf4a5598422d510a2e6868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.010203 13270 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7b93f2b99d4c27915adea1f987deff (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:18:24.016319 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:24.016769 13267 tablet_service.cc:1511] Processing CreateTablet for tablet 93c48a9952404409941f272f18f7aa28 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:18:24.017591 13333 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:24.018090 13333 raft_consensus.cc:697] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:24.018919 13333 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:18:24.023810 13118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b4bbf33578469487ada15907f2483a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.991358 13195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4a8424978a43d1ba67730ec2d91f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.027769 13200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4c4238ca2d414dbdb755c1217ef912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.027343 13269 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4a8424978a43d1ba67730ec2d91f76 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:18:24.031790 13197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b25f727caf4a5598422d510a2e6868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.032501 13327 raft_consensus.cc:359] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.033325 13327 raft_consensus.cc:385] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.033761 13327 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.041157 13270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7b93f2b99d4c27915adea1f987deff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.043457 13267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c48a9952404409941f272f18f7aa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.045029 13198 tablet_service.cc:1511] Processing CreateTablet for tablet 93c48a9952404409941f272f18f7aa28 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:18:24.046331 13198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c48a9952404409941f272f18f7aa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.051748 13269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4a8424978a43d1ba67730ec2d91f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.054136 13202 tablet_service.cc:1511] Processing CreateTablet for tablet 6fd86be5bbd94b1aa09465a16ec1c5b3 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:18:24.060400 13119 tablet_service.cc:1511] Processing CreateTablet for tablet a9b25f727caf4a5598422d510a2e6868 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:18:24.061445 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:24.062568 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:18:24.066042 13252 leader_election.cc:343] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.066571 13326 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:24.066977 13249 leader_election.cc:343] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.067620 13249 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:24.068532 13334 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:24.068224 13272 tablet_service.cc:1511] Processing CreateTablet for tablet 6fd86be5bbd94b1aa09465a16ec1c5b3 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:18:24.069769 13272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd86be5bbd94b1aa09465a16ec1c5b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.070174 13196 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7b93f2b99d4c27915adea1f987deff (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:18:24.065832 13120 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7b93f2b99d4c27915adea1f987deff (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:18:24.068270 13124 tablet_service.cc:1511] Processing CreateTablet for tablet 93c48a9952404409941f272f18f7aa28 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:18:24.070853 13327 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.075716 13202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd86be5bbd94b1aa09465a16ec1c5b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.079273 13326 ts_tablet_manager.cc:1434] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 12:18:23.998946 13194 tablet_service.cc:1511] Processing CreateTablet for tablet 53ab219d48754e9b883a85ef2a514a1e (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:18:24.092692 13275 tablet_service.cc:1511] Processing CreateTablet for tablet 51d5ddc60f3a4b948881a4efc95b8721 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:18:24.106287 13119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b25f727caf4a5598422d510a2e6868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.110443 13196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7b93f2b99d4c27915adea1f987deff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.101645 13199 tablet_service.cc:1511] Processing CreateTablet for tablet 51d5ddc60f3a4b948881a4efc95b8721 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:18:24.120587 13327 ts_tablet_manager.cc:1434] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.113s	user 0.001s	sys 0.006s
I20260709 12:18:24.127955 13194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ab219d48754e9b883a85ef2a514a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.134912 13124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c48a9952404409941f272f18f7aa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.136837 13327 tablet_bootstrap.cc:492] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:24.139150 13122 tablet_service.cc:1511] Processing CreateTablet for tablet 6fd86be5bbd94b1aa09465a16ec1c5b3 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:18:24.141940 13275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d5ddc60f3a4b948881a4efc95b8721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.144666 13271 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8fccf310364ac9887a867f78b35734 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:18:24.145412 13034 catalog_manager.cc:5697] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.148155 13271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8fccf310364ac9887a867f78b35734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.150791 13326 tablet_bootstrap.cc:492] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:24.152109 13267 tablet_service.cc:1511] Processing CreateTablet for tablet 0277518ce1314a3c82f3ab5bad63bdc6 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:18:24.156204 13267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0277518ce1314a3c82f3ab5bad63bdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.158174 13193 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8fccf310364ac9887a867f78b35734 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:18:24.149454 13274 tablet_service.cc:1511] Processing CreateTablet for tablet a2b8aac4336e49d4bc5ba21f80833bd5 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:18:24.159492 13193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8fccf310364ac9887a867f78b35734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.152482 13120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7b93f2b99d4c27915adea1f987deff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.159653 13274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8aac4336e49d4bc5ba21f80833bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.162959 13200 tablet_service.cc:1511] Processing CreateTablet for tablet 0277518ce1314a3c82f3ab5bad63bdc6 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:18:24.165120 13122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd86be5bbd94b1aa09465a16ec1c5b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.166177 13118 tablet_service.cc:1511] Processing CreateTablet for tablet 51d5ddc60f3a4b948881a4efc95b8721 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:18:24.162108 13199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d5ddc60f3a4b948881a4efc95b8721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.167418 13118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d5ddc60f3a4b948881a4efc95b8721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.171080 13123 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8fccf310364ac9887a867f78b35734 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:18:24.172608 13123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8fccf310364ac9887a867f78b35734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.172653 13198 tablet_service.cc:1511] Processing CreateTablet for tablet 79d6c326c49e497ab8d45ac2cf85f71f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:18:24.174062 13198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d6c326c49e497ab8d45ac2cf85f71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.170495 13273 tablet_service.cc:1511] Processing CreateTablet for tablet 79d6c326c49e497ab8d45ac2cf85f71f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:18:24.176956 13127 tablet_service.cc:1511] Processing CreateTablet for tablet 0277518ce1314a3c82f3ab5bad63bdc6 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:18:24.177007 13121 tablet_service.cc:1511] Processing CreateTablet for tablet 79d6c326c49e497ab8d45ac2cf85f71f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:18:24.177472 13125 tablet_service.cc:1511] Processing CreateTablet for tablet 904dfe40ae474e1689d6b8be4e1dba77 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:18:24.178381 13127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0277518ce1314a3c82f3ab5bad63bdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.179139 13121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d6c326c49e497ab8d45ac2cf85f71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.182410 13200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0277518ce1314a3c82f3ab5bad63bdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.184288 13126 tablet_service.cc:1511] Processing CreateTablet for tablet 96956ab507b74b29b91a4c067585d07f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:18:24.184768 13125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904dfe40ae474e1689d6b8be4e1dba77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.190403 13273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d6c326c49e497ab8d45ac2cf85f71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.186537 13119 tablet_service.cc:1511] Processing CreateTablet for tablet a2b8aac4336e49d4bc5ba21f80833bd5 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:18:24.193029 13119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8aac4336e49d4bc5ba21f80833bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.167732 13332 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.161566 13201 tablet_service.cc:1511] Processing CreateTablet for tablet a2b8aac4336e49d4bc5ba21f80833bd5 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:18:24.195075 13332 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.195844 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8aac4336e49d4bc5ba21f80833bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.197288 13332 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:24.198472 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:24.198886 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:18:24.199921 13177 leader_election.cc:343] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:24.200393 13175 leader_election.cc:343] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.200834 13175 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:24.201879 13332 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:24.211756 13019 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 43667.1us
W20260709 12:18:24.211977 13022 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 43526.4us
I20260709 12:18:24.214334 13194 tablet_service.cc:1511] Processing CreateTablet for tablet 904dfe40ae474e1689d6b8be4e1dba77 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:18:24.227645 13268 tablet_service.cc:1511] Processing CreateTablet for tablet 904dfe40ae474e1689d6b8be4e1dba77 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:18:24.227981 13126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96956ab507b74b29b91a4c067585d07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.237596 13268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904dfe40ae474e1689d6b8be4e1dba77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.258483 13198 tablet_service.cc:1511] Processing CreateTablet for tablet 96956ab507b74b29b91a4c067585d07f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:18:24.259093 13327 tablet_bootstrap.cc:654] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.260160 13198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96956ab507b74b29b91a4c067585d07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.263747 13328 tablet_bootstrap.cc:492] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:24.264346 13328 ts_tablet_manager.cc:1403] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.657s	user 0.015s	sys 0.022s
I20260709 12:18:24.290382 13326 tablet_bootstrap.cc:654] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.276569 13194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904dfe40ae474e1689d6b8be4e1dba77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.578506 13193 tablet_service.cc:1511] Processing CreateTablet for tablet f369b73ff12847ccbbb00601fe431eb4 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:18:24.288611 13272 tablet_service.cc:1511] Processing CreateTablet for tablet 96956ab507b74b29b91a4c067585d07f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:18:24.331187 13274 tablet_service.cc:1511] Processing CreateTablet for tablet f2ad0088ea4e4b988f1c76b3260f2b55 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:18:24.582335 13272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96956ab507b74b29b91a4c067585d07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.267375 13328 raft_consensus.cc:359] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.586217 13328 raft_consensus.cc:385] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.586563 13328 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.586465 13357 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:24.587390 13328 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.419149 13197 tablet_service.cc:1511] Processing CreateTablet for tablet f2ad0088ea4e4b988f1c76b3260f2b55 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:18:24.373641 13271 tablet_service.cc:1511] Processing CreateTablet for tablet c37477a485ab4cbfbeddcf8f65632297 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:18:24.368206 13268 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6b513b5ce94426880fca53620e1f51 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:18:24.346537 13327 tablet_bootstrap.cc:492] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:24.593780 13327 ts_tablet_manager.cc:1403] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.457s	user 0.021s	sys 0.000s
I20260709 12:18:24.357309 13326 tablet_bootstrap.cc:492] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:24.596465 13326 ts_tablet_manager.cc:1403] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.446s	user 0.027s	sys 0.016s
I20260709 12:18:24.597211 13327 raft_consensus.cc:359] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.598094 13327 raft_consensus.cc:385] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.598409 13327 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.446379 13267 tablet_service.cc:1511] Processing CreateTablet for tablet 8820b0db2b544a93ba81b2abe6292404 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:18:24.450687 13276 tablet_service.cc:1511] Processing CreateTablet for tablet d4a97da851674edaa6a93f32de934f5c (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 12:18:24.513844 13083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:24.518903 13269 tablet_service.cc:1511] Processing CreateTablet for tablet 3642b79a5a004395947fefe912c71406 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:18:24.527067 13273 tablet_service.cc:1511] Processing CreateTablet for tablet 763333b6723c40cf8a4902d56603e45f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:18:24.529628 13202 tablet_service.cc:1511] Processing CreateTablet for tablet 8820b0db2b544a93ba81b2abe6292404 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:18:24.543322 13270 tablet_service.cc:1511] Processing CreateTablet for tablet f369b73ff12847ccbbb00601fe431eb4 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:18:24.545001 13122 tablet_service.cc:1511] Processing CreateTablet for tablet 8820b0db2b544a93ba81b2abe6292404 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:18:24.602564 13122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8820b0db2b544a93ba81b2abe6292404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.605010 13200 tablet_service.cc:1511] Processing CreateTablet for tablet 3642b79a5a004395947fefe912c71406 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:18:24.546540 13121 tablet_service.cc:1511] Processing CreateTablet for tablet f369b73ff12847ccbbb00601fe431eb4 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:18:24.546715 13195 tablet_service.cc:1511] Processing CreateTablet for tablet c37477a485ab4cbfbeddcf8f65632297 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:18:24.542806 13196 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6b513b5ce94426880fca53620e1f51 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:18:24.608916 13121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f369b73ff12847ccbbb00601fe431eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.548060 13123 tablet_service.cc:1511] Processing CreateTablet for tablet 763333b6723c40cf8a4902d56603e45f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:18:24.610044 13123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763333b6723c40cf8a4902d56603e45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.548202 13120 tablet_service.cc:1511] Processing CreateTablet for tablet c37477a485ab4cbfbeddcf8f65632297 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:18:24.613188 13120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37477a485ab4cbfbeddcf8f65632297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.549377 13126 tablet_service.cc:1511] Processing CreateTablet for tablet d4a97da851674edaa6a93f32de934f5c (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:18:24.616279 13126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a97da851674edaa6a93f32de934f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.599241 13327 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.550417 13124 tablet_service.cc:1511] Processing CreateTablet for tablet f2ad0088ea4e4b988f1c76b3260f2b55 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:18:24.551472 13119 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6b513b5ce94426880fca53620e1f51 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:18:24.552588 13201 tablet_service.cc:1511] Processing CreateTablet for tablet 763333b6723c40cf8a4902d56603e45f (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:18:24.557337 13118 tablet_service.cc:1511] Processing CreateTablet for tablet 3642b79a5a004395947fefe912c71406 (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:18:24.558002 13332 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.562742 13198 tablet_service.cc:1511] Processing CreateTablet for tablet d4a97da851674edaa6a93f32de934f5c (DEFAULT_TABLE table=test-workload [id=824766a2954f4b6289d140094178de5c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:18:24.567955 13335 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.627676 13332 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.628278 13335 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.579648 13193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f369b73ff12847ccbbb00601fe431eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.630168 13201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763333b6723c40cf8a4902d56603e45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.583158 13274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ad0088ea4e4b988f1c76b3260f2b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.630982 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:18:24.584458 13102 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:24.632205 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 48119.3us
I20260709 12:18:24.632452 13273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763333b6723c40cf8a4902d56603e45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.631846 13196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6b513b5ce94426880fca53620e1f51. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:24.633708 13175 leader_election.cc:343] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.629052 13327 ts_tablet_manager.cc:1434] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:18:24.634403 13119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6b513b5ce94426880fca53620e1f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.634502 13270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f369b73ff12847ccbbb00601fe431eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.635078 13124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ad0088ea4e4b988f1c76b3260f2b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.635202 13327 tablet_bootstrap.cc:492] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:24.635685 13195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37477a485ab4cbfbeddcf8f65632297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.636483 13276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a97da851674edaa6a93f32de934f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.637449 13202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8820b0db2b544a93ba81b2abe6292404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.637966 13269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3642b79a5a004395947fefe912c71406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.639530 13271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37477a485ab4cbfbeddcf8f65632297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.639645 13118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3642b79a5a004395947fefe912c71406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.640645 13197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ad0088ea4e4b988f1c76b3260f2b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.642233 13268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6b513b5ce94426880fca53620e1f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.644546 13267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8820b0db2b544a93ba81b2abe6292404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.607538 13326 raft_consensus.cc:359] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.649833 13326 raft_consensus.cc:385] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.650398 13326 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.654181 13198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a97da851674edaa6a93f32de934f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.656849 13200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3642b79a5a004395947fefe912c71406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.666399 13326 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.599263 13328 ts_tablet_manager.cc:1434] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.335s	user 0.012s	sys 0.005s
I20260709 12:18:24.714890 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:24.716389 13177 leader_election.cc:343] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.716843 13177 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:24.717837 13359 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:24.718580 13332 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:24.737932 13328 tablet_bootstrap.cc:492] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:24.753310 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:18:24.757690 13103 leader_election.cc:343] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.759289 13335 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:24.759923 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:24.760608 13286 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:24.761907 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:18:24.763007 13335 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:24.763827 13335 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.764163 13335 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.777499 13335 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.780534 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:24.781713 13335 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:18:24.783151 13103 leader_election.cc:343] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.783082 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:24.783852 13286 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.787940 13328 tablet_bootstrap.cc:654] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.790779 13286 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:24.791157 13326 ts_tablet_manager.cc:1434] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.194s	user 0.007s	sys 0.003s
I20260709 12:18:24.800571 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:18:24.802592 13326 tablet_bootstrap.cc:492] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:24.803385 13335 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:24.805493 13335 raft_consensus.cc:697] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:24.806412 13335 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.809774 13327 tablet_bootstrap.cc:654] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.820382 13332 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.820900 13332 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.822908 13332 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:24.825563 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:18:24.827206 13175 leader_election.cc:343] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.828112 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:24.829545 13326 tablet_bootstrap.cc:654] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:24.829694 13177 leader_election.cc:343] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.830130 13177 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:24.831365 13332 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:24.834048 13328 tablet_bootstrap.cc:492] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:24.834648 13328 ts_tablet_manager.cc:1403] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.002s
I20260709 12:18:24.845284 13326 tablet_bootstrap.cc:492] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:24.845898 13326 ts_tablet_manager.cc:1403] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.007s
I20260709 12:18:24.846784 13035 catalog_manager.cc:5697] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.849124 13326 raft_consensus.cc:359] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.849965 13326 raft_consensus.cc:385] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.850314 13326 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.851135 13326 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.853564 13326 ts_tablet_manager.cc:1434] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:24.854305 13328 raft_consensus.cc:359] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.860951 13328 raft_consensus.cc:385] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.858217 13327 tablet_bootstrap.cc:492] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:24.861802 13327 ts_tablet_manager.cc:1403] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.227s	user 0.000s	sys 0.031s
I20260709 12:18:24.864986 13327 raft_consensus.cc:359] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.866302 13327 raft_consensus.cc:385] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.866724 13327 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.854874 13326 tablet_bootstrap.cc:492] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:24.865833 13328 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.868105 13328 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.869184 13327 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.871953 13327 ts_tablet_manager.cc:1434] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:18:24.873114 13327 tablet_bootstrap.cc:492] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:24.874637 13328 ts_tablet_manager.cc:1434] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260709 12:18:24.874948 13326 tablet_bootstrap.cc:654] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.876011 13328 tablet_bootstrap.cc:492] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:24.880301 13327 tablet_bootstrap.cc:654] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.884011 13328 tablet_bootstrap.cc:654] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.892510 13327 tablet_bootstrap.cc:492] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:24.893148 13327 ts_tablet_manager.cc:1403] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:18:24.893800 13326 tablet_bootstrap.cc:492] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:24.894394 13326 ts_tablet_manager.cc:1403] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.016s
I20260709 12:18:24.896608 13327 raft_consensus.cc:359] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.897459 13327 raft_consensus.cc:385] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.897815 13327 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.898653 13327 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.899454 13326 raft_consensus.cc:359] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.900909 13326 raft_consensus.cc:385] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.901724 13327 ts_tablet_manager.cc:1434] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:18:24.902995 13327 tablet_bootstrap.cc:492] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:24.903056 13328 tablet_bootstrap.cc:492] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:24.901788 13326 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.903831 13328 ts_tablet_manager.cc:1403] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.002s
I20260709 12:18:24.904315 13326 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.906888 13326 ts_tablet_manager.cc:1434] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:18:24.906808 13328 raft_consensus.cc:359] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.907688 13328 raft_consensus.cc:385] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.908046 13328 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.908327 13326 tablet_bootstrap.cc:492] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:24.908874 13328 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.910211 13327 tablet_bootstrap.cc:654] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.911144 13328 ts_tablet_manager.cc:1434] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:18:24.916280 13328 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:24.921568 13326 tablet_bootstrap.cc:654] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.922271 13327 tablet_bootstrap.cc:492] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:24.922840 13327 ts_tablet_manager.cc:1403] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:18:24.922888 13328 tablet_bootstrap.cc:654] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.926257 13327 raft_consensus.cc:359] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.927084 13327 raft_consensus.cc:385] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.927493 13327 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.928552 13327 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.932868 13327 ts_tablet_manager.cc:1434] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:18:24.934201 13327 tablet_bootstrap.cc:492] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:24.935648 13358 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.936195 13358 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.937242 13326 tablet_bootstrap.cc:492] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:24.937835 13326 ts_tablet_manager.cc:1403] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.007s
I20260709 12:18:24.940032 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:24.940853 13327 tablet_bootstrap.cc:654] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.941013 13326 raft_consensus.cc:359] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.941962 13326 raft_consensus.cc:385] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.942320 13326 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.942430 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:24.943164 13137 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:24.943221 13326 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:24.944751 13252 leader_election.cc:343] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.945400 13358 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:24.946215 13326 ts_tablet_manager.cc:1434] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:18:24.947806 13249 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:18:24.948235 13328 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:24.948761 13328 ts_tablet_manager.cc:1403] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.006s
I20260709 12:18:24.949110 13358 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:24.949542 13358 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.949934 13358 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.950145 13326 tablet_bootstrap.cc:492] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:24.952044 13328 raft_consensus.cc:359] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:18:24.952854 13328 raft_consensus.cc:385] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.953192 13328 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.953985 13328 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:18:24.971647 13326 tablet_bootstrap.cc:654] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.978338 13328 ts_tablet_manager.cc:1434] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.029s	user 0.015s	sys 0.013s
I20260709 12:18:24.978838 13327 tablet_bootstrap.cc:492] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:24.979235 13326 tablet_bootstrap.cc:492] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:24.979310 13327 ts_tablet_manager.cc:1403] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.016s
I20260709 12:18:24.979741 13326 ts_tablet_manager.cc:1403] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.001s
I20260709 12:18:24.979755 13328 tablet_bootstrap.cc:492] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:24.982417 13326 raft_consensus.cc:359] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.982198 13327 raft_consensus.cc:359] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.983052 13326 raft_consensus.cc:385] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.983211 13327 raft_consensus.cc:385] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.983372 13326 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.983743 13327 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.984249 13326 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.984520 13327 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:24.987183 13327 ts_tablet_manager.cc:1434] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:24.989092 13327 tablet_bootstrap.cc:492] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:24.989679 13326 ts_tablet_manager.cc:1434] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:18:24.990623 13326 tablet_bootstrap.cc:492] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:24.993171 13328 tablet_bootstrap.cc:654] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.995640 13327 tablet_bootstrap.cc:654] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.995918 13326 tablet_bootstrap.cc:654] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.006287 13358 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.008004 13327 tablet_bootstrap.cc:492] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:25.008277 13326 tablet_bootstrap.cc:492] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:25.008663 13326 ts_tablet_manager.cc:1403] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:18:25.008633 13327 ts_tablet_manager.cc:1403] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.014s
I20260709 12:18:25.010845 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:25.011579 13327 raft_consensus.cc:359] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.011679 13326 raft_consensus.cc:359] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.011780 13137 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.012542 13327 raft_consensus.cc:385] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.012899 13326 raft_consensus.cc:385] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.012926 13327 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.013391 13326 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.014118 13326 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.016287 13326 ts_tablet_manager.cc:1434] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:25.014061 13327 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.017886 13327 ts_tablet_manager.cc:1434] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:18:25.019085 13327 tablet_bootstrap.cc:492] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:25.022177 13326 tablet_bootstrap.cc:492] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:25.024789 13327 tablet_bootstrap.cc:654] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.028646 13326 tablet_bootstrap.cc:654] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.036214 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:25.036911 13211 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.043709 13327 tablet_bootstrap.cc:492] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:25.043861 13358 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:25.044544 13327 ts_tablet_manager.cc:1403] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 12:18:25.044692 13211 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:25.046119 13252 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:25.047282 13358 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.048280 13327 raft_consensus.cc:359] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.049219 13327 raft_consensus.cc:385] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.049422 13358 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:25.049572 13327 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.047227 13137 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:25.050853 13327 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.050895 13358 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.054253 13328 tablet_bootstrap.cc:492] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:25.054814 13328 ts_tablet_manager.cc:1403] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.013s
I20260709 12:18:25.057689 13327 ts_tablet_manager.cc:1434] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:18:25.058203 13328 raft_consensus.cc:359] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.058985 13327 tablet_bootstrap.cc:492] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:25.059072 13328 raft_consensus.cc:385] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.060879 13328 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.062036 13326 tablet_bootstrap.cc:492] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:25.061749 13328 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.062655 13326 ts_tablet_manager.cc:1403] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.022s
I20260709 12:18:25.064333 13328 ts_tablet_manager.cc:1434] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:18:25.065003 13327 tablet_bootstrap.cc:654] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.065480 13328 tablet_bootstrap.cc:492] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:25.065457 13326 raft_consensus.cc:359] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.066432 13326 raft_consensus.cc:385] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.066781 13326 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.067636 13326 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.073606 13328 tablet_bootstrap.cc:654] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.076330 13326 ts_tablet_manager.cc:1434] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:18:25.077800 13326 tablet_bootstrap.cc:492] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:25.082415 13335 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.082918 13335 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.085140 13335 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.086702 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:25.088691 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.089329 13211 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
W20260709 12:18:25.090921 13102 leader_election.cc:343] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.089560 13033 catalog_manager.cc:5697] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.093245 13103 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:25.096197 13326 tablet_bootstrap.cc:654] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.096802 13357 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.099360 13357 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.100409 13327 tablet_bootstrap.cc:492] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:25.100880 13327 ts_tablet_manager.cc:1403] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.016s
I20260709 12:18:25.097407 13328 tablet_bootstrap.cc:492] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:25.097738 13335 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.101568 13357 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.101850 13335 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.101940 13328 ts_tablet_manager.cc:1403] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.013s
I20260709 12:18:25.102303 13335 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.103525 13327 raft_consensus.cc:359] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.104879 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:25.105614 13327 raft_consensus.cc:385] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.105412 13328 raft_consensus.cc:359] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.106159 13328 raft_consensus.cc:385] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.106415 13328 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.106495 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.107121 13211 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:25.107030 13328 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.107885 13286 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:25.108408 13103 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:25.109288 13357 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.109555 13328 ts_tablet_manager.cc:1434] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:25.109648 13357 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.110226 13357 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.110563 13328 tablet_bootstrap.cc:492] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:25.116482 13335 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.117239 13328 tablet_bootstrap.cc:654] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.120080 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:25.120774 13211 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.120579 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:18:25.122539 13102 leader_election.cc:343] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.123414 13335 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.126991 13326 tablet_bootstrap.cc:492] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:25.105937 13327 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.127481 13326 ts_tablet_manager.cc:1403] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.000s
I20260709 12:18:25.128114 13327 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.130087 13328 tablet_bootstrap.cc:492] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:25.130059 13326 raft_consensus.cc:359] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.130833 13328 ts_tablet_manager.cc:1403] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:18:25.130908 13326 raft_consensus.cc:385] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.131269 13326 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.131703 13211 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:25.131991 13326 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.133101 13103 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:25.133846 13328 raft_consensus.cc:359] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.134472 13328 raft_consensus.cc:385] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.134467 13326 ts_tablet_manager.cc:1434] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:25.134877 13328 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.135736 13328 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.136224 13326 tablet_bootstrap.cc:492] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:25.130259 13327 ts_tablet_manager.cc:1434] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:18:25.138800 13327 tablet_bootstrap.cc:492] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:25.142539 13326 tablet_bootstrap.cc:654] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.143905 13328 ts_tablet_manager.cc:1434] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 12:18:25.144857 13328 tablet_bootstrap.cc:492] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:25.143810 13357 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.148602 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:25.149385 13286 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.150386 13328 tablet_bootstrap.cc:654] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.154234 13389 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.166869 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:25.167763 13211 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.175642 13357 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.180147 13211 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:25.159336 13286 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:25.181927 13103 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:25.183316 13389 raft_consensus.cc:697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:25.184302 13389 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.185302 13392 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.186035 13392 raft_consensus.cc:697] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:25.186902 13392 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.187620 13327 tablet_bootstrap.cc:654] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.188874 13358 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.189364 13358 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.192242 13358 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:25.192721 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:25.193380 13137 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:25.194218 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.194900 13326 tablet_bootstrap.cc:492] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:25.195363 13326 ts_tablet_manager.cc:1403] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.039s
I20260709 12:18:25.195072 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:25.196242 13358 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.196724 13358 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.197156 13358 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.197820 13328 tablet_bootstrap.cc:492] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:25.198316 13328 ts_tablet_manager.cc:1403] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.054s	user 0.004s	sys 0.018s
I20260709 12:18:25.198189 13326 raft_consensus.cc:359] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.198855 13326 raft_consensus.cc:385] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.199157 13326 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.199988 13392 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.200170 13326 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.200461 13392 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.203002 13392 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.203833 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:25.204659 13286 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
W20260709 12:18:25.205591 13252 leader_election.cc:343] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.205814 13328 raft_consensus.cc:359] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.207186 13328 raft_consensus.cc:385] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.207664 13328 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.207942 13326 ts_tablet_manager.cc:1434] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:18:25.208448 13328 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.208993 13326 tablet_bootstrap.cc:492] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:25.213488 13328 ts_tablet_manager.cc:1434] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.002s
I20260709 12:18:25.214427 13389 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.222357 13327 tablet_bootstrap.cc:492] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:25.214983 13102 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:25.222826 13327 ts_tablet_manager.cc:1403] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.000s
I20260709 12:18:25.223014 13328 tablet_bootstrap.cc:492] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:25.223093 13392 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.223508 13392 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.223865 13392 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.225085 13389 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.225960 13327 raft_consensus.cc:359] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.226599 13327 raft_consensus.cc:385] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.226876 13327 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.227528 13327 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.228415 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.228999 13212 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:25.218863 13326 tablet_bootstrap.cc:654] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.230672 13103 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:25.220177 13035 catalog_manager.cc:5697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.231140 13392 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.231317 13358 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.232378 13327 ts_tablet_manager.cc:1434] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:18:25.233268 13327 tablet_bootstrap.cc:492] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:25.229169 13328 tablet_bootstrap.cc:654] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.215721 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.233671 13335 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.233875 13211 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:25.234030 13335 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.234405 13335 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.235191 13358 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:25.242944 13327 tablet_bootstrap.cc:654] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.243605 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:18:25.245412 13252 leader_election.cc:343] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.247918 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:25.248773 13286 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.249704 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:25.250489 13211 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.251919 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:25.252700 13137 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.254812 13327 tablet_bootstrap.cc:492] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:25.255293 13327 ts_tablet_manager.cc:1403] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.005s
I20260709 12:18:25.258064 13327 raft_consensus.cc:359] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.258733 13327 raft_consensus.cc:385] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.259004 13327 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.265282 13389 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.265419 13327 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.266948 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:25.270411 13335 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.278455 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:25.279253 13212 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.283353 13389 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.284016 13389 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.286203 13210 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.287415 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.288358 13209 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:25.286242 13389 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.291394 13137 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:25.291712 13392 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.290218 13103 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:25.271926 13033 catalog_manager.cc:5697] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:25.274286 13102 leader_election.cc:343] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.293968 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:18:25.295241 13358 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.295946 13358 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:25.297057 13358 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.302166 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:25.303051 13285 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:25.305846 13389 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.306241 13389 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.306588 13389 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.309767 13286 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:25.310950 13102 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:25.311769 13357 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.313666 13357 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.274852 13211 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:25.271317 13327 ts_tablet_manager.cc:1434] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.004s
I20260709 12:18:25.313839 13389 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.315723 13327 tablet_bootstrap.cc:492] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:25.317214 13389 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.317847 13389 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.318043 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:25.318296 13389 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.318796 13285 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.321751 13389 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.321588 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:25.322465 13284 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:25.324245 13327 tablet_bootstrap.cc:654] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.324028 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:25.324870 13389 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.325011 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:25.325287 13389 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.325753 13389 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.325817 13211 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.329209 13328 tablet_bootstrap.cc:492] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:25.329823 13328 ts_tablet_manager.cc:1403] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.107s	user 0.048s	sys 0.023s
I20260709 12:18:25.330859 13285 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:25.332160 13102 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:25.334381 13326 tablet_bootstrap.cc:492] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:25.334873 13326 ts_tablet_manager.cc:1403] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.126s	user 0.044s	sys 0.024s
I20260709 12:18:25.335522 13212 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:25.336755 13327 tablet_bootstrap.cc:492] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:25.337201 13327 ts_tablet_manager.cc:1403] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 12:18:25.337607 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.338239 13210 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:25.339399 13328 raft_consensus.cc:359] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.339754 13327 raft_consensus.cc:359] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.340090 13328 raft_consensus.cc:385] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.339886 13392 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.340368 13327 raft_consensus.cc:385] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.341190 13327 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.341460 13326 raft_consensus.cc:359] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.342020 13327 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.342110 13326 raft_consensus.cc:385] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.340493 13328 raft_consensus.cc:740] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.343842 13326 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.341676 13403 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.344310 13328 consensus_queue.cc:260] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.344835 13326 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.347054 13326 ts_tablet_manager.cc:1434] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.008s
I20260709 12:18:25.347554 13328 ts_tablet_manager.cc:1434] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.007s
I20260709 12:18:25.348735 13328 tablet_bootstrap.cc:492] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:25.349434 13326 tablet_bootstrap.cc:492] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:25.351234 13357 raft_consensus.cc:697] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:25.351830 13400 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.357447 13377 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.350080 13103 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:25.359462 13335 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.360041 13335 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.360280 13326 tablet_bootstrap.cc:654] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.360483 13335 raft_consensus.cc:697] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:25.361356 13335 consensus_queue.cc:237] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.363348 13389 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.357978 13377 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:18:25.367888 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:18:25.369417 13102 leader_election.cc:343] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.369743 13377 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:25.355058 13403 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.368760 13035 catalog_manager.cc:5697] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.373946 13403 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.377041 13327 ts_tablet_manager.cc:1434] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.010s
I20260709 12:18:25.377257 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:25.378052 13327 tablet_bootstrap.cc:492] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:25.379179 13357 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.380474 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.381378 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.382017 13209 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:25.385557 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:25.385715 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:25.386420 13358 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:25.388082 13389 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.395912 13332 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:25.416951 13233 debug-util.cc:398] Leaking SignalData structure 0x7b0800163740 after lost signal to thread 11919
I20260709 12:18:25.396472 13332 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.399469 13392 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:25.429122 13404 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.448235 13328 tablet_bootstrap.cc:654] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.449196 13404 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.449782 13404 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.463899 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:25.464581 13209 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.470220 13332 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.471604 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:25.473472 13177 leader_election.cc:343] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.462913 13211 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:25.504333 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:25.506889 13233 debug-util.cc:398] Leaking SignalData structure 0x7b0800165e60 after lost signal to thread 13069
I20260709 12:18:25.504635 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:25.517426 13209 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:25.518862 13103 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:18:25.519138 13175 leader_election.cc:343] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.519776 13335 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.519822 13175 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:25.520354 13335 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:25.520794 13332 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:25.507937 13405 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:25.530786 13102 leader_election.cc:343] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.531190 13332 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.531808 13332 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.518854 13033 catalog_manager.cc:5697] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.521283 13335 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.524654 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:25.508598 13392 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.527485 13286 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.527357 13358 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.530622 13405 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:25.529949 13233 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1720 after lost signal to thread 13161
I20260709 12:18:25.538343 13285 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:25.545374 13233 debug-util.cc:398] Leaking SignalData structure 0x7b0800211880 after lost signal to thread 13236
I20260709 12:18:25.550524 13326 tablet_bootstrap.cc:492] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:25.551282 13326 ts_tablet_manager.cc:1403] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.202s	user 0.020s	sys 0.000s
I20260709 12:18:25.535058 13404 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.555294 13328 tablet_bootstrap.cc:492] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:25.555787 13328 ts_tablet_manager.cc:1403] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.207s	user 0.012s	sys 0.004s
W20260709 12:18:25.555927 13233 debug-util.cc:398] Leaking SignalData structure 0x7b0800138ee0 after lost signal to thread 13310
I20260709 12:18:25.568801 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.575356 13405 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.577221 13212 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:25.578612 13103 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:25.579617 13405 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.580024 13405 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.580407 13405 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.581867 13326 raft_consensus.cc:359] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.583318 13326 raft_consensus.cc:385] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.583712 13326 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.587246 13392 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.588858 13326 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.590762 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:25.591385 13212 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.593593 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:25.592823 13328 raft_consensus.cc:359] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.586884 13285 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:25.594580 13326 ts_tablet_manager.cc:1434] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:18:25.595387 13328 raft_consensus.cc:385] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.595716 13328 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.597164 13326 tablet_bootstrap.cc:492] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:25.598695 13328 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.596177 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:25.594425 13404 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.609148 13328 ts_tablet_manager.cc:1434] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:18:25.610538 13328 tablet_bootstrap.cc:492] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:25.601274 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:25.610067 13102 leader_election.cc:343] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:25.612731 13102 leader_election.cc:343] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.609725 13332 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.617547 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:25.619171 13177 leader_election.cc:343] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:25.630734 13083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:25.633698 13327 tablet_bootstrap.cc:654] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.634526 13212 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:25.651763 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:25.657068 13326 tablet_bootstrap.cc:654] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.657063 13358 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:18:25.667092 13405 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.668684 13137 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:25.675680 13034 catalog_manager.cc:5697] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.678131 13034 catalog_manager.cc:5697] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.658735 13335 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.680943 13335 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:25.681645 13175 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:25.682004 13328 tablet_bootstrap.cc:654] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.681463 13034 catalog_manager.cc:5697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.683588 13332 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.700848 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:25.702836 13389 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.705235 13335 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.695839 13377 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.710179 13358 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.712359 13332 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:25.716814 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:18:25.725122 13102 leader_election.cc:343] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.706992 13377 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.719174 13405 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.738466 13327 tablet_bootstrap.cc:492] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:25.738977 13327 ts_tablet_manager.cc:1403] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.361s	user 0.011s	sys 0.022s
I20260709 12:18:25.741638 13377 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:25.742844 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.744249 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:25.744801 13209 raft_consensus.cc:2393] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:25.747092 13405 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.747568 13405 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.749922 13327 raft_consensus.cc:359] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.750447 13405 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.750703 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:25.752406 13249 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:25.753727 13327 raft_consensus.cc:385] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.756137 13327 raft_consensus.cc:740] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.756897 13327 consensus_queue.cc:260] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.758296 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.759117 13327 ts_tablet_manager.cc:1434] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.006s
I20260709 12:18:25.760176 13327 tablet_bootstrap.cc:492] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:25.761566 13212 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.762331 13358 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:25.763201 13102 leader_election.cc:343] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:25.768265 13103 leader_election.cc:343] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.768746 13103 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:25.770704 13328 tablet_bootstrap.cc:492] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:25.771193 13328 ts_tablet_manager.cc:1403] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.007s
I20260709 12:18:25.769763 13405 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:25.771915 13377 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.773263 13377 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.773738 13377 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.775161 13328 raft_consensus.cc:359] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.775955 13328 raft_consensus.cc:385] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.776320 13328 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.777205 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:25.777583 13211 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
W20260709 12:18:25.779024 13249 leader_election.cc:343] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.779075 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.780020 13328 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:25.781117 13252 leader_election.cc:343] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.781729 13252 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:25.783372 13421 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:25.784529 13421 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.784945 13326 tablet_bootstrap.cc:492] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:25.785440 13326 ts_tablet_manager.cc:1403] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.189s	user 0.009s	sys 0.020s
I20260709 12:18:25.785784 13377 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:25.788134 13421 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.788872 13358 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:25.790690 13405 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.792495 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:18:25.794461 13252 leader_election.cc:343] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.795130 13421 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:25.803171 13328 ts_tablet_manager.cc:1434] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:18:25.804430 13328 tablet_bootstrap.cc:492] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:25.802866 13405 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:18:25.808184 13103 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:25.809144 13405 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.809623 13405 raft_consensus.cc:697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:25.807462 13326 raft_consensus.cc:359] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.810990 13326 raft_consensus.cc:385] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.811347 13326 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.813359 13405 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.812300 13326 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.813391 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:25.816478 13136 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:25.821220 13326 ts_tablet_manager.cc:1434] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.003s
I20260709 12:18:25.821403 13249 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:18:25.822180 13326 tablet_bootstrap.cc:492] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:25.824004 13377 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.824378 13377 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.824728 13377 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.839391 13328 tablet_bootstrap.cc:654] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.845085 13327 tablet_bootstrap.cc:654] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.858160 13377 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.861744 13035 catalog_manager.cc:5697] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.875568 13377 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:25.876565 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:25.876590 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:25.877308 13136 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:25.878626 13252 leader_election.cc:343] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.881645 13400 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.884330 13326 tablet_bootstrap.cc:654] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.888398 13328 tablet_bootstrap.cc:492] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:25.888833 13328 ts_tablet_manager.cc:1403] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.001s
I20260709 12:18:25.892967 13327 tablet_bootstrap.cc:492] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:25.892752 13328 raft_consensus.cc:359] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.893442 13327 ts_tablet_manager.cc:1403] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.134s	user 0.005s	sys 0.019s
I20260709 12:18:25.893554 13328 raft_consensus.cc:385] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.893977 13328 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.894809 13328 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.896031 13327 raft_consensus.cc:359] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.896826 13327 raft_consensus.cc:385] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.896938 13328 ts_tablet_manager.cc:1434] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:18:25.897115 13327 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.897979 13328 tablet_bootstrap.cc:492] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:25.897799 13327 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.900681 13327 ts_tablet_manager.cc:1434] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:25.901521 13327 tablet_bootstrap.cc:492] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:25.902318 13136 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:25.907568 13327 tablet_bootstrap.cc:654] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.912761 13328 tablet_bootstrap.cc:654] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.917057 13400 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.924710 13033 catalog_manager.cc:5697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.925586 13249 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:18:25.927148 13377 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.927802 13377 raft_consensus.cc:697] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:25.928642 13377 consensus_queue.cc:237] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.930002 13326 tablet_bootstrap.cc:492] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:25.930620 13326 ts_tablet_manager.cc:1403] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.008s
I20260709 12:18:25.933605 13326 raft_consensus.cc:359] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.934369 13326 raft_consensus.cc:385] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.934707 13326 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.935501 13326 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.940470 13389 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.942570 13327 tablet_bootstrap.cc:492] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:25.943259 13326 ts_tablet_manager.cc:1434] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:18:25.944976 13326 tablet_bootstrap.cc:492] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:25.943073 13327 ts_tablet_manager.cc:1403] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.002s
I20260709 12:18:25.948210 13283 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.949846 13327 raft_consensus.cc:359] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.950532 13327 raft_consensus.cc:385] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.950796 13327 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.954196 13327 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.956398 13327 ts_tablet_manager.cc:1434] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:18:25.957340 13327 tablet_bootstrap.cc:492] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:25.958865 13326 tablet_bootstrap.cc:654] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.961359 13400 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.978052 13327 tablet_bootstrap.cc:654] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.984750 13400 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.985248 13400 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:25.989928 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:25.990108 13400 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:25.990669 13210 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:25.990779 13034 catalog_manager.cc:5697] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.991366 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:25.992218 13103 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:25.993122 13400 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.993494 13400 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:25.993573 13102 leader_election.cc:343] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:25.993939 13400 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.004601 13389 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:26.006040 13400 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.019505 13328 tablet_bootstrap.cc:492] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:26.020180 13328 ts_tablet_manager.cc:1403] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.122s	user 0.023s	sys 0.010s
I20260709 12:18:26.022730 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:26.023401 13209 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.024555 13328 raft_consensus.cc:359] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.025229 13328 raft_consensus.cc:385] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.025492 13328 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.026151 13328 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.028513 13328 ts_tablet_manager.cc:1434] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:26.029482 13328 tablet_bootstrap.cc:492] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:26.033972 13209 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:26.034930 13326 tablet_bootstrap.cc:492] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:26.035388 13103 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:26.036428 13389 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:26.036986 13389 raft_consensus.cc:697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:26.038079 13389 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.040977 13328 tablet_bootstrap.cc:654] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.051975 13400 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.053740 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:26.054325 13286 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.055342 13327 tablet_bootstrap.cc:492] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:26.055794 13327 ts_tablet_manager.cc:1403] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.099s	user 0.018s	sys 0.001s
I20260709 12:18:26.059118 13326 ts_tablet_manager.cc:1403] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.114s	user 0.028s	sys 0.022s
I20260709 12:18:26.060472 13327 raft_consensus.cc:359] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.061168 13327 raft_consensus.cc:385] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.061453 13327 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.061331 13286 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:26.062255 13327 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.064474 13327 ts_tablet_manager.cc:1434] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:26.064209 13326 raft_consensus.cc:359] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.064895 13326 raft_consensus.cc:385] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.065174 13326 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.065169 13034 catalog_manager.cc:5697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:26.067898 13326 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.069643 13326 ts_tablet_manager.cc:1434] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.002s
I20260709 12:18:26.070506 13327 tablet_bootstrap.cc:492] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:26.071583 13389 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:26.074951 13326 tablet_bootstrap.cc:492] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:26.077250 13327 tablet_bootstrap.cc:654] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.080358 13415 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.080899 13415 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.084401 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:26.084627 13332 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.085037 13283 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:26.085114 13332 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.085335 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:26.086198 13136 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:26.086500 13177 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:26.087829 13413 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:26.088227 13413 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.088304 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:26.088640 13413 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:26.089697 13177 leader_election.cc:343] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.092835 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:18:26.095258 13175 leader_election.cc:343] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.095741 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.096995 13415 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.098150 13415 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:26.087221 13332 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.110029 13327 tablet_bootstrap.cc:492] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:26.110541 13327 ts_tablet_manager.cc:1403] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.003s
I20260709 12:18:26.113430 13327 raft_consensus.cc:359] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.114106 13327 raft_consensus.cc:385] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.113941 13404 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:26.114449 13327 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.123167 13413 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.125782 13327 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.127732 13404 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.132081 13404 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.134439 13327 ts_tablet_manager.cc:1434] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:18:26.138901 13404 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.139855 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:26.141426 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:18:26.141637 13102 leader_election.cc:343] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.142047 13210 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:26.143388 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.144697 13404 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:26.145150 13404 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.145561 13404 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.148630 13335 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:26.151688 13327 tablet_bootstrap.cc:492] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:26.153445 13404 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.167797 13404 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.170331 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:18:26.172108 13102 leader_election.cc:343] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.167979 13413 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.177173 13335 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:26.188527 13328 tablet_bootstrap.cc:492] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:26.189056 13328 ts_tablet_manager.cc:1403] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.160s	user 0.018s	sys 0.009s
I20260709 12:18:26.202291 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:26.203112 13210 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.207916 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:26.208715 13284 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.221393 13413 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:26.168906 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 73686.6us
I20260709 12:18:26.224133 13413 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.232897 13413 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.233911 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:26.232903 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:26.235455 13136 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.235941 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:26.237488 13177 leader_election.cc:343] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.239820 13328 raft_consensus.cc:359] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.240612 13328 raft_consensus.cc:385] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.240933 13328 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.241763 13328 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.253499 13328 ts_tablet_manager.cc:1434] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.002s
I20260709 12:18:26.254462 13328 tablet_bootstrap.cc:492] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:26.258545 13326 tablet_bootstrap.cc:654] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:26.252225 13175 leader_election.cc:343] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.261582 13175 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.262959 13450 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:26.269824 13210 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:26.266402 13136 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:26.273662 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:26.274091 13327 tablet_bootstrap.cc:654] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.273715 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.274555 13451 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:26.276294 13451 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:26.277176 13451 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.279552 13404 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:26.280073 13404 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:26.283258 13284 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:26.281874 13404 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:26.303960 13102 consensus_peers.cc:597] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.311704 13328 tablet_bootstrap.cc:654] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.317616 13326 tablet_bootstrap.cc:492] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:26.318895 13326 ts_tablet_manager.cc:1403] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.244s	user 0.005s	sys 0.050s
W20260709 12:18:26.320567 13252 consensus_peers.cc:597] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.321801 13326 raft_consensus.cc:359] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.322384 13327 tablet_bootstrap.cc:492] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:26.322526 13326 raft_consensus.cc:385] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.322889 13327 ts_tablet_manager.cc:1403] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.187s	user 0.011s	sys 0.007s
I20260709 12:18:26.322844 13326 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.323858 13326 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.326512 13326 ts_tablet_manager.cc:1434] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 12:18:26.326608 13400 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:26.327625 13326 tablet_bootstrap.cc:492] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:26.329397 13327 raft_consensus.cc:359] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.335016 13327 raft_consensus.cc:385] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:18:26.335139 13102 consensus_peers.cc:597] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.335525 13327 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.336575 13327 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.341100 13326 tablet_bootstrap.cc:654] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.343016 13327 ts_tablet_manager.cc:1434] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:18:26.344702 13327 tablet_bootstrap.cc:492] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:26.359071 13033 catalog_manager.cc:5697] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:26.359836 13034 catalog_manager.cc:5697] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:26.368670 13328 tablet_bootstrap.cc:492] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:26.369151 13328 ts_tablet_manager.cc:1403] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.002s
I20260709 12:18:26.369856 13326 tablet_bootstrap.cc:492] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:26.370348 13326 ts_tablet_manager.cc:1403] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.015s
I20260709 12:18:26.371505 13328 raft_consensus.cc:359] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.372181 13328 raft_consensus.cc:385] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.372442 13328 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.372928 13327 tablet_bootstrap.cc:654] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.373147 13328 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.373008 13326 raft_consensus.cc:359] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.374217 13326 raft_consensus.cc:385] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.374521 13326 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.375463 13326 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.377765 13326 ts_tablet_manager.cc:1434] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:26.378247 13328 ts_tablet_manager.cc:1434] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:18:26.378681 13326 tablet_bootstrap.cc:492] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:26.379145 13328 tablet_bootstrap.cc:492] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:26.386005 13328 tablet_bootstrap.cc:654] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.386016 13326 tablet_bootstrap.cc:654] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.393594 13328 tablet_bootstrap.cc:492] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:26.394029 13328 ts_tablet_manager.cc:1403] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:18:26.397416 13454 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.399029 13454 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.401684 13454 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:26.402962 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:26.403736 13136 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:26.404825 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:26.405328 13328 raft_consensus.cc:359] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.406210 13328 raft_consensus.cc:385] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.406539 13328 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.406729 13249 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:26.407698 13328 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:26.409298 13252 leader_election.cc:343] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.409814 13454 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:26.410220 13454 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.410535 13454 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.412375 13326 tablet_bootstrap.cc:492] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:26.412896 13326 ts_tablet_manager.cc:1403] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.003s
I20260709 12:18:26.418211 13451 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.418975 13451 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.422322 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:26.424417 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:26.426129 13175 leader_election.cc:343] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.427282 13328 ts_tablet_manager.cc:1434] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.004s
I20260709 12:18:26.416971 13326 raft_consensus.cc:359] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.428093 13326 raft_consensus.cc:385] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.428521 13326 raft_consensus.cc:740] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
W20260709 12:18:26.429458 13177 leader_election.cc:343] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.429584 13451 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.430022 13177 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.430785 13400 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:26.432998 13328 tablet_bootstrap.cc:492] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:26.432765 13326 consensus_queue.cc:260] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.436578 13326 ts_tablet_manager.cc:1434] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:18:26.437585 13326 tablet_bootstrap.cc:492] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:26.444180 13450 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.432035 13451 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:26.422329 13454 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.444983 13450 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.469616 13451 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.470142 13451 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.473169 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:26.474929 13454 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:18:26.502559 13175 leader_election.cc:343] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.503268 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:26.504460 13328 tablet_bootstrap.cc:654] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.505254 13326 tablet_bootstrap.cc:654] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:26.505031 13252 leader_election.cc:343] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.508605 13327 tablet_bootstrap.cc:492] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:26.509059 13327 ts_tablet_manager.cc:1403] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.165s	user 0.016s	sys 0.034s
I20260709 12:18:26.522783 13400 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.524881 13400 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.525295 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:26.526651 13177 leader_election.cc:343] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.527087 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.527474 13400 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.527990 13413 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:26.527870 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:26.529037 13135 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 1: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:18:26.523993 13327 raft_consensus.cc:359] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.530238 13327 raft_consensus.cc:385] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.528235 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:26.530543 13327 raft_consensus.cc:740] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.530705 13136 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.531243 13327 consensus_queue.cc:260] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.533352 13327 ts_tablet_manager.cc:1434] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:18:26.534287 13327 tablet_bootstrap.cc:492] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:26.535795 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:26.536217 13450 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.536450 13211 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:26.537823 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:26.517709 13451 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:18:26.540719 13102 leader_election.cc:343] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.541136 13136 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:26.544709 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:26.546203 13177 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.546506 13249 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:18:26.547282 13454 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:26.547516 13451 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.547827 13454 raft_consensus.cc:697] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:26.548851 13454 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.546203 13103 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.554839 13455 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.555365 13455 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.557976 13455 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:26.559715 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:26.560526 13212 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:26.561354 13403 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:26.562215 13404 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.562688 13404 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.563122 13327 tablet_bootstrap.cc:654] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.565016 13404 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.566596 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:26.568137 13102 leader_election.cc:343] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.568840 13400 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:26.569229 13400 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.569636 13400 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.572494 13032 catalog_manager.cc:5697] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:26.575951 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:26.576411 13451 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:26.577993 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:26.578624 13212 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:26.579275 13328 tablet_bootstrap.cc:492] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:26.580278 13249 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:26.581518 13454 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:26.582852 13454 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.585322 13328 ts_tablet_manager.cc:1403] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.152s	user 0.016s	sys 0.007s
I20260709 12:18:26.588271 13328 raft_consensus.cc:359] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.589871 13454 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:26.590768 13328 raft_consensus.cc:385] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.591465 13328 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.592224 13328 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.597234 13328 ts_tablet_manager.cc:1434] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:18:26.598166 13328 tablet_bootstrap.cc:492] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:26.598515 13327 tablet_bootstrap.cc:492] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:26.598932 13327 ts_tablet_manager.cc:1403] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.003s
I20260709 12:18:26.602042 13327 raft_consensus.cc:359] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.602677 13327 raft_consensus.cc:385] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.602941 13327 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.603075 13103 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.603631 13327 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.604138 13403 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:26.604619 13403 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.605001 13403 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.605612 13327 ts_tablet_manager.cc:1434] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:26.606509 13327 tablet_bootstrap.cc:492] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:26.612692 13403 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.616711 13328 tablet_bootstrap.cc:654] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.618223 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:26.618887 13211 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.624184 13327 tablet_bootstrap.cc:654] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.624473 13400 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.626629 13400 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.628228 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:18:26.629667 13102 leader_election.cc:343] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.631244 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:26.631848 13212 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.639447 13212 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:26.644615 13211 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:26.646152 13326 tablet_bootstrap.cc:492] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:26.646642 13326 ts_tablet_manager.cc:1403] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.209s	user 0.008s	sys 0.003s
I20260709 12:18:26.647830 13103 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.649058 13328 tablet_bootstrap.cc:492] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:26.649519 13328 ts_tablet_manager.cc:1403] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.010s
I20260709 12:18:26.652225 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:26.652829 13284 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.655292 13328 raft_consensus.cc:359] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.656051 13328 raft_consensus.cc:385] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.656343 13328 raft_consensus.cc:740] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.656755 13326 raft_consensus.cc:359] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.657483 13326 raft_consensus.cc:385] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.657353 13328 consensus_queue.cc:260] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.657789 13326 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.658591 13326 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.661278 13284 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:26.662581 13328 ts_tablet_manager.cc:1434] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:18:26.662531 13102 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:26.663349 13403 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.663625 13328 tablet_bootstrap.cc:492] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:26.664090 13404 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:26.664310 13454 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.664603 13404 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:26.664778 13454 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.665427 13404 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.667726 13454 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:26.670027 13335 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:26.670284 13328 tablet_bootstrap.cc:654] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.670521 13335 raft_consensus.cc:697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:26.670956 13326 ts_tablet_manager.cc:1434] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:18:26.671365 13335 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.671922 13326 tablet_bootstrap.cc:492] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:26.681649 13327 tablet_bootstrap.cc:492] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:26.682224 13327 ts_tablet_manager.cc:1403] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.000s
I20260709 12:18:26.682328 13326 tablet_bootstrap.cc:654] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.683523 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:18:26.689078 13252 leader_election.cc:343] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.689641 13328 tablet_bootstrap.cc:492] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:26.690111 13328 ts_tablet_manager.cc:1403] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.008s
I20260709 12:18:26.691578 13327 raft_consensus.cc:359] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.698925 13327 raft_consensus.cc:385] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.700702 13327 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.701501 13284 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.701614 13327 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.704030 13327 ts_tablet_manager.cc:1434] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:18:26.705024 13327 tablet_bootstrap.cc:492] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:26.694247 13326 tablet_bootstrap.cc:492] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:26.697482 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:18:26.700348 13083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:26.706842 13326 ts_tablet_manager.cc:1403] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.007s
W20260709 12:18:26.709276 13249 leader_election.cc:343] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.692972 13328 raft_consensus.cc:359] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.709839 13328 raft_consensus.cc:385] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.709758 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:26.710228 13328 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.710553 13358 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:26.711125 13328 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.711618 13335 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.713522 13335 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.709559 13326 raft_consensus.cc:359] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.714299 13326 raft_consensus.cc:385] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.714578 13326 raft_consensus.cc:740] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.715215 13326 consensus_queue.cc:260] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.716599 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:26.717197 13283 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:26.717578 13326 ts_tablet_manager.cc:1434] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 12:18:26.718278 13102 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:26.718849 13326 tablet_bootstrap.cc:492] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:26.719086 13389 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:26.719485 13389 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.719823 13389 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.720367 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:26.721037 13327 tablet_bootstrap.cc:654] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.720956 13211 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:26.724941 13326 tablet_bootstrap.cc:654] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.731040 13335 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.734303 13389 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.734509 13032 catalog_manager.cc:5697] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:26.736304 13403 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.736382 13404 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:26.736886 13403 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.736332 13032 catalog_manager.cc:5697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:26.738934 13403 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.737185 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:26.739670 13212 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.740348 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:26.740934 13210 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:26.742447 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:26.743258 13404 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:26.743678 13404 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.744017 13404 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.744747 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:26.746196 13102 leader_election.cc:343] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.738827 13328 ts_tablet_manager.cc:1434] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:18:26.747653 13328 tablet_bootstrap.cc:492] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:26.750566 13212 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:26.753108 13327 tablet_bootstrap.cc:492] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:26.753862 13327 ts_tablet_manager.cc:1403] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.000s
I20260709 12:18:26.756546 13326 tablet_bootstrap.cc:492] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:26.756981 13326 ts_tablet_manager.cc:1403] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 12:18:26.756639 13327 raft_consensus.cc:359] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.757346 13327 raft_consensus.cc:385] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.757623 13327 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.758275 13327 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.759268 13326 raft_consensus.cc:359] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.759974 13326 raft_consensus.cc:385] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.760723 13103 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:26.761871 13389 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.760257 13326 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.767940 13326 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.761973 13403 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:26.763494 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:26.775592 13403 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:26.775691 13283 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.776533 13403 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.776571 13326 ts_tablet_manager.cc:1434] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:18:26.778059 13326 tablet_bootstrap.cc:492] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:26.764976 13327 ts_tablet_manager.cc:1434] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:18:26.780968 13327 tablet_bootstrap.cc:492] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:26.780968 13328 tablet_bootstrap.cc:654] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.792316 13404 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.802191 13404 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.803334 13327 tablet_bootstrap.cc:654] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.809830 13326 tablet_bootstrap.cc:654] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:26.812736 13451 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.813242 13451 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.796043 13283 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:26.815585 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:26.815366 13451 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.823247 13211 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.823294 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:26.827153 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:26.828007 13135 raft_consensus.cc:2393] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 1: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:18:26.830634 13102 leader_election.cc:343] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:26.832834 13450 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:26.822932 13335 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:18:26.829249 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:26.883330 13211 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:26.893177 13485 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.903568 13327 tablet_bootstrap.cc:492] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:26.897434 13177 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.904183 13327 ts_tablet_manager.cc:1403] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.123s	user 0.025s	sys 0.009s
I20260709 12:18:26.904933 13451 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.900563 13450 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:18:26.910521 13327 raft_consensus.cc:359] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.911477 13327 raft_consensus.cc:385] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.911813 13327 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.912631 13327 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.915052 13327 ts_tablet_manager.cc:1434] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:18:26.916347 13327 tablet_bootstrap.cc:492] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:26.920148 13328 tablet_bootstrap.cc:492] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:26.920652 13328 ts_tablet_manager.cc:1403] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.173s	user 0.012s	sys 0.012s
I20260709 12:18:26.924701 13328 raft_consensus.cc:359] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.925657 13328 raft_consensus.cc:385] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.926033 13328 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.899118 13485 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.929857 13485 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.926926 13328 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.934046 13450 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.934641 13450 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.945482 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:26.951759 13328 ts_tablet_manager.cc:1434] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:18:26.955348 13328 tablet_bootstrap.cc:492] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:26.941931 13451 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:26.946420 13136 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:26.958860 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:26.959074 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:26.959546 13450 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.959609 13212 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:26.960186 13450 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:26.960515 13450 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.960878 13450 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.961150 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:26.961954 13285 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:26.967604 13035 catalog_manager.cc:5697] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:26.973228 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:26.974774 13103 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:26.975620 13389 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:26.976064 13389 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:26.976585 13403 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:26.977029 13403 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.976891 13389 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.977434 13403 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:26.980624 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:26.981420 13286 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:26.984627 13326 tablet_bootstrap.cc:492] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:26.985685 13326 ts_tablet_manager.cc:1403] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.004s
I20260709 12:18:26.977458 13450 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.988292 13403 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.988919 13326 raft_consensus.cc:359] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:26.989619 13326 raft_consensus.cc:385] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:26.989912 13326 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:26.990553 13403 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:26.991067 13358 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:26.990624 13326 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.003891 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:27.004662 13283 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.012759 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:27.013401 13135 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.015179 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:27.015911 13285 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.021847 13327 tablet_bootstrap.cc:654] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.023581 13135 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:27.025692 13455 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.026846 13283 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:27.031391 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:27.040086 13211 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.045327 13326 ts_tablet_manager.cc:1434] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.059s	user 0.014s	sys 0.013s
I20260709 12:18:27.046648 13326 tablet_bootstrap.cc:492] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:27.043943 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:27.047991 13451 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.048520 13451 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:27.050881 13328 tablet_bootstrap.cc:654] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.050575 13451 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.041586 13450 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.056067 13285 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:27.048504 13102 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:27.058336 13400 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.058933 13400 raft_consensus.cc:697] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:27.059935 13400 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:27.087177 13102 consensus_peers.cc:597] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:27.096248 13485 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.096768 13485 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.100752 13326 tablet_bootstrap.cc:654] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.104390 13485 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.106400 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:18:27.107932 13103 leader_election.cc:343] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.110042 13032 catalog_manager.cc:5697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.120823 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:27.131803 13102 leader_election.cc:343] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.132865 13102 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:27.134089 13400 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:27.139053 13327 tablet_bootstrap.cc:492] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:27.142218 13327 ts_tablet_manager.cc:1403] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.226s	user 0.009s	sys 0.005s
I20260709 12:18:27.144603 13211 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:27.151000 13328 tablet_bootstrap.cc:492] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:27.151638 13328 ts_tablet_manager.cc:1403] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.199s	user 0.032s	sys 0.028s
I20260709 12:18:27.151269 13327 raft_consensus.cc:359] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.152249 13327 raft_consensus.cc:385] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.152621 13327 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.153311 13327 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.155062 13033 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.157549 13328 raft_consensus.cc:359] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.158242 13328 raft_consensus.cc:385] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.158473 13328 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.163090 13328 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.163966 13326 tablet_bootstrap.cc:492] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:27.164443 13326 ts_tablet_manager.cc:1403] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.118s	user 0.018s	sys 0.002s
I20260709 12:18:27.166749 13328 ts_tablet_manager.cc:1434] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:18:27.167697 13328 tablet_bootstrap.cc:492] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:27.168296 13400 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.171869 13327 ts_tablet_manager.cc:1434] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:18:27.172835 13327 tablet_bootstrap.cc:492] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:27.179638 13326 raft_consensus.cc:359] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.180342 13326 raft_consensus.cc:385] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.180622 13326 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.187011 13326 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.189131 13326 ts_tablet_manager.cc:1434] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:18:27.190019 13326 tablet_bootstrap.cc:492] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:27.196902 13032 catalog_manager.cc:5697] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.205013 13328 tablet_bootstrap.cc:654] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.179349 13327 tablet_bootstrap.cc:654] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.211602 13400 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.212507 13326 tablet_bootstrap.cc:654] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.218027 13485 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.236727 13485 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.252969 13328 tablet_bootstrap.cc:492] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:27.253464 13328 ts_tablet_manager.cc:1403] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.001s
I20260709 12:18:27.256232 13328 raft_consensus.cc:359] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.256886 13328 raft_consensus.cc:385] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.257121 13328 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.257814 13328 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.260277 13328 ts_tablet_manager.cc:1434] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:27.261188 13328 tablet_bootstrap.cc:492] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:27.279112 13498 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.279750 13498 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.292620 13455 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.293293 13455 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.330734 13455 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:27.331626 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:27.333694 13498 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.333811 13451 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.334273 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:27.334370 13451 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.334759 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:27.338423 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:27.338634 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:27.339412 13451 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.339629 13455 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:27.340063 13175 leader_election.cc:343] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.340768 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:27.341358 13285 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:27.343348 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:27.344063 13135 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
W20260709 12:18:27.344936 13177 leader_election.cc:343] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.345383 13177 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:27.347833 13175 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:27.348651 13498 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.350172 13498 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.347393 13451 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:27.350586 13498 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.356163 13485 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.358642 13328 tablet_bootstrap.cc:654] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.368247 13326 tablet_bootstrap.cc:492] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:27.368701 13326 ts_tablet_manager.cc:1403] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.179s	user 0.026s	sys 0.032s
I20260709 12:18:27.377314 13327 tablet_bootstrap.cc:492] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:27.377740 13327 ts_tablet_manager.cc:1403] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.205s	user 0.025s	sys 0.031s
I20260709 12:18:27.380255 13326 raft_consensus.cc:359] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.380961 13326 raft_consensus.cc:385] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.379631 13498 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.381253 13326 raft_consensus.cc:740] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.382428 13326 consensus_queue.cc:260] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.385284 13326 ts_tablet_manager.cc:1434] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:18:27.386292 13326 tablet_bootstrap.cc:492] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:27.387508 13400 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.398665 13327 raft_consensus.cc:359] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.399410 13327 raft_consensus.cc:385] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.399760 13327 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.401450 13327 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.403681 13327 ts_tablet_manager.cc:1434] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:18:27.404865 13327 tablet_bootstrap.cc:492] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:27.405786 13498 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.405939 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:27.406538 13135 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.409071 13328 tablet_bootstrap.cc:492] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:27.409507 13328 ts_tablet_manager.cc:1403] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.149s	user 0.012s	sys 0.001s
I20260709 12:18:27.405982 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:27.411075 13285 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.413383 13328 raft_consensus.cc:359] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.414279 13328 raft_consensus.cc:385] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.414603 13328 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.419202 13285 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:27.420377 13177 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:27.421195 13451 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.421640 13451 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.418979 13328 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.426395 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:27.426630 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:27.423722 13451 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:18:27.427671 13177 leader_election.cc:343] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:27.430596 13102 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:27.431540 13175 leader_election.cc:343] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.430218 13326 tablet_bootstrap.cc:654] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.432125 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:27.434206 13498 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.436596 13498 raft_consensus.cc:697] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:27.436275 13451 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:27.437593 13498 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.435837 13135 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:27.451628 13328 ts_tablet_manager.cc:1434] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.002s
I20260709 12:18:27.452611 13328 tablet_bootstrap.cc:492] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:27.454346 13327 tablet_bootstrap.cc:654] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.458515 13328 tablet_bootstrap.cc:654] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.483448 13455 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.484158 13455 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.488747 13455 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:27.490052 13400 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:27.491590 13326 tablet_bootstrap.cc:492] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:27.492233 13326 ts_tablet_manager.cc:1403] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.004s
I20260709 12:18:27.494685 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:27.495344 13135 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:27.502657 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:27.504630 13455 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.504982 13455 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.505331 13455 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.508100 13326 raft_consensus.cc:359] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.508801 13326 raft_consensus.cc:385] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.509199 13326 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.509877 13326 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.512823 13403 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:27.518060 13032 catalog_manager.cc:5697] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:27.521862 13326 ts_tablet_manager.cc:1434] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:18:27.522809 13326 tablet_bootstrap.cc:492] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:27.528957 13326 tablet_bootstrap.cc:654] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.502218 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:27.536803 13211 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:27.541565 13400 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.544004 13498 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:27.542272 13400 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.550321 13400 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.551776 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:27.552255 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:18:27.554332 13102 leader_election.cc:343] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:27.555146 13103 leader_election.cc:343] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.555745 13103 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:27.558451 13400 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:27.572749 13501 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:27.576695 13455 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.584762 13326 tablet_bootstrap.cc:492] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:27.585218 13326 ts_tablet_manager.cc:1403] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.036s
I20260709 12:18:27.588084 13326 raft_consensus.cc:359] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.589264 13326 raft_consensus.cc:385] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.589629 13326 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.590456 13326 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.592759 13326 ts_tablet_manager.cc:1434] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:27.593817 13326 tablet_bootstrap.cc:492] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:27.599982 13326 tablet_bootstrap.cc:654] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.600487 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:27.601151 13136 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.601244 13327 tablet_bootstrap.cc:492] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:27.601841 13327 ts_tablet_manager.cc:1403] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.197s	user 0.026s	sys 0.034s
I20260709 12:18:27.608862 13327 raft_consensus.cc:359] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.609658 13327 raft_consensus.cc:385] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.609985 13327 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.610139 13136 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:27.610811 13327 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.611773 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:27.613361 13358 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:27.613968 13327 ts_tablet_manager.cc:1434] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:18:27.615013 13327 tablet_bootstrap.cc:492] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:27.614002 13358 raft_consensus.cc:697] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:27.618065 13455 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:27.617360 13328 tablet_bootstrap.cc:492] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:27.618738 13328 ts_tablet_manager.cc:1403] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.166s	user 0.020s	sys 0.041s
I20260709 12:18:27.618453 13358 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.626945 13327 tablet_bootstrap.cc:654] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.627310 13328 raft_consensus.cc:359] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.628278 13328 raft_consensus.cc:385] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.628597 13328 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.629395 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:27.630026 13211 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.631934 13328 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.636515 13328 ts_tablet_manager.cc:1434] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 12:18:27.637566 13328 tablet_bootstrap.cc:492] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:27.648978 13498 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.649677 13498 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.652375 13498 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.654457 13211 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:27.660384 13035 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:27.657258 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:27.668248 13177 leader_election.cc:343] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.669106 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:18:27.671279 13175 leader_election.cc:343] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.671785 13175 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:27.673357 13328 tablet_bootstrap.cc:654] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.673424 13501 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:27.675707 13326 tablet_bootstrap.cc:492] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:27.680999 13327 tablet_bootstrap.cc:492] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:27.684303 13327 ts_tablet_manager.cc:1403] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.004s
I20260709 12:18:27.683737 13326 ts_tablet_manager.cc:1403] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.090s	user 0.028s	sys 0.035s
I20260709 12:18:27.689379 13326 raft_consensus.cc:359] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.691149 13326 raft_consensus.cc:385] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.693887 13326 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.692943 13327 raft_consensus.cc:359] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.706727 13327 raft_consensus.cc:385] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.707113 13327 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.709168 13327 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.694818 13326 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.724354 13326 ts_tablet_manager.cc:1434] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:18:27.725378 13326 tablet_bootstrap.cc:492] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:27.729660 13285 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.731479 13326 tablet_bootstrap.cc:654] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.732527 13328 tablet_bootstrap.cc:492] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:27.733189 13328 ts_tablet_manager.cc:1403] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.019s
I20260709 12:18:27.736541 13328 raft_consensus.cc:359] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.737490 13328 raft_consensus.cc:385] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.737828 13328 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.732710 13327 ts_tablet_manager.cc:1434] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
I20260709 12:18:27.741629 13327 tablet_bootstrap.cc:492] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:27.752509 13327 tablet_bootstrap.cc:654] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.755754 13328 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.765079 13328 ts_tablet_manager.cc:1434] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:18:27.766084 13328 tablet_bootstrap.cc:492] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:27.773324 13328 tablet_bootstrap.cc:654] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.778414 13326 tablet_bootstrap.cc:492] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:27.778986 13326 ts_tablet_manager.cc:1403] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.011s
W20260709 12:18:27.782976 13083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:27.786748 13327 tablet_bootstrap.cc:492] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:27.787379 13327 ts_tablet_manager.cc:1403] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260709 12:18:27.790031 13327 raft_consensus.cc:359] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.790684 13327 raft_consensus.cc:385] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.790961 13327 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.791584 13327 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.793367 13327 ts_tablet_manager.cc:1434] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:27.793879 13326 raft_consensus.cc:359] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.794520 13326 raft_consensus.cc:385] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.794770 13326 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.795388 13326 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.797298 13326 ts_tablet_manager.cc:1434] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.002s
I20260709 12:18:27.798288 13327 tablet_bootstrap.cc:492] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:27.803464 13335 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.803941 13335 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.805405 13326 tablet_bootstrap.cc:492] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:27.805864 13335 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.808514 13328 tablet_bootstrap.cc:492] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:27.808951 13328 ts_tablet_manager.cc:1403] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.043s	user 0.003s	sys 0.006s
I20260709 12:18:27.809513 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:18:27.811321 13103 leader_election.cc:343] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.811885 13328 raft_consensus.cc:359] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.812544 13328 raft_consensus.cc:385] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.812827 13328 raft_consensus.cc:740] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.813473 13328 consensus_queue.cc:260] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.815402 13328 ts_tablet_manager.cc:1434] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:18:27.821287 13328 tablet_bootstrap.cc:492] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:27.823166 13283 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.827121 13327 tablet_bootstrap.cc:654] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.817759 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:27.828152 13285 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:27.828670 13485 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.829133 13485 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.829420 13102 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:18:27.830773 13403 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.831125 13403 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.831450 13403 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.831981 13485 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.834028 13328 tablet_bootstrap.cc:654] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.836213 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:27.834961 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:27.839618 13211 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
W20260709 12:18:27.842617 13102 leader_election.cc:343] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.842938 13501 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.843238 13103 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:27.843607 13501 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.846081 13501 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.846891 13403 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.847610 13485 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.848088 13485 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.848474 13485 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.854393 13501 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.854995 13501 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.860749 13403 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.914475 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:27.898121 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:27.899924 13455 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.899302 13328 tablet_bootstrap.cc:492] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:27.917740 13328 ts_tablet_manager.cc:1403] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.009s
I20260709 12:18:27.916163 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:27.917439 13455 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.918217 13284 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.820392 13326 tablet_bootstrap.cc:654] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.919309 13455 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:27.898963 13327 tablet_bootstrap.cc:492] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:27.920403 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:27.920753 13327 ts_tablet_manager.cc:1403] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.002s
W20260709 12:18:27.921859 13252 leader_election.cc:343] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.905098 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:27.927302 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:27.923112 13327 raft_consensus.cc:359] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.926707 13498 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:18:27.926420 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:27.924422 13103 leader_election.cc:343] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.932130 13327 raft_consensus.cc:385] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.932435 13327 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.933097 13327 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.934737 13327 ts_tablet_manager.cc:1434] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.001s
I20260709 12:18:27.935580 13327 tablet_bootstrap.cc:492] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
W20260709 12:18:27.926833 13177 leader_election.cc:343] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:27.936321 13175 leader_election.cc:343] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.901226 13501 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.907158 13485 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.938289 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:27.939908 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:27.940508 13210 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.943199 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:18:27.945001 13249 leader_election.cc:343] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.945480 13249 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:27.947610 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:27.948447 13328 raft_consensus.cc:359] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:27.948945 13102 leader_election.cc:343] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.949191 13328 raft_consensus.cc:385] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.949519 13328 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
W20260709 12:18:27.950251 13175 leader_election.cc:343] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.950214 13328 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.951604 13377 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:27.952596 13328 ts_tablet_manager.cc:1434] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 12:18:27.953594 13328 tablet_bootstrap.cc:492] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:27.955049 13327 tablet_bootstrap.cc:654] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.957958 13498 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:27.962479 13328 tablet_bootstrap.cc:654] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:27.962649 13283 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:27.965179 13326 tablet_bootstrap.cc:492] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:27.965682 13326 ts_tablet_manager.cc:1403] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.160s	user 0.012s	sys 0.004s
I20260709 12:18:27.970290 13177 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:18:27.971869 13498 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:27.972271 13498 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.972644 13498 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:27.978358 13492 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:27.981307 13335 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.981812 13335 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.983245 13327 tablet_bootstrap.cc:492] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:27.983836 13327 ts_tablet_manager.cc:1403] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.008s
I20260709 12:18:27.984169 13335 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:27.985455 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:27.987123 13102 leader_election.cc:343] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.969034 13326 raft_consensus.cc:359] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.988481 13326 raft_consensus.cc:385] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.988801 13326 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.990072 13327 raft_consensus.cc:359] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.992350 13327 raft_consensus.cc:385] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:27.993073 13327 raft_consensus.cc:740] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:27.990705 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:27.994580 13327 consensus_queue.cc:260] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:27.996830 13103 leader_election.cc:343] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:27.997284 13103 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:27.994964 13326 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:27.927167 13284 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:27.998051 13400 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:28.000337 13210 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:27.939402 13485 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.016466 13326 ts_tablet_manager.cc:1434] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 12:18:28.016486 13327 ts_tablet_manager.cc:1434] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 12:18:28.017359 13327 tablet_bootstrap.cc:492] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:28.017537 13326 tablet_bootstrap.cc:492] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:28.021823 13455 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.021806 13102 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:18:28.015810 13358 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:18:28.022423 13455 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.024467 13103 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:28.024569 13455 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:28.025420 13400 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:28.033327 13335 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:28.033859 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:28.034722 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:28.028105 13400 raft_consensus.cc:697] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:28.037273 13400 consensus_queue.cc:237] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.039966 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:28.041152 13455 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:28.048326 13327 tablet_bootstrap.cc:654] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.015750 13498 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.065326 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:28.065603 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:28.066254 13282 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:28.067272 13175 leader_election.cc:343] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:28.080986 13282 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:28.082305 13177 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:18:28.083204 13501 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:28.083716 13501 raft_consensus.cc:697] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:28.084530 13501 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.085760 13498 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.085891 13335 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:28.090961 13335 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.095218 13328 tablet_bootstrap.cc:492] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:28.097590 13328 ts_tablet_manager.cc:1403] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.144s	user 0.014s	sys 0.007s
I20260709 12:18:28.101711 13328 raft_consensus.cc:359] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.106600 13328 raft_consensus.cc:385] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.106986 13328 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.107880 13328 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.112919 13282 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.126595 13326 tablet_bootstrap.cc:654] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.130056 13328 ts_tablet_manager.cc:1434] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:18:28.134115 13328 tablet_bootstrap.cc:492] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:28.128310 13033 catalog_manager.cc:5697] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.143322 13455 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:28.144475 13327 tablet_bootstrap.cc:492] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:28.145221 13327 ts_tablet_manager.cc:1403] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.000s
I20260709 12:18:28.148332 13327 raft_consensus.cc:359] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.150635 13327 raft_consensus.cc:385] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.150960 13327 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.160600 13327 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.163038 13035 catalog_manager.cc:5697] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.164908 13035 catalog_manager.cc:5697] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.167112 13327 ts_tablet_manager.cc:1434] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 12:18:28.168437 13327 tablet_bootstrap.cc:492] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:28.169689 13328 tablet_bootstrap.cc:654] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.172083 13326 tablet_bootstrap.cc:492] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:28.172581 13326 ts_tablet_manager.cc:1403] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.155s	user 0.008s	sys 0.003s
I20260709 12:18:28.177174 13326 raft_consensus.cc:359] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.177944 13326 raft_consensus.cc:385] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.178256 13326 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.178994 13326 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.180943 13326 ts_tablet_manager.cc:1434] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:28.184620 13327 tablet_bootstrap.cc:654] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.189198 13326 tablet_bootstrap.cc:492] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:28.194339 13328 tablet_bootstrap.cc:492] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:28.194806 13328 ts_tablet_manager.cc:1403] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:18:28.197362 13328 raft_consensus.cc:359] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.197978 13328 raft_consensus.cc:385] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.198304 13328 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.198032 13326 tablet_bootstrap.cc:654] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.206455 13327 tablet_bootstrap.cc:492] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:28.207150 13327 ts_tablet_manager.cc:1403] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.002s
I20260709 12:18:28.203176 13328 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.215324 13328 ts_tablet_manager.cc:1434] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:18:28.216703 13328 tablet_bootstrap.cc:492] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:28.211133 13327 raft_consensus.cc:359] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.220252 13327 raft_consensus.cc:385] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.220654 13327 raft_consensus.cc:740] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.221602 13327 consensus_queue.cc:260] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.224673 13327 ts_tablet_manager.cc:1434] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:18:28.232264 13328 tablet_bootstrap.cc:654] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.233842 13326 tablet_bootstrap.cc:492] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:28.234309 13326 ts_tablet_manager.cc:1403] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.008s
I20260709 12:18:28.232327 13327 tablet_bootstrap.cc:492] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:28.236954 13326 raft_consensus.cc:359] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.237630 13326 raft_consensus.cc:385] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.237897 13326 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.238562 13326 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.243458 13326 ts_tablet_manager.cc:1434] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:18:28.244408 13326 tablet_bootstrap.cc:492] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:28.249378 13328 tablet_bootstrap.cc:492] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:28.249868 13335 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.253396 13335 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.252365 13327 tablet_bootstrap.cc:654] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.258735 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:28.259138 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:28.260982 13102 leader_election.cc:343] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:28.261723 13335 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.262589 13328 ts_tablet_manager.cc:1403] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.008s
I20260709 12:18:28.264209 13326 tablet_bootstrap.cc:654] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.259321 13211 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:28.266115 13103 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:28.266861 13335 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:28.267285 13335 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.267674 13335 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.268707 13328 raft_consensus.cc:359] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.269512 13328 raft_consensus.cc:385] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.269757 13328 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.270496 13328 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.277938 13328 ts_tablet_manager.cc:1434] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:18:28.278829 13328 tablet_bootstrap.cc:492] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:28.282050 13545 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.282598 13545 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.284472 13328 tablet_bootstrap.cc:654] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.285108 13545 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.287616 13326 tablet_bootstrap.cc:492] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:28.288050 13326 ts_tablet_manager.cc:1403] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.000s
I20260709 12:18:28.288012 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:28.290908 13326 raft_consensus.cc:359] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.291383 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:28.291719 13326 raft_consensus.cc:385] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.292106 13326 raft_consensus.cc:740] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.292371 13282 raft_consensus.cc:2393] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 1: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:18:28.292933 13326 consensus_queue.cc:260] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.293936 13102 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:28.295149 13326 ts_tablet_manager.cc:1434] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:18:28.295469 13400 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.296478 13326 tablet_bootstrap.cc:492] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:28.302897 13326 tablet_bootstrap.cc:654] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.303858 13400 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:28.312103 13335 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.314882 13327 tablet_bootstrap.cc:492] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:28.315407 13327 ts_tablet_manager.cc:1403] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.006s
I20260709 12:18:28.319785 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:28.320551 13211 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.327911 13327 raft_consensus.cc:359] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.329648 13327 raft_consensus.cc:385] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.329933 13327 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.330592 13327 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.332229 13327 ts_tablet_manager.cc:1434] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:18:28.333082 13327 tablet_bootstrap.cc:492] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:28.343521 13211 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:28.345148 13103 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:28.346858 13403 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:28.347329 13403 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:28.348214 13403 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.350636 13455 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.352829 13455 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.354946 13455 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:28.359449 13327 tablet_bootstrap.cc:654] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.360741 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:28.361483 13211 raft_consensus.cc:2393] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:28.360713 13335 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.365562 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:28.368705 13326 tablet_bootstrap.cc:492] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:28.368000 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:28.369738 13455 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.369179 13326 ts_tablet_manager.cc:1403] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.016s
I20260709 12:18:28.370101 13328 tablet_bootstrap.cc:492] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:28.370541 13328 ts_tablet_manager.cc:1403] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.092s	user 0.021s	sys 0.028s
I20260709 12:18:28.371363 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:28.376351 13326 raft_consensus.cc:359] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.377050 13328 raft_consensus.cc:359] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.377743 13328 raft_consensus.cc:385] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.378002 13328 raft_consensus.cc:740] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.378912 13328 consensus_queue.cc:260] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.377113 13326 raft_consensus.cc:385] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.379873 13326 raft_consensus.cc:740] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.380676 13326 consensus_queue.cc:260] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.381179 13328 ts_tablet_manager.cc:1434] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:18:28.382254 13032 catalog_manager.cc:5697] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.383312 13326 ts_tablet_manager.cc:1434] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:18:28.384249 13455 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:28.385166 13326 tablet_bootstrap.cc:492] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:28.387897 13485 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.388371 13485 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.390473 13485 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.394244 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:28.394843 13211 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:28.396423 13103 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:28.397845 13403 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:28.398310 13403 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.398698 13403 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.407634 13327 tablet_bootstrap.cc:492] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:28.408178 13327 ts_tablet_manager.cc:1403] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.004s
I20260709 12:18:28.408850 13326 tablet_bootstrap.cc:654] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.412806 13327 raft_consensus.cc:359] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.413538 13327 raft_consensus.cc:385] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.413872 13327 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.414551 13327 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.415943 13403 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.417408 13327 ts_tablet_manager.cc:1434] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:18:28.418216 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:28.418872 13284 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:28.421139 13327 tablet_bootstrap.cc:492] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:28.421244 13328 tablet_bootstrap.cc:492] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:28.429862 13403 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.430359 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:28.431011 13284 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.431576 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:28.432495 13211 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.434718 13327 tablet_bootstrap.cc:654] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.440960 13328 tablet_bootstrap.cc:654] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.445863 13326 tablet_bootstrap.cc:492] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:28.446383 13326 ts_tablet_manager.cc:1403] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.000s
I20260709 12:18:28.449120 13326 raft_consensus.cc:359] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.449829 13326 raft_consensus.cc:385] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.450120 13326 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.450812 13326 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.453328 13326 ts_tablet_manager.cc:1434] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:28.454368 13326 tablet_bootstrap.cc:492] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:28.454519 13211 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:28.456792 13103 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:28.457824 13403 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:28.458438 13403 raft_consensus.cc:697] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:28.459865 13403 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.466461 13492 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.467190 13492 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.471478 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:28.472306 13137 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:28.473980 13175 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:28.474946 13327 tablet_bootstrap.cc:492] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:28.475096 13498 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:28.475608 13327 ts_tablet_manager.cc:1403] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.011s
I20260709 12:18:28.475651 13498 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.476315 13498 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.476786 13284 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:28.479990 13326 tablet_bootstrap.cc:654] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.480376 13327 raft_consensus.cc:359] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.481148 13327 raft_consensus.cc:385] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.592847 13455 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.600248 13327 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.600783 13455 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.601094 13327 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.481035 13282 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:28.603259 13327 ts_tablet_manager.cc:1434] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.127s	user 0.028s	sys 0.030s
I20260709 12:18:28.518884 13284 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.604244 13327 tablet_bootstrap.cc:492] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:28.545039 13400 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 12:18:28.516983 13485 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.091s
I20260709 12:18:28.534334 13545 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.608649 13545 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.610939 13545 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.611757 13326 tablet_bootstrap.cc:492] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:28.613641 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:28.614359 13285 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:28.612378 13326 ts_tablet_manager.cc:1403] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.158s	user 0.009s	sys 0.003s
I20260709 12:18:28.497596 13498 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.618491 13455 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:28.624015 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:28.624819 13136 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.624867 13326 raft_consensus.cc:359] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.625448 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:28.625741 13326 raft_consensus.cc:385] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.626067 13326 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.626080 13212 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:28.626672 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:28.629644 13327 tablet_bootstrap.cc:654] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.626838 13326 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.619295 13492 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.635103 13211 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.644325 13103 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:28.653559 13400 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:28.654156 13400 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.654644 13400 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.655467 13328 tablet_bootstrap.cc:492] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:28.655994 13328 ts_tablet_manager.cc:1403] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.235s	user 0.020s	sys 0.021s
I20260709 12:18:28.658988 13498 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.658901 13328 raft_consensus.cc:359] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.663908 13328 raft_consensus.cc:385] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.664289 13328 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.664507 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:28.665295 13283 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:28.666752 13492 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.667455 13492 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.671000 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:28.671775 13283 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.672952 13501 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.673468 13501 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.681769 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:28.682490 13282 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:28.673409 13492 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.683890 13451 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:28.686120 13501 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.688983 13328 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.696791 13032 catalog_manager.cc:5697] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.711022 13328 ts_tablet_manager.cc:1434] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 12:18:28.693490 13485 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:18:28.703024 13498 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.721628 13498 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.724972 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:28.726480 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:28.727463 13400 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.728014 13569 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:28.728423 13569 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.728765 13569 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.728897 13498 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.730702 13328 tablet_bootstrap.cc:492] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:28.740003 13326 ts_tablet_manager.cc:1434] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.123s	user 0.024s	sys 0.001s
I20260709 12:18:28.741268 13326 tablet_bootstrap.cc:492] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
W20260709 12:18:28.761001 13177 leader_election.cc:343] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:28.758097 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 93824us
I20260709 12:18:28.765776 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:28.804764 13212 raft_consensus.cc:2393] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:18:28.807567 13377 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.808032 13377 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.801577 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:28.807081 13569 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.815690 13335 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.840904 13572 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.841601 13572 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.844519 13400 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.846524 13211 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:18:28.848820 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:28.849411 13208 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.861277 13400 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.861877 13400 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.845124 13335 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.892150 13400 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.895900 13400 consensus_queue.cc:1059] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:28.887640 13403 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.900667 13403 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.903362 13570 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.904464 13335 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.903910 13570 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.908149 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:28.893456 13377 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:28.909855 13400 raft_consensus.cc:3055] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:28.910173 13400 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:28.895076 13136 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:28.913161 13327 tablet_bootstrap.cc:492] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:28.913604 13498 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:28.913715 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:28.908793 13134 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:28.899648 13572 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.917353 13327 ts_tablet_manager.cc:1403] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.313s	user 0.020s	sys 0.027s
I20260709 12:18:28.917678 13326 tablet_bootstrap.cc:654] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.919910 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:28.920809 13400 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.922463 13400 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:28.911878 13283 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:28.931890 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:28.931998 13570 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.923458 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:28.928856 13177 leader_election.cc:343] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:28.924324 13135 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:28.928970 13403 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.939332 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:28.936249 13569 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:28.949419 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:28.949589 13175 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:28.950096 13212 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:28.950647 13175 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:28.946226 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:28.951738 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:28.952582 13211 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:28.955461 13103 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:28.957597 13400 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:28.958058 13400 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.958465 13400 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.961140 13103 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:28.955441 13137 raft_consensus.cc:2410] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:18:28.955596 13286 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.969413 13575 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:28.969863 13575 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.970243 13575 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.971109 13328 tablet_bootstrap.cc:654] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.959785 13498 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:28.959960 13570 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:28.974856 13400 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:28.966557 13133 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:29.019214 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:29.201408 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:29.030182 13286 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:28.975564 13570 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:29.034709 13580 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:18:29.171159 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:29.105254 13581 log.cc:927] Time spent T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.156s	user 0.004s	sys 0.000s
I20260709 12:18:28.977954 13498 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:29.073720 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:29.216022 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:29.206702 13400 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:29.030884 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:29.161330 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:18:29.022023 13177 leader_election.cc:343] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.049053 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:29.218714 13570 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.034539 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:29.037997 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:29.048710 13582 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.184s
I20260709 12:18:28.994423 13175 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:18:29.246486 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 227937us
W20260709 12:18:29.259619 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 221749us
I20260709 12:18:29.259727 13569 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.263705 13326 tablet_bootstrap.cc:492] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:29.264183 13326 ts_tablet_manager.cc:1403] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.523s	user 0.011s	sys 0.008s
W20260709 12:18:29.268914 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 276297us
I20260709 12:18:29.270881 13573 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.255606 13576 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:29.271548 13573 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.274932 13327 raft_consensus.cc:359] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.275889 13327 raft_consensus.cc:385] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.276275 13327 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.277058 13327 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.281997 13327 ts_tablet_manager.cc:1434] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.361s	user 0.006s	sys 0.001s
I20260709 12:18:29.282753 13327 tablet_bootstrap.cc:492] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:29.268333 13584 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:18:29.263722 13569 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.260286 13208 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:29.289520 13326 raft_consensus.cc:359] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.292510 13326 raft_consensus.cc:385] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.292894 13326 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.261000 13498 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.293684 13326 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.291884 13569 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.295769 13326 ts_tablet_manager.cc:1434] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 12:18:29.296710 13326 tablet_bootstrap.cc:492] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:29.297183 13573 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:29.305384 13569 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.312542 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:29.315996 13328 tablet_bootstrap.cc:492] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:29.316519 13328 ts_tablet_manager.cc:1403] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.586s	user 0.021s	sys 0.022s
I20260709 12:18:29.317271 13210 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 1: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:18:29.318310 13177 leader_election.cc:343] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.319087 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:29.311497 13575 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.322970 13575 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:29.324587 13572 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:29.325278 13569 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:29.331856 13175 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:29.332405 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:18:29.333070 13175 leader_election.cc:343] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.336189 13571 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.337090 13571 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.337431 13571 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.341149 13326 tablet_bootstrap.cc:654] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.335050 13570 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.344628 13327 tablet_bootstrap.cc:654] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.349615 13570 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:29.351804 13328 raft_consensus.cc:359] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.352519 13328 raft_consensus.cc:385] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.352905 13571 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:29.382818 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 60399.5us
W20260709 12:18:29.392915 13177 leader_election.cc:343] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.333520 13175 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:29.352854 13328 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
W20260709 12:18:29.406672 13083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:29.406903 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:29.409550 13569 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:29.408852 13328 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:29.420574 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 87411.5us
W20260709 12:18:29.422742 13177 leader_election.cc:343] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.432418 13328 ts_tablet_manager.cc:1434] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.116s	user 0.004s	sys 0.008s
I20260709 12:18:29.434625 13328 tablet_bootstrap.cc:492] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
W20260709 12:18:29.436813 13103 leader_election.cc:343] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.438185 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:29.439193 13103 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:29.440673 13400 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.441907 13400 raft_consensus.cc:697] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:29.443343 13400 consensus_queue.cc:237] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.443689 13335 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:29.445117 13326 tablet_bootstrap.cc:492] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:29.446107 13326 ts_tablet_manager.cc:1403] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.150s	user 0.012s	sys 0.004s
I20260709 12:18:29.440701 13576 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:29.450685 13326 raft_consensus.cc:359] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.451742 13326 raft_consensus.cc:385] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.452101 13326 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.453037 13326 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.459393 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:29.460249 13284 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.458700 13571 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:29.464360 13326 ts_tablet_manager.cc:1434] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 12:18:29.470381 13326 tablet_bootstrap.cc:492] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:29.475589 13328 tablet_bootstrap.cc:654] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.477188 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:18:29.480523 13249 leader_election.cc:343] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.494096 13327 tablet_bootstrap.cc:492] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:29.494904 13327 ts_tablet_manager.cc:1403] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.212s	user 0.010s	sys 0.004s
I20260709 12:18:29.498325 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:29.499554 13137 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:29.500490 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:29.501430 13210 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:29.502426 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:29.503340 13132 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:29.504845 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:29.505815 13207 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 1: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:18:29.511193 13034 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:29.515353 13102 leader_election.cc:343] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.512547 13032 catalog_manager.cc:5697] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.513657 13175 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:29.522639 13326 tablet_bootstrap.cc:654] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.522722 13498 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:18:29.525864 13102 leader_election.cc:343] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.526352 13102 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:29.526612 13545 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:29.528117 13485 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:29.522903 13327 raft_consensus.cc:359] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.530179 13327 raft_consensus.cc:385] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.530505 13327 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
W20260709 12:18:29.532291 13102 leader_election.cc:343] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.539819 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:29.531111 13327 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.548081 13284 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:29.548454 13175 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:29.549048 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:29.526357 13595 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:18:29.557583 13498 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:29.561662 13177 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:29.562767 13498 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.563474 13498 raft_consensus.cc:697] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:18:29.584499 13102 leader_election.cc:343] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.585114 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:29.591686 13498 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.623401 13595 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:18:29.648461 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 64019.8us
W20260709 12:18:29.653136 13102 leader_election.cc:343] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.653602 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:29.654362 13335 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:18:29.645386 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 97117.9us
I20260709 12:18:29.662871 13571 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.663582 13252 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:18:29.665441 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:29.666640 13135 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.664690 13571 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.675130 13571 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:29.675580 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:29.676491 13132 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:29.677639 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:29.679359 13175 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:18:29.680262 13177 leader_election.cc:343] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.681346 13571 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.681767 13571 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.682118 13571 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.683044 13576 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.683627 13576 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.684074 13576 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.687290 13327 ts_tablet_manager.cc:1434] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.192s	user 0.010s	sys 0.002s
I20260709 12:18:29.688862 13327 tablet_bootstrap.cc:492] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:29.720556 13326 tablet_bootstrap.cc:492] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:29.721186 13326 ts_tablet_manager.cc:1403] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.251s	user 0.025s	sys 0.036s
I20260709 12:18:29.728343 13328 tablet_bootstrap.cc:492] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:29.728816 13328 ts_tablet_manager.cc:1403] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.295s	user 0.022s	sys 0.012s
I20260709 12:18:29.721768 13135 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:29.744223 13326 raft_consensus.cc:359] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.744920 13326 raft_consensus.cc:385] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.745218 13326 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.749864 13328 raft_consensus.cc:359] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.753291 13328 raft_consensus.cc:385] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.753813 13328 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.755002 13328 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.762351 13326 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.765125 13326 ts_tablet_manager.cc:1434] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 12:18:29.766151 13327 tablet_bootstrap.cc:654] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.766683 13326 tablet_bootstrap.cc:492] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:29.773886 13576 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.778442 13571 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.785645 13576 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:29.785883 13590 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.786404 13590 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.797487 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:29.797993 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:29.798602 13135 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.798815 13590 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:29.803337 13328 ts_tablet_manager.cc:1434] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.002s
I20260709 12:18:29.809839 13328 tablet_bootstrap.cc:492] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:29.791044 13571 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:29.799795 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:29.841632 13327 tablet_bootstrap.cc:492] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:29.842245 13327 ts_tablet_manager.cc:1403] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.154s	user 0.011s	sys 0.004s
I20260709 12:18:29.842885 13328 tablet_bootstrap.cc:654] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.799850 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:29.845641 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:18:29.799367 13177 leader_election.cc:343] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.817458 13590 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:18:29.800608 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:18:29.855372 13249 leader_election.cc:343] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:29.858286 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 58954.2us
I20260709 12:18:29.847385 13210 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.871879 13576 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:29.872674 13175 leader_election.cc:343] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.872460 13576 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.805886 13135 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:29.874496 13175 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:29.874779 13576 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:29.869992 13327 raft_consensus.cc:359] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.876024 13327 raft_consensus.cc:385] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.876319 13327 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.878356 13326 tablet_bootstrap.cc:654] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.879536 13327 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.881562 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:29.881924 13593 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:29.883956 13177 leader_election.cc:343] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.885833 13593 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.883419 13571 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.888113 13571 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:29.888231 13209 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:18:29.892297 13571 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.893221 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:29.888901 13177 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:29.894582 13590 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:29.897394 13103 leader_election.cc:343] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.900537 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:29.903703 13102 leader_election.cc:343] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.904105 13327 ts_tablet_manager.cc:1434] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 12:18:29.890550 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:29.904117 13102 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:29.906476 13328 tablet_bootstrap.cc:492] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:29.906466 13400 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:29.904633 13498 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:29.907086 13328 ts_tablet_manager.cc:1403] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.098s	user 0.008s	sys 0.010s
I20260709 12:18:29.899341 13593 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:29.908414 13133 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:29.905768 13327 tablet_bootstrap.cc:492] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:29.909715 13328 raft_consensus.cc:359] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.910413 13328 raft_consensus.cc:385] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.906888 13210 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:29.910696 13328 raft_consensus.cc:740] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.911394 13328 consensus_queue.cc:260] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:29.913846 13328 ts_tablet_manager.cc:1434] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:18:29.914875 13328 tablet_bootstrap.cc:492] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:29.915763 13252 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:18:29.917456 13249 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:29.918483 13576 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.917477 13573 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.972671 13576 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:29.983043 13327 tablet_bootstrap.cc:654] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.983692 13573 raft_consensus.cc:697] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:29.988260 13573 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.000265 13326 tablet_bootstrap.cc:492] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:30.000897 13326 ts_tablet_manager.cc:1403] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.234s	user 0.024s	sys 0.002s
I20260709 12:18:30.003322 13328 tablet_bootstrap.cc:654] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.001528 13034 catalog_manager.cc:5697] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.005028 13034 catalog_manager.cc:5697] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.011780 13326 raft_consensus.cc:359] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.012625 13326 raft_consensus.cc:385] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.012928 13326 raft_consensus.cc:740] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.013628 13326 consensus_queue.cc:260] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.017620 13326 ts_tablet_manager.cc:1434] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:18:30.019418 13326 tablet_bootstrap.cc:492] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:30.028414 13326 tablet_bootstrap.cc:654] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.033327 13327 tablet_bootstrap.cc:492] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:30.033811 13327 ts_tablet_manager.cc:1403] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.005s
I20260709 12:18:30.038955 13032 catalog_manager.cc:5697] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:30.039899 13575 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:30.044579 13545 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:30.044915 13327 raft_consensus.cc:359] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.045689 13327 raft_consensus.cc:385] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.045997 13327 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.046696 13327 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.049137 13327 ts_tablet_manager.cc:1434] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:18:30.050196 13327 tablet_bootstrap.cc:492] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:30.051963 13328 tablet_bootstrap.cc:492] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:30.052423 13328 ts_tablet_manager.cc:1403] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.138s	user 0.017s	sys 0.001s
I20260709 12:18:30.058238 13328 raft_consensus.cc:359] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.059226 13328 raft_consensus.cc:385] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.059533 13328 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.060971 13328 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.063292 13328 ts_tablet_manager.cc:1434] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:18:30.064707 13328 tablet_bootstrap.cc:492] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:30.071022 13326 tablet_bootstrap.cc:492] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:30.071543 13326 ts_tablet_manager.cc:1403] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.001s
I20260709 12:18:30.073030 13593 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.073529 13593 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.074204 13326 raft_consensus.cc:359] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.074867 13326 raft_consensus.cc:385] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.075116 13326 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.075589 13593 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.075799 13326 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.077502 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:30.078963 13327 tablet_bootstrap.cc:654] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.082953 13326 ts_tablet_manager.cc:1434] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:18:30.084311 13326 tablet_bootstrap.cc:492] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:30.088513 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:30.095917 13208 raft_consensus.cc:2393] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 1: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:18:30.113754 13328 tablet_bootstrap.cc:654] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.114434 13103 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:30.115899 13593 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.116390 13593 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.122052 13575 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.145725 13326 tablet_bootstrap.cc:654] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.145493 13571 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:30.160454 13593 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.161288 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:30.162016 13208 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:30.162283 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:30.163313 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:30.164139 13593 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:18:30.164302 13102 leader_election.cc:343] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.164657 13593 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.165022 13593 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.166258 13575 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:30.168803 13327 tablet_bootstrap.cc:492] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:30.169377 13327 ts_tablet_manager.cc:1403] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.119s	user 0.033s	sys 0.023s
I20260709 12:18:30.176153 13327 raft_consensus.cc:359] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.176841 13327 raft_consensus.cc:385] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.177106 13327 raft_consensus.cc:740] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.177685 13327 consensus_queue.cc:260] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.178831 13571 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:30.180955 13327 ts_tablet_manager.cc:1434] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:18:30.181947 13327 tablet_bootstrap.cc:492] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:30.195945 13573 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.196540 13573 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.198635 13573 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:30.198905 13328 tablet_bootstrap.cc:492] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:30.199573 13328 ts_tablet_manager.cc:1403] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.135s	user 0.028s	sys 0.024s
I20260709 12:18:30.204067 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:30.204785 13133 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:30.207224 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:30.207893 13208 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:30.207824 13328 raft_consensus.cc:359] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.208642 13328 raft_consensus.cc:385] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.208923 13328 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.209213 13252 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:30.209560 13328 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.210376 13573 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:30.210779 13573 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.211187 13573 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.229991 13624 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.230602 13624 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.238449 13328 ts_tablet_manager.cc:1434] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.038s	user 0.013s	sys 0.015s
I20260709 12:18:30.239745 13328 tablet_bootstrap.cc:492] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:30.241900 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:30.242656 13208 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:30.244168 13252 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:30.245247 13622 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:30.245648 13622 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.246007 13622 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.249197 13328 tablet_bootstrap.cc:654] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.250965 13545 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.251550 13545 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.251561 13624 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:30.253667 13545 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.254309 13326 tablet_bootstrap.cc:492] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:30.254813 13326 ts_tablet_manager.cc:1403] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.171s	user 0.008s	sys 0.016s
I20260709 12:18:30.255302 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:30.256724 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:30.257370 13208 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:18:30.258773 13326 raft_consensus.cc:359] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.259717 13326 raft_consensus.cc:385] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.260069 13326 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.262235 13103 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:30.265413 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:30.266314 13327 tablet_bootstrap.cc:654] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.270663 13545 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:30.271121 13545 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.271528 13545 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:30.271944 13326 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.280881 13326 ts_tablet_manager.cc:1434] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.005s
W20260709 12:18:30.281903 13249 leader_election.cc:343] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.273458 13573 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.284461 13622 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.279266 13545 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.289047 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:30.291801 13573 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:30.292922 13326 tablet_bootstrap.cc:492] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:30.292919 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:30.293198 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:30.293987 13209 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:30.293977 13208 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.298650 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:30.242388 13593 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.299477 13133 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.300490 13545 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.304613 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:18:30.306069 13102 leader_election.cc:343] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.308404 13133 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:30.308894 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:30.309501 13210 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.304673 13209 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:18:30.311003 13208 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:30.312930 13328 tablet_bootstrap.cc:492] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:30.313920 13326 tablet_bootstrap.cc:654] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.313819 13252 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:30.313428 13328 ts_tablet_manager.cc:1403] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.017s
I20260709 12:18:30.316798 13624 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:30.317559 13624 raft_consensus.cc:697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:30.318571 13624 consensus_queue.cc:237] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.325968 13328 raft_consensus.cc:359] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.326910 13328 raft_consensus.cc:385] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.327236 13328 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.328182 13328 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.323289 13103 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:30.333910 13328 ts_tablet_manager.cc:1434] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:18:30.332994 13593 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.333683 13575 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:30.335091 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:30.336171 13328 tablet_bootstrap.cc:492] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:30.336994 13575 raft_consensus.cc:697] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:30.337920 13622 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:30.338418 13210 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
W20260709 12:18:30.342722 13249 leader_election.cc:343] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.343060 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:30.343724 13208 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.337926 13575 consensus_queue.cc:237] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.347364 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:30.348821 13582 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:30.349293 13582 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:30.349884 13326 tablet_bootstrap.cc:492] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:30.350373 13326 ts_tablet_manager.cc:1403] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.010s
I20260709 12:18:30.350064 13582 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.356081 13327 tablet_bootstrap.cc:492] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:30.356647 13327 ts_tablet_manager.cc:1403] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.175s	user 0.015s	sys 0.006s
I20260709 12:18:30.359584 13032 catalog_manager.cc:5697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:30.361585 13622 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:18:30.362089 13622 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.364194 13571 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:30.365303 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:30.366040 13209 raft_consensus.cc:2368] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3.
I20260709 12:18:30.369225 13252 leader_election.cc:400] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3.
I20260709 12:18:30.369065 13327 raft_consensus.cc:359] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.369711 13252 leader_election.cc:403] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:30.369961 13327 raft_consensus.cc:385] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.370663 13498 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.370836 13624 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:30.371131 13498 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.371742 13328 tablet_bootstrap.cc:654] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.370247 13327 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.374194 13326 raft_consensus.cc:359] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.374756 13498 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.372637 13327 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.374888 13326 raft_consensus.cc:385] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.376899 13326 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.383545 13327 ts_tablet_manager.cc:1434] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:18:30.383332 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:30.384485 13327 tablet_bootstrap.cc:492] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:30.376085 13622 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:30.391923 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:30.393792 13624 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3.
I20260709 12:18:30.401508 13326 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:30.402729 13177 leader_election.cc:343] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.412288 13326 ts_tablet_manager.cc:1434] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 12:18:30.382795 13208 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:30.407173 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:18:30.416574 13175 leader_election.cc:343] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.417021 13175 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:30.418337 13571 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:30.420195 13326 tablet_bootstrap.cc:492] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:30.427883 13571 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.428398 13571 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.430680 13571 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.432399 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:30.433104 13286 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:30.434055 13175 leader_election.cc:343] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.438917 13032 catalog_manager.cc:5697] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.455359 13252 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:18:30.456615 13622 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:30.457490 13328 tablet_bootstrap.cc:492] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:30.457280 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:30.457914 13328 ts_tablet_manager.cc:1403] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.012s
I20260709 12:18:30.457818 13622 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:30.467404 13327 tablet_bootstrap.cc:654] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:30.465138 13177 leader_election.cc:343] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.469677 13177 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:30.470513 13571 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:30.470630 13624 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.471108 13624 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.471869 13590 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:30.473259 13624 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:30.474792 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:30.475621 13132 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:30.475958 13622 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.476898 13590 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.477373 13590 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.480587 13590 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.480813 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:30.481369 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:30.481763 13208 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:18:30.482056 13132 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:30.482352 13326 tablet_bootstrap.cc:654] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.484485 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:30.485399 13590 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:30.483170 13252 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:30.485759 13590 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.486109 13590 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.497547 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:30.509436 13590 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.508989 13032 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.513526 13328 raft_consensus.cc:359] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.514241 13328 raft_consensus.cc:385] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.514501 13328 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
W20260709 12:18:30.516057 13177 leader_election.cc:343] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.502692 13622 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.516108 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:30.515141 13328 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.524571 13590 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.527405 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:18:30.528834 13177 leader_election.cc:343] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.525393 13135 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.533418 13622 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:30.542146 13328 ts_tablet_manager.cc:1434] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.084s	user 0.004s	sys 0.004s
I20260709 12:18:30.544368 13034 catalog_manager.cc:5697] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:30.545480 13624 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
W20260709 12:18:30.565327 13644 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:18:30.567467 13328 tablet_bootstrap.cc:492] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
W20260709 12:18:30.582398 13083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:30.584053 13135 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:30.588536 13327 tablet_bootstrap.cc:492] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:30.589128 13327 ts_tablet_manager.cc:1403] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.205s	user 0.037s	sys 0.026s
I20260709 12:18:30.568001 13622 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:18:30.592010 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:30.598241 13571 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:30.599032 13571 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:30.599931 13571 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.604352 13327 raft_consensus.cc:359] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.605087 13327 raft_consensus.cc:385] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.605373 13327 raft_consensus.cc:740] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.605988 13327 consensus_queue.cc:260] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.614442 13328 tablet_bootstrap.cc:654] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.619113 13327 ts_tablet_manager.cc:1434] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.004s
I20260709 12:18:30.620671 13327 tablet_bootstrap.cc:492] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:30.626528 13327 tablet_bootstrap.cc:654] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.631775 13328 tablet_bootstrap.cc:492] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:30.632407 13328 ts_tablet_manager.cc:1403] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.001s
I20260709 12:18:30.635177 13328 raft_consensus.cc:359] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.635910 13328 raft_consensus.cc:385] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.636427 13328 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.636312 13032 catalog_manager.cc:5697] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.637197 13328 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.637842 13326 tablet_bootstrap.cc:492] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:30.638275 13326 ts_tablet_manager.cc:1403] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.218s	user 0.012s	sys 0.017s
I20260709 12:18:30.640889 13326 raft_consensus.cc:359] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.641399 13327 tablet_bootstrap.cc:492] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:30.641538 13326 raft_consensus.cc:385] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.641839 13327 ts_tablet_manager.cc:1403] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 12:18:30.639323 13328 ts_tablet_manager.cc:1434] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:30.646533 13328 tablet_bootstrap.cc:492] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:30.653313 13328 tablet_bootstrap.cc:654] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.644886 13327 raft_consensus.cc:359] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.656265 13327 raft_consensus.cc:385] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.656584 13327 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.641816 13326 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.657922 13326 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.660233 13326 ts_tablet_manager.cc:1434] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:18:30.661404 13326 tablet_bootstrap.cc:492] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:30.663693 13327 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.665207 13327 ts_tablet_manager.cc:1434] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:18:30.673981 13582 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.674512 13582 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.676689 13582 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.678236 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:30.678566 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:30.679697 13102 leader_election.cc:343] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:30.680300 13103 leader_election.cc:343] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.680668 13103 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:30.681602 13595 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:30.685603 13327 tablet_bootstrap.cc:492] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:30.695478 13571 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.695988 13571 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.696897 13328 tablet_bootstrap.cc:492] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:30.697345 13328 ts_tablet_manager.cc:1403] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.003s
I20260709 12:18:30.698009 13571 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.700662 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:30.701429 13135 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:30.702576 13175 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:30.703488 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:30.704116 13277 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:30.704205 13328 raft_consensus.cc:359] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.704887 13328 raft_consensus.cc:385] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.704833 13571 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:30.705359 13328 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.705458 13571 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.706138 13571 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.706055 13328 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.707144 13326 tablet_bootstrap.cc:654] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.711246 13328 ts_tablet_manager.cc:1434] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:18:30.711977 13327 tablet_bootstrap.cc:654] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.716670 13328 tablet_bootstrap.cc:492] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:30.723240 13328 tablet_bootstrap.cc:654] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.725277 13326 tablet_bootstrap.cc:492] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:30.725767 13326 ts_tablet_manager.cc:1403] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.000s
I20260709 12:18:30.726696 13571 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.728511 13326 raft_consensus.cc:359] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.729187 13326 raft_consensus.cc:385] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.729460 13326 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.729487 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:30.730134 13132 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.737097 13132 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:30.738310 13175 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:30.739295 13646 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:30.739687 13571 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.739846 13646 raft_consensus.cc:697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:30.730141 13326 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.741044 13646 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.742527 13326 ts_tablet_manager.cc:1434] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:18:30.743980 13326 tablet_bootstrap.cc:492] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:30.746327 13327 tablet_bootstrap.cc:492] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:30.746824 13327 ts_tablet_manager.cc:1403] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.001s
I20260709 12:18:30.749686 13327 raft_consensus.cc:359] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.750393 13327 raft_consensus.cc:385] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.750674 13327 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.751402 13327 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.760970 13327 ts_tablet_manager.cc:1434] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:18:30.758627 13326 tablet_bootstrap.cc:654] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.773716 13326 tablet_bootstrap.cc:492] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:30.774266 13326 ts_tablet_manager.cc:1403] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.004s
I20260709 12:18:30.777117 13326 raft_consensus.cc:359] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.777827 13326 raft_consensus.cc:385] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.778116 13326 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.779014 13326 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.784415 13326 ts_tablet_manager.cc:1434] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:18:30.786844 13326 tablet_bootstrap.cc:492] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:30.794361 13326 tablet_bootstrap.cc:654] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.806259 13595 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.806958 13595 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.809625 13595 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.812520 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:30.813021 13326 tablet_bootstrap.cc:492] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:30.813400 13209 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:30.813663 13326 ts_tablet_manager.cc:1403] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 12:18:30.816609 13326 raft_consensus.cc:359] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.817294 13326 raft_consensus.cc:385] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.819525 13573 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:30.820515 13286 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:30.821808 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:30.817595 13326 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.823474 13326 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.824584 13400 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:30.826308 13326 ts_tablet_manager.cc:1434] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:18:30.827340 13326 tablet_bootstrap.cc:492] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:30.828202 13624 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:30.833477 13326 tablet_bootstrap.cc:654] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.847635 13326 tablet_bootstrap.cc:492] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:30.848186 13326 ts_tablet_manager.cc:1403] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:18:30.768405 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:30.849582 13277 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.851403 13326 raft_consensus.cc:359] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.852231 13326 raft_consensus.cc:385] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.852536 13326 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.853459 13326 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.856122 13326 ts_tablet_manager.cc:1434] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:30.857249 13326 tablet_bootstrap.cc:492] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:30.862560 13208 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:30.864567 13326 tablet_bootstrap.cc:654] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.874040 13280 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.876775 13326 tablet_bootstrap.cc:492] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:30.877321 13326 ts_tablet_manager.cc:1403] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:18:30.880390 13326 raft_consensus.cc:359] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.881130 13326 raft_consensus.cc:385] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.881441 13326 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.882916 13326 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.885650 13326 ts_tablet_manager.cc:1434] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:18:30.886864 13326 tablet_bootstrap.cc:492] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
W20260709 12:18:30.892375 13102 leader_election.cc:343] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.893868 13326 tablet_bootstrap.cc:654] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.903931 13035 catalog_manager.cc:5697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.910283 13646 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.910795 13646 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.913611 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:30.914252 13132 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:30.915413 13326 tablet_bootstrap.cc:492] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:30.916002 13326 ts_tablet_manager.cc:1403] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.011s
I20260709 12:18:30.916208 13175 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:30.917392 13571 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:30.917877 13571 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.918352 13571 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.919665 13326 raft_consensus.cc:359] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.920449 13326 raft_consensus.cc:385] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:30.920763 13326 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.921495 13326 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.924751 13326 ts_tablet_manager.cc:1434] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:18:30.924899 13590 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.925904 13326 tablet_bootstrap.cc:492] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:30.925566 13590 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.928133 13498 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.928766 13498 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.931411 13498 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.939664 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:30.942066 13103 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:30.944715 13400 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:30.945047 13400 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.945313 13400 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:30.947583 13582 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:30.949885 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:30.950789 13327 tablet_bootstrap.cc:492] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:30.952385 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:30.953012 13133 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:30.957782 13327 tablet_bootstrap.cc:654] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.960212 13596 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.960879 13596 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:30.933146 13326 tablet_bootstrap.cc:654] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:30.935417 13590 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.969681 13596 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:18:30.973541 13177 leader_election.cc:343] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.974993 13646 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:30.975497 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:30.976625 13590 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.977162 13590 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:30.983829 13175 leader_election.cc:343] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.984828 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:30.999308 13498 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:30.999764 13498 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.000209 13498 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.005446 13326 tablet_bootstrap.cc:492] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:31.005999 13326 ts_tablet_manager.cc:1403] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.003s
I20260709 12:18:31.009627 13590 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.011510 13624 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.012091 13624 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.012804 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:31.014853 13624 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:18:31.018502 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 75195.7us
I20260709 12:18:31.021181 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:31.022030 13132 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:31.021906 13582 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:31.034898 13277 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:31.042621 13328 tablet_bootstrap.cc:492] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:31.043085 13328 ts_tablet_manager.cc:1403] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.327s	user 0.108s	sys 0.148s
I20260709 12:18:31.043727 13326 raft_consensus.cc:359] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.044584 13326 raft_consensus.cc:385] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.044946 13326 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:30.989624 13571 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.045720 13326 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.046015 13328 raft_consensus.cc:359] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.046695 13328 raft_consensus.cc:385] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.046967 13328 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.047632 13328 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.048275 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:18:30.997107 13177 leader_election.cc:343] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:30.998181 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:31.049806 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 52766.5us
I20260709 12:18:30.997618 13327 tablet_bootstrap.cc:492] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:31.050907 13327 ts_tablet_manager.cc:1403] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.001s
I20260709 12:18:31.053808 13327 raft_consensus.cc:359] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.054546 13327 raft_consensus.cc:385] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.054841 13328 ts_tablet_manager.cc:1434] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:18:31.055820 13328 tablet_bootstrap.cc:492] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:31.055974 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:31.056736 13278 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:31.054867 13327 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.058621 13327 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.060233 13327 ts_tablet_manager.cc:1434] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:18:31.061121 13327 tablet_bootstrap.cc:492] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:31.064028 13624 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.064546 13624 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.066936 13624 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:31.067116 13327 tablet_bootstrap.cc:654] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.069469 13670 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:31.072988 13328 tablet_bootstrap.cc:654] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.079589 13595 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.080968 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:31.084029 13327 tablet_bootstrap.cc:492] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:31.084498 13327 ts_tablet_manager.cc:1403] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.001s
I20260709 12:18:31.084365 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:31.084954 13133 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.088778 13328 tablet_bootstrap.cc:492] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:31.089249 13328 ts_tablet_manager.cc:1403] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.007s
I20260709 12:18:31.091934 13328 raft_consensus.cc:359] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.092572 13328 raft_consensus.cc:385] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:18:31.092607 13249 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:31.092922 13328 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.093612 13328 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.096129 13590 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.096602 13590 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.096849 13327 raft_consensus.cc:359] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.097465 13327 raft_consensus.cc:385] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.097733 13327 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.097842 13326 ts_tablet_manager.cc:1434] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.092s	user 0.009s	sys 0.001s
I20260709 12:18:31.098459 13327 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.103024 13327 ts_tablet_manager.cc:1434] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:18:31.104035 13327 tablet_bootstrap.cc:492] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:31.109445 13675 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.099121 13590 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.109962 13675 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.099102 13326 tablet_bootstrap.cc:492] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:31.112193 13675 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.114786 13327 tablet_bootstrap.cc:654] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:31.115814 13177 leader_election.cc:343] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.116878 13177 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:31.117785 13675 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.118330 13675 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.118831 13675 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.120739 13326 tablet_bootstrap.cc:654] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.127930 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:31.129148 13327 tablet_bootstrap.cc:492] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:31.129591 13327 ts_tablet_manager.cc:1403] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.026s	user 0.001s	sys 0.013s
I20260709 12:18:31.130628 13400 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.132601 13400 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.133592 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:31.134023 13571 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.134354 13208 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.133500 13327 raft_consensus.cc:359] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.135831 13327 raft_consensus.cc:385] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.136107 13327 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
W20260709 12:18:31.136309 13175 leader_election.cc:343] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.136766 13327 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.080227 13595 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.133277 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:31.138499 13327 ts_tablet_manager.cc:1434] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:18:31.154031 13327 tablet_bootstrap.cc:492] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
W20260709 12:18:31.154088 13177 leader_election.cc:343] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.154639 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:31.154987 13177 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:31.155292 13277 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:31.156397 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:31.159354 13646 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.159878 13646 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.161746 13646 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.161830 13327 tablet_bootstrap.cc:654] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.162727 13646 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:31.136859 13175 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:31.163949 13675 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.165020 13590 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:31.165217 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:31.165932 13284 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:31.166451 13675 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.167990 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:31.168617 13280 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:31.169462 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:31.142109 13208 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:31.170074 13207 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:31.143246 13595 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.171589 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:31.174312 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:31.174921 13135 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:31.175309 13103 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:31.175681 13280 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.144029 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:31.176609 13209 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:31.179849 13670 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.148798 13328 ts_tablet_manager.cc:1434] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:18:31.181455 13328 tablet_bootstrap.cc:492] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:31.152729 13326 tablet_bootstrap.cc:492] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:31.182894 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:31.183068 13326 ts_tablet_manager.cc:1403] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.004s
I20260709 12:18:31.183763 13400 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.184177 13400 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.184523 13400 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:31.150019 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54112.1us
W20260709 12:18:31.151603 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 82427.9us
I20260709 12:18:31.149271 13252 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:18:31.194257 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 45094.8us
I20260709 12:18:31.197052 13400 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.181742 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:31.182603 13670 raft_consensus.cc:697] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:31.139307 13133 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:31.216096 13400 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.196727 13622 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:31.145736 13498 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.222919 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:31.247241 13669 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.247833 13669 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.248246 13669 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:31.251016 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54904.1us
W20260709 12:18:31.251722 13249 leader_election.cc:343] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.253121 13328 tablet_bootstrap.cc:654] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.255730 13400 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.256211 13400 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.205363 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:31.259418 13252 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:18:31.270038 13327 tablet_bootstrap.cc:492] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:31.270705 13327 ts_tablet_manager.cc:1403] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.117s	user 0.028s	sys 0.033s
I20260709 12:18:31.274538 13498 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.258441 13590 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:18:31.271303 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:31.283385 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:31.285477 13498 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.299854 13282 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.329695 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:31.304939 13595 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.309504 13498 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.275118 13670 consensus_queue.cc:237] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:31.306675 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 109593us
I20260709 12:18:31.306403 13133 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.347994 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:31.348169 13327 raft_consensus.cc:359] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.348886 13327 raft_consensus.cc:385] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.343392 13498 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.349146 13327 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.352048 13327 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:31.352995 13102 leader_election.cc:343] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.345116 13130 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:31.343961 13595 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:31.344420 13177 leader_election.cc:343] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.366815 13326 raft_consensus.cc:359] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.367744 13326 raft_consensus.cc:385] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.368086 13326 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.378603 13326 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.381448 13280 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:31.369884 13683 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.064s
I20260709 12:18:31.383623 13328 tablet_bootstrap.cc:492] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:31.385780 13328 ts_tablet_manager.cc:1403] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.205s	user 0.008s	sys 0.018s
I20260709 12:18:31.401024 13400 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.401482 13328 raft_consensus.cc:359] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.402185 13328 raft_consensus.cc:385] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.402438 13328 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.405480 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:31.406172 13280 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:31.409380 13328 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.382936 13684 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.409175 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:31.445470 13400 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:31.445997 13400 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.446322 13400 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.446427 13326 ts_tablet_manager.cc:1434] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.263s	user 0.011s	sys 0.002s
I20260709 12:18:31.455792 13326 tablet_bootstrap.cc:492] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:31.457525 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:31.458254 13136 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.461079 13328 ts_tablet_manager.cc:1434] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.002s
I20260709 12:18:31.463223 13327 ts_tablet_manager.cc:1434] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.192s	user 0.015s	sys 0.012s
I20260709 12:18:31.394341 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:31.460384 13684 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.460208 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:31.477074 13596 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:31.480770 13596 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.481353 13596 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.488390 13498 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.484164 13207 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:31.491088 13498 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.496430 13400 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.494539 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:31.499111 13327 tablet_bootstrap.cc:492] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:31.502590 13400 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.472627 13684 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:31.508492 13175 leader_election.cc:343] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:31.474177 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 89715.2us
I20260709 12:18:31.518561 13175 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:31.507799 13590 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.520367 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:31.520781 13590 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.521347 13135 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.530524 13675 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.530268 13687 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:31.581487 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 63072us
I20260709 12:18:31.600484 13688 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.600675 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:31.591800 13675 raft_consensus.cc:697] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:31.578154 13282 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:31.601070 13688 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.533269 13177 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:18:31.616195 13083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:31.617116 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:31.537405 13596 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.615981 13590 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.622279 13212 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.613250 13136 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:31.618971 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:31.590991 13687 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.536577 13669 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:31.626076 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 92902us
I20260709 12:18:31.632623 13646 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.618000 13675 consensus_queue.cc:237] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.647614 13210 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 1: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:18:31.647614 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:31.648624 13646 raft_consensus.cc:697] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:31.655177 13328 tablet_bootstrap.cc:492] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:31.656940 13209 raft_consensus.cc:2393] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 1: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:18:31.658361 13688 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.664634 13595 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.670743 13281 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.671303 13326 tablet_bootstrap.cc:654] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.677992 13687 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.678732 13596 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.679646 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:31.680485 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:31.660279 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:31.687106 13669 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.691701 13646 consensus_queue.cc:237] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.692515 13135 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:31.674901 13684 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.712502 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:31.713137 13286 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.713527 13280 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 1: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:18:31.720866 13177 leader_election.cc:343] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.721580 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:31.722366 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:31.722744 13133 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:31.724087 13327 tablet_bootstrap.cc:654] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:31.721571 13177 leader_election.cc:343] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.728799 13212 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:18:31.729660 13684 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:31.730294 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:31.739092 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:31.748027 13102 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:31.748754 13277 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:31.750988 13593 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.751703 13593 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:31.752514 13593 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.744287 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:18:31.757912 13102 leader_election.cc:343] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.743796 13286 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:18:31.763943 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:18:31.773202 13175 leader_election.cc:343] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.773726 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:31.774849 13328 tablet_bootstrap.cc:654] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:31.775665 13129 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.777920 13669 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:31.776109 13212 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:18:31.770512 13284 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.782877 13175 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:31.785234 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:31.785892 13133 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:31.789364 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:31.789038 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:31.788808 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:31.790977 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:31.794806 13675 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.795140 13596 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:31.795055 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:31.795367 13675 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:31.795750 13596 raft_consensus.cc:697] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:31.795974 13137 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:18:31.796425 13675 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.796648 13596 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:31.782912 13177 leader_election.cc:343] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.784104 13700 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:31.812000 13175 leader_election.cc:343] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:31.814659 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:31.815337 13207 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:31.826499 13284 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:31.827841 13698 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:31.828591 13698 raft_consensus.cc:697] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:31.830487 13326 tablet_bootstrap.cc:492] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:31.831068 13326 ts_tablet_manager.cc:1403] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.376s	user 0.021s	sys 0.018s
I20260709 12:18:31.829592 13698 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.856716 13700 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:18:31.878465 13326 raft_consensus.cc:359] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.879491 13326 raft_consensus.cc:385] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:31.879853 13326 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:31.882898 13326 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.866057 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:31.903968 13103 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:31.906443 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:31.907622 13624 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.909637 13326 ts_tablet_manager.cc:1434] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 12:18:31.909330 13624 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.915545 13595 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:31.908516 13675 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:31.916450 13675 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:31.919667 13646 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:31.924404 13624 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:31.928646 13400 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:31.929004 13400 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.929283 13400 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:31.934739 13675 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.936729 13133 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:31.937268 13326 tablet_bootstrap.cc:492] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:31.944532 13328 tablet_bootstrap.cc:492] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:31.948212 13328 ts_tablet_manager.cc:1403] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.293s	user 0.042s	sys 0.025s
I20260709 12:18:31.951674 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:18:31.952553 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 158107us
I20260709 12:18:31.953492 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:31.956466 13400 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:31.961789 13400 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:31.972015 13033 catalog_manager.cc:5697] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:31.958494 13498 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:31.961787 13699 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:18:32.087469 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 127781us
I20260709 12:18:31.978889 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:32.089761 13328 raft_consensus.cc:359] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.090469 13328 raft_consensus.cc:385] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:32.090735 13328 raft_consensus.cc:740] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:32.091778 13328 consensus_queue.cc:260] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.095521 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:32.097029 13252 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:32.098110 13326 tablet_bootstrap.cc:654] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:32.098889 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:32.100240 13286 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:32.101316 13328 ts_tablet_manager.cc:1434] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.153s	user 0.011s	sys 0.012s
I20260709 12:18:32.102284 13328 tablet_bootstrap.cc:492] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
W20260709 12:18:32.114725 13102 leader_election.cc:343] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:32.108103 13210 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:32.108016 13622 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:32.123977 13720 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.110656 13698 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:18:32.139050 13328 tablet_bootstrap.cc:654] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:32.133252 13595 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:18:32.157209 13327 tablet_bootstrap.cc:492] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:32.157804 13571 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.163511 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:32.135960 13720 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.166289 13327 ts_tablet_manager.cc:1403] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.667s	user 0.021s	sys 0.011s
I20260709 12:18:32.168304 13720 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:32.170697 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:32.174741 13681 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:32.174820 13177 leader_election.cc:343] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:32.243062 13327 raft_consensus.cc:359] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.247514 13327 raft_consensus.cc:385] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:32.247874 13327 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:32.249969 13327 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:32.256879 13715 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:18:32.183076 13681 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.263060 13681 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:32.268319 13210 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:32.286443 13327 ts_tablet_manager.cc:1434] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.000s
W20260709 12:18:32.318054 13718 log.cc:927] Time spent T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:18:32.319211 13326 tablet_bootstrap.cc:492] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
W20260709 12:18:32.319768 13717 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:18:32.319852 13326 ts_tablet_manager.cc:1403] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.383s	user 0.007s	sys 0.049s
I20260709 12:18:32.329480 13252 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:18:32.344017 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 80883.9us
I20260709 12:18:32.352154 13722 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:32.352385 13593 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:18:32.355355 13723 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:18:32.368932 13327 tablet_bootstrap.cc:492] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:32.378219 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:32.376775 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:32.381558 13400 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:18:32.384608 13177 consensus_peers.cc:597] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.394528 13328 tablet_bootstrap.cc:492] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:32.395016 13328 ts_tablet_manager.cc:1403] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.293s	user 0.018s	sys 0.000s
W20260709 12:18:32.416859 13177 consensus_peers.cc:597] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.421650 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:32.415169 13326 raft_consensus.cc:359] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.426891 13326 raft_consensus.cc:385] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:32.427218 13326 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:32.428939 13328 raft_consensus.cc:359] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.429893 13328 raft_consensus.cc:385] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:32.430251 13328 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:32.431730 13328 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.434592 13326 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.437942 13400 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:32.437984 13328 ts_tablet_manager.cc:1434] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.001s
I20260709 12:18:32.438894 13400 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.441201 13328 tablet_bootstrap.cc:492] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:32.443620 13327 tablet_bootstrap.cc:654] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:32.450500 13326 ts_tablet_manager.cc:1434] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.130s	user 0.007s	sys 0.000s
I20260709 12:18:32.457175 13326 tablet_bootstrap.cc:492] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
W20260709 12:18:32.461366 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 79362.6us
I20260709 12:18:32.470047 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:32.475482 13249 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:32.480392 13685 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:32.484259 13720 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.484860 13720 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.489841 13326 tablet_bootstrap.cc:654] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:32.491180 13175 leader_election.cc:343] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:32.491827 13175 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:32.498234 13590 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.500921 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:32.492882 13720 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:32.496893 13675 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:32.573937 13177 leader_election.cc:343] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:32.546586 13733 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.115s
W20260709 12:18:32.617449 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 49024us
I20260709 12:18:32.633438 13327 tablet_bootstrap.cc:492] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:32.634136 13327 ts_tablet_manager.cc:1403] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.265s	user 0.014s	sys 0.003s
I20260709 12:18:32.643745 13675 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.657022 13720 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.664551 13686 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.665086 13686 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.668669 13327 raft_consensus.cc:359] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.669371 13327 raft_consensus.cc:385] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:32.669643 13327 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:32.669698 13280 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:18:32.670213 13686 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:32.670312 13327 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.671052 13284 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:18:32.671331 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:32.672029 13134 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:32.676448 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:32.679064 13102 leader_election.cc:343] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:32.692929 13083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:32.695302 13669 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:32.686575 13732 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:18:32.699172 13328 tablet_bootstrap.cc:654] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:32.710012 13327 ts_tablet_manager.cc:1434] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.005s
I20260709 12:18:32.732492 13135 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:18:32.748039 13327 tablet_bootstrap.cc:492] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:32.769933 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:32.773435 13720 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:32.775848 13720 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.776180 13720 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:32.764803 13669 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:18:32.784955 13326 tablet_bootstrap.cc:492] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:32.785468 13326 ts_tablet_manager.cc:1403] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.333s	user 0.020s	sys 0.009s
I20260709 12:18:32.791771 13207 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:18:32.803097 13683 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.803812 13683 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.806427 13683 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:32.813339 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:32.814481 13209 raft_consensus.cc:2393] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:32.844938 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:32.845774 13327 tablet_bootstrap.cc:654] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:32.860072 13326 raft_consensus.cc:359] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.861480 13326 raft_consensus.cc:385] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:32.861845 13326 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:32.862541 13326 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.865075 13326 ts_tablet_manager.cc:1434] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.004s
I20260709 12:18:32.865658 13328 tablet_bootstrap.cc:492] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:32.866281 13328 ts_tablet_manager.cc:1403] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.427s	user 0.026s	sys 0.048s
I20260709 12:18:32.870829 13731 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:18:32.874545 13035 catalog_manager.cc:5697] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.811640 13675 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.056s
I20260709 12:18:32.868873 13590 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:18:32.869187 13596 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.927799 13035 catalog_manager.cc:5697] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.943733 13326 tablet_bootstrap.cc:492] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:32.947206 13035 catalog_manager.cc:5697] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.963910 13328 raft_consensus.cc:359] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.964876 13328 raft_consensus.cc:385] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:32.965225 13328 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:32.969164 13328 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.932090 13720 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:32.959995 13035 catalog_manager.cc:5697] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.935268 13596 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:33.017246 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 88498.3us
I20260709 12:18:33.027561 13203 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 1: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:18:33.041802 13596 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:33.042317 13720 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:33.052745 13328 ts_tablet_manager.cc:1434] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.186s	user 0.019s	sys 0.009s
I20260709 12:18:33.050804 13689 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.068922 13328 tablet_bootstrap.cc:492] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
W20260709 12:18:33.077042 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 47984.3us
I20260709 12:18:33.067492 13689 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.155906 13749 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:33.159540 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 58018.3us
W20260709 12:18:33.161538 13745 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.233s	user 0.004s	sys 0.000s
I20260709 12:18:33.164708 13749 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:33.199229 13754 log.cc:927] Time spent T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:18:33.236073 13326 tablet_bootstrap.cc:654] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:33.248651 13327 tablet_bootstrap.cc:492] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:33.249315 13327 ts_tablet_manager.cc:1403] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.502s	user 0.014s	sys 0.012s
I20260709 12:18:33.256469 13749 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:33.257504 13689 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:33.257768 13328 tablet_bootstrap.cc:654] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:33.251705 13280 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:33.273438 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:33.274134 13285 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:33.276163 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:33.278084 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:33.279001 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:33.279740 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:18:33.308743 13177 leader_election.cc:343] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.313726 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:33.314348 13210 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:33.315160 13747 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.281551 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:33.315645 13747 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.318001 13747 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:18:33.319491 13177 leader_election.cc:343] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:33.333009 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 51558.4us
I20260709 12:18:33.335630 13750 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:33.351030 13327 raft_consensus.cc:359] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.351776 13327 raft_consensus.cc:385] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:33.352065 13327 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:33.343668 13750 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.359418 13327 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.371956 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:33.375977 13327 ts_tablet_manager.cc:1434] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.126s	user 0.008s	sys 0.000s
I20260709 12:18:33.362418 13750 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:33.376710 13177 leader_election.cc:343] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:33.379820 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49448.9us
W20260709 12:18:33.386345 13177 leader_election.cc:343] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.389858 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:33.391952 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:33.392733 13132 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:33.403913 13327 tablet_bootstrap.cc:492] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
W20260709 12:18:33.430894 13742 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.114s	user 0.004s	sys 0.000s
I20260709 12:18:33.441429 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:33.450995 13758 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:33.442657 13750 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.462636 13750 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:33.469587 13327 tablet_bootstrap.cc:654] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:33.469995 13249 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:33.471834 13328 tablet_bootstrap.cc:492] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:33.472497 13328 ts_tablet_manager.cc:1403] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.404s	user 0.017s	sys 0.021s
I20260709 12:18:33.473109 13755 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:33.474332 13326 tablet_bootstrap.cc:492] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:33.474825 13326 ts_tablet_manager.cc:1403] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.599s	user 0.040s	sys 0.032s
I20260709 12:18:33.469913 13132 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:33.477478 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:33.477507 13032 catalog_manager.cc:5697] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 2, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:18:33.478631 13692 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:33.479817 13032 catalog_manager.cc:5697] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 2, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:18:33.481679 13328 raft_consensus.cc:359] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.482345 13328 raft_consensus.cc:385] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:33.482615 13328 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:33.483372 13328 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.481849 13032 catalog_manager.cc:5697] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:18:33.485945 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:33.490345 13283 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:33.493484 13328 ts_tablet_manager.cc:1434] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:18:33.499970 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:33.489838 13035 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42064 (request call id 104) took 1535 ms. Trace:
I20260709 12:18:33.505955 13328 tablet_bootstrap.cc:492] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:33.509933 13326 raft_consensus.cc:359] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.510620 13326 raft_consensus.cc:385] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:33.510897 13326 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:33.516816 13596 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.498167 13283 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:33.517582 13596 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.525909 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:33.526505 13206 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:33.527990 13326 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.537284 13596 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:33.538375 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:33.540153 13177 leader_election.cc:343] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.542495 13206 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:33.505806 13035 rpcz_store.cc:276] 0709 12:18:31.951242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.957890 (+  6648us) service_pool.cc:224] Handling call
0709 12:18:33.486587 (+1528697us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:33.092574 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:33.164724 (+ 72150us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:33.164765 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:18:33.164788 (+    23us) tablet.cc:662] Decoding operations
0709 12:18:33.204490 (+ 39702us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:33.204574 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:33.204607 (+    33us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:18:33.205029 (+   422us) tablet.cc:701] Row locks acquired
0709 12:18:33.205050 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:18:33.205196 (+   146us) write_op.cc:270] Start()
0709 12:18:33.205358 (+   162us) write_op.cc:276] Timestamp: P: 1783599513205157 usec, L: 0
0709 12:18:33.205385 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:18:33.233489 (+ 28104us) log.cc:844] Serialized 1693 byte log entry
0709 12:18:33.362250 (+128761us) op_driver.cc:464] REPLICATION: finished
0709 12:18:33.420519 (+ 58269us) write_op.cc:301] APPLY: starting
0709 12:18:33.420604 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:33.420766 (+   162us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:33.421668 (+   902us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:33.422126 (+   458us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:33.422300 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:18:33.422348 (+    48us) write_op.cc:312] APPLY: finished
0709 12:18:33.422571 (+   223us) log.cc:844] Serialized 40 byte log entry
0709 12:18:33.422733 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:33.422830 (+    97us) write_op.cc:454] Released schema lock
0709 12:18:33.422878 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:33.423192 (+   314us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:33.423216 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":93667,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":41460,"apply.run_cpu_time_us":2087,"apply.run_wall_time_us":12553,"num_ops":4,"prepare.queue_time_us":78321,"prepare.run_cpu_time_us":4540,"prepare.run_wall_time_us":147010,"replication_time_us":156729,"thread_start_us":88898,"threads_started":2}]]}
I20260709 12:18:33.552779 13328 tablet_bootstrap.cc:654] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:33.553821 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:18:33.558501 13175 leader_election.cc:343] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.559527 13175 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:33.558892 13326 ts_tablet_manager.cc:1434] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.084s	user 0.004s	sys 0.002s
I20260709 12:18:33.583956 13327 tablet_bootstrap.cc:492] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
W20260709 12:18:33.585918 13175 leader_election.cc:343] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.586409 13175 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:33.587960 13326 tablet_bootstrap.cc:492] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:33.584470 13590 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:33.587544 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:33.588812 13137 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:33.590261 13769 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:18:33.592104 13175 leader_election.cc:343] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.592563 13175 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:33.593433 13720 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:33.593853 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:33.586047 13033 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:33.595096 13773 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:33.595495 13748 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:33.595661 13773 raft_consensus.cc:697] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:33.597383 13669 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:33.596680 13773 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.597919 13669 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:33.598817 13669 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.600493 13327 ts_tablet_manager.cc:1403] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.199s	user 0.015s	sys 0.000s
I20260709 12:18:33.609923 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:33.638016 13590 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:33.638603 13590 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.640188 13327 raft_consensus.cc:359] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.651582 13327 raft_consensus.cc:385] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:33.645381 13326 tablet_bootstrap.cc:654] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:33.639072 13590 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:33.649989 13328 tablet_bootstrap.cc:492] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:33.670697 13328 ts_tablet_manager.cc:1403] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.165s	user 0.021s	sys 0.033s
I20260709 12:18:33.651906 13327 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:33.673065 13327 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.676910 13328 raft_consensus.cc:359] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.677712 13328 raft_consensus.cc:385] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:33.677997 13328 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:33.678692 13328 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.689965 13033 catalog_manager.cc:5697] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:33.696930 13327 ts_tablet_manager.cc:1434] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260709 12:18:33.691637 13590 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.697532 13328 ts_tablet_manager.cc:1434] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:18:33.704499 13590 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:33.705456 13327 tablet_bootstrap.cc:492] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:33.705502 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:33.707196 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:33.715674 13328 tablet_bootstrap.cc:492] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:33.718451 13136 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:33.720073 13177 leader_election.cc:343] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.733048 13136 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:33.734463 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:33.736639 13590 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:33.737133 13590 raft_consensus.cc:697] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:33.737962 13590 consensus_queue.cc:237] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.743914 13328 tablet_bootstrap.cc:654] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:33.755272 13326 tablet_bootstrap.cc:492] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:33.755883 13326 ts_tablet_manager.cc:1403] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.171s	user 0.015s	sys 0.009s
I20260709 12:18:33.758956 13327 tablet_bootstrap.cc:654] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:33.758179 13032 catalog_manager.cc:5697] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:33.778429 13326 raft_consensus.cc:359] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.779210 13326 raft_consensus.cc:385] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:33.779497 13326 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:33.780129 13326 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.782224 13326 ts_tablet_manager.cc:1434] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.026s	user 0.000s	sys 0.005s
I20260709 12:18:33.783159 13326 tablet_bootstrap.cc:492] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Bootstrap starting.
I20260709 12:18:33.805716 13326 tablet_bootstrap.cc:654] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:33.816090 13328 tablet_bootstrap.cc:492] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:33.816669 13328 ts_tablet_manager.cc:1403] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.012s
I20260709 12:18:33.819324 13328 raft_consensus.cc:359] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.824016 13328 raft_consensus.cc:385] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:33.824707 13328 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:33.826826 13328 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.830564 13328 ts_tablet_manager.cc:1434] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:18:33.845728 13032 catalog_manager.cc:5697] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:33.878274 13590 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.879099 13590 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.881053 13328 tablet_bootstrap.cc:492] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:33.882355 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:33.875765 13327 tablet_bootstrap.cc:492] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:33.887635 13327 ts_tablet_manager.cc:1403] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.182s	user 0.026s	sys 0.014s
W20260709 12:18:33.855754 13083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:18:33.890013 13175 leader_election.cc:343] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.890370 13327 raft_consensus.cc:359] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.891052 13327 raft_consensus.cc:385] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:33.891331 13327 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:33.893278 13327 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.897243 13755 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.897734 13755 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.900924 13755 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:33.903743 13769 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.904945 13769 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.905799 13590 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:33.907382 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:33.908552 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:33.911516 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:33.912830 13328 tablet_bootstrap.cc:654] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:33.916133 13207 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:33.915874 13590 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.914286 13327 ts_tablet_manager.cc:1434] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:18:33.917470 13769 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:18:33.916837 13177 leader_election.cc:343] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.918219 13177 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:33.917243 13590 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.915122 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:33.918258 13327 tablet_bootstrap.cc:492] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:33.918697 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:33.920001 13747 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:33.921487 13102 leader_election.cc:343] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.926326 13326 tablet_bootstrap.cc:492] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: No bootstrap required, opened a new log
I20260709 12:18:33.926661 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:33.926834 13326 ts_tablet_manager.cc:1403] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Time spent bootstrapping tablet: real 0.144s	user 0.014s	sys 0.024s
I20260709 12:18:33.926743 13685 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:33.927899 13177 leader_election.cc:343] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.927366 13685 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.929211 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:33.927873 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:33.930063 13769 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:33.930470 13769 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.931618 13249 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:18:33.931351 13175 leader_election.cc:343] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:33.932112 13769 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:33.933632 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:33.934376 13683 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:33.931792 13685 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:33.934482 13136 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:18:33.932997 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:33.936852 13669 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:33.928040 13590 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:33.941349 13328 tablet_bootstrap.cc:492] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:33.941450 13769 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.943387 13328 ts_tablet_manager.cc:1403] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.011s
I20260709 12:18:33.937812 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:33.944829 13326 raft_consensus.cc:359] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.945528 13326 raft_consensus.cc:385] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:33.945822 13326 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Initialized, Role: FOLLOWER
I20260709 12:18:33.946447 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:33.947002 13207 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:33.946619 13326 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.948092 13252 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:33.954193 13328 raft_consensus.cc:359] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.955165 13328 raft_consensus.cc:385] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:33.955416 13328 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:33.956995 13328 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:33.953398 13789 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:33.965374 13328 ts_tablet_manager.cc:1434] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:18:33.966667 13326 ts_tablet_manager.cc:1434] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.003s
I20260709 12:18:33.979095 13328 tablet_bootstrap.cc:492] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:33.973414 13769 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:33.990926 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:33.993037 13279 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:33.993191 13283 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.025242 13283 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:34.029021 13327 tablet_bootstrap.cc:654] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.029433 13669 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.030566 13669 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.033803 13328 tablet_bootstrap.cc:654] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.040257 13590 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.041657 13590 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.041020 13207 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:34.044668 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:34.050762 13177 leader_election.cc:343] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.051292 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:34.052028 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:34.051970 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:34.056051 13768 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:34.049584 13590 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:34.057830 13768 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:34.058683 13768 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:34.060330 13175 leader_election.cc:343] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.060873 13175 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:34.061707 13596 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:34.061290 13177 leader_election.cc:343] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.080677 13789 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:34.062084 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:34.084483 13136 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 0.
I20260709 12:18:34.052323 13669 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:34.087683 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:34.088548 13747 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:34.088953 13747 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.089314 13747 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.099927 13596 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:34.105078 13327 tablet_bootstrap.cc:492] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:34.105544 13327 ts_tablet_manager.cc:1403] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.188s	user 0.009s	sys 0.007s
I20260709 12:18:34.109576 13747 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.112463 13327 raft_consensus.cc:359] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.115254 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:34.115501 13759 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:18:34.117007 13177 leader_election.cc:343] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.114449 13327 raft_consensus.cc:385] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.119117 13327 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.118606 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:34.122568 13792 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:18:34.130726 13136 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.131585 13327 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.126111 13747 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:34.135926 13327 ts_tablet_manager.cc:1434] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.006s
I20260709 12:18:34.138830 13136 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:18:34.139770 13747 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:34.163655 13327 tablet_bootstrap.cc:492] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:34.164737 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:34.166011 13596 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:34.166499 13596 raft_consensus.cc:697] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:34.165849 13033 catalog_manager.cc:5697] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:34.167467 13596 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.171896 13328 tablet_bootstrap.cc:492] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:34.172549 13328 ts_tablet_manager.cc:1403] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.202s	user 0.022s	sys 0.009s
W20260709 12:18:34.178772 13177 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:34.187371 13328 raft_consensus.cc:359] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.188179 13328 raft_consensus.cc:385] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.188480 13328 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.189172 13328 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.190927 13328 ts_tablet_manager.cc:1434] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:18:34.193624 13327 tablet_bootstrap.cc:654] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.202163 13328 tablet_bootstrap.cc:492] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:34.210151 13327 tablet_bootstrap.cc:492] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:34.210749 13327 ts_tablet_manager.cc:1403] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 12:18:34.213532 13327 raft_consensus.cc:359] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.214368 13327 raft_consensus.cc:385] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.214701 13327 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.215452 13327 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.236071 13327 ts_tablet_manager.cc:1434] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:18:34.237107 13327 tablet_bootstrap.cc:492] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:34.219626 13328 tablet_bootstrap.cc:654] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.230095 13035 catalog_manager.cc:5697] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 0 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:34.273787 13327 tablet_bootstrap.cc:654] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.277334 13328 tablet_bootstrap.cc:492] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:34.278048 13328 ts_tablet_manager.cc:1403] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.018s
I20260709 12:18:34.280794 13328 raft_consensus.cc:359] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.281474 13328 raft_consensus.cc:385] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.281747 13328 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.282423 13328 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.288061 13328 ts_tablet_manager.cc:1434] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:18:34.289119 13328 tablet_bootstrap.cc:492] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:34.291024 13286 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.295542 13328 tablet_bootstrap.cc:654] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.336516 13789 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.337028 13789 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.348304 13327 tablet_bootstrap.cc:492] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:34.348201 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:34.348851 13327 ts_tablet_manager.cc:1403] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.014s
I20260709 12:18:34.349442 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:18:34.349689 13249 leader_election.cc:343] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.350076 13207 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:34.350205 13789 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:34.351347 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:18:34.351585 13327 raft_consensus.cc:359] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.352303 13327 raft_consensus.cc:385] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.352453 13789 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:34.352568 13327 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.353195 13789 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.353615 13789 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.353782 13327 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.356288 13327 ts_tablet_manager.cc:1434] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:18:34.356583 13328 tablet_bootstrap.cc:492] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:34.357509 13328 ts_tablet_manager.cc:1403] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.019s
I20260709 12:18:34.361227 13328 raft_consensus.cc:359] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.362006 13328 raft_consensus.cc:385] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.361596 13789 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.362396 13328 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.358498 13327 tablet_bootstrap.cc:492] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:34.366196 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:34.367375 13789 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:18:34.367744 13249 leader_election.cc:343] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.368917 13327 tablet_bootstrap.cc:654] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.369652 13328 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.374301 13328 ts_tablet_manager.cc:1434] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:18:34.375950 13328 tablet_bootstrap.cc:492] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:34.377844 13596 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:34.379491 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:34.380923 13207 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.382735 13328 tablet_bootstrap.cc:654] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.402179 13207 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:34.403409 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:18:34.404918 13755 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:34.405383 13755 raft_consensus.cc:697] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:34.406163 13755 consensus_queue.cc:237] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.417656 13759 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.418206 13759 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.420485 13759 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:34.424907 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:18:34.433553 13102 leader_election.cc:343] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.447927 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:34.448860 13204 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:34.460460 13103 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:34.461658 13768 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:34.462088 13768 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.462558 13768 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:34.478931 13810 log.cc:927] Time spent T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:18:34.505446 13773 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.517402 13768 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.523201 13790 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:34.526105 13773 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.528275 13768 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:34.524008 13328 tablet_bootstrap.cc:492] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:34.529655 13790 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:34.531031 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:34.531306 13328 ts_tablet_manager.cc:1403] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.156s	user 0.034s	sys 0.057s
I20260709 12:18:34.531701 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:34.532356 13204 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:34.532585 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:34.531694 13207 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.536013 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:34.524878 13035 catalog_manager.cc:5697] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:34.534608 13102 leader_election.cc:343] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:34.542443 13102 leader_election.cc:343] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.543924 13103 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:34.544685 13757 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:34.545033 13757 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.545351 13757 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.549664 13327 tablet_bootstrap.cc:492] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:34.550163 13327 ts_tablet_manager.cc:1403] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.192s	user 0.022s	sys 0.033s
I20260709 12:18:34.528292 13773 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:34.552726 13207 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:34.553604 13789 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.553362 13327 raft_consensus.cc:359] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.554409 13327 raft_consensus.cc:385] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.554741 13327 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.557242 13757 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.564520 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:34.565083 13209 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.572487 13328 raft_consensus.cc:359] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.573243 13328 raft_consensus.cc:385] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.573652 13757 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:34.579377 13328 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.580232 13755 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.580404 13328 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.580718 13755 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.582743 13755 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:34.582894 13328 ts_tablet_manager.cc:1434] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 12:18:34.573033 13209 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:34.583786 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:34.554097 13789 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.584455 13204 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:34.585700 13252 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:34.586143 13789 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:34.586582 13328 tablet_bootstrap.cc:492] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:34.586705 13789 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:34.587208 13789 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.587646 13789 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.588099 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:34.578476 13327 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.592839 13328 tablet_bootstrap.cc:654] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.592896 13327 ts_tablet_manager.cc:1434] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 12:18:34.595486 13327 tablet_bootstrap.cc:492] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24: Bootstrap starting.
I20260709 12:18:34.605434 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:34.606333 13281 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.620698 13773 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.621250 13773 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.623008 13773 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:34.625638 13281 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:18:34.626461 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:34.626729 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:34.627147 13137 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:34.628595 13103 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:34.629377 13773 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:34.629818 13773 raft_consensus.cc:697] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:34.629953 13103 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:18:34.630889 13773 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.635887 13328 tablet_bootstrap.cc:492] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:34.636478 13328 ts_tablet_manager.cc:1403] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.017s
I20260709 12:18:34.639359 13328 raft_consensus.cc:359] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.640177 13328 raft_consensus.cc:385] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.640528 13328 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.641377 13328 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.643864 13328 ts_tablet_manager.cc:1434] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:34.648419 13789 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.650914 13328 tablet_bootstrap.cc:492] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:34.654585 13327 tablet_bootstrap.cc:654] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.657629 13757 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:34.658141 13757 raft_consensus.cc:697] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:34.658694 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:34.659484 13286 raft_consensus.cc:2393] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 1: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:18:34.658958 13757 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.661338 13328 tablet_bootstrap.cc:654] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.666486 13286 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.672279 13328 tablet_bootstrap.cc:492] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:34.672837 13328 ts_tablet_manager.cc:1403] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.001s
I20260709 12:18:34.675559 13328 raft_consensus.cc:359] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.676288 13328 raft_consensus.cc:385] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.676605 13328 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.677228 13328 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.679281 13328 ts_tablet_manager.cc:1434] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:34.680333 13328 tablet_bootstrap.cc:492] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133: Bootstrap starting.
I20260709 12:18:34.681360 13769 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.681890 13769 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.683985 13769 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:34.686581 13328 tablet_bootstrap.cc:654] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.690166 13281 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.697088 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:34.697772 13207 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 0.
I20260709 12:18:34.698040 13328 tablet_bootstrap.cc:492] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133: No bootstrap required, opened a new log
I20260709 12:18:34.698606 13328 ts_tablet_manager.cc:1403] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:18:34.701193 13328 raft_consensus.cc:359] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.702001 13328 raft_consensus.cc:385] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.702139 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:18:34.702381 13328 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.703130 13328 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.705361 13328 ts_tablet_manager.cc:1434] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:18:34.706867 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:34.707477 13207 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.708866 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:34.710366 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:34.714259 13209 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 1: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:18:34.717097 13103 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:18:34.718869 13759 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:34.719203 13103 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:34.719369 13759 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.719941 13759 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.720568 13732 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.710855 13675 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:34.711783 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:34.712491 13789 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:34.728786 13732 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:34.734210 13789 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.734818 13789 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.737017 13789 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:34.742163 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:34.743046 13209 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:34.744222 13759 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.744904 13252 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:34.745980 13789 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:34.746254 13132 raft_consensus.cc:2393] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:34.746387 13789 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.746877 13789 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.765748 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:34.766093 13207 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:34.767248 13252 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:34.768846 13759 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:34.772857 13327 tablet_bootstrap.cc:492] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24: No bootstrap required, opened a new log
I20260709 12:18:34.773356 13327 ts_tablet_manager.cc:1403] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24: Time spent bootstrapping tablet: real 0.178s	user 0.009s	sys 0.000s
I20260709 12:18:34.754771 13789 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.778023 13327 raft_consensus.cc:359] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.778687 13327 raft_consensus.cc:385] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.778942 13327 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.779632 13327 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.780043 13789 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:34.783568 13789 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:34.784236 13755 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:34.783244 13327 ts_tablet_manager.cc:1434] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:18:34.788316 13669 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:34.794884 13789 raft_consensus.cc:697] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:34.795681 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:34.796281 13207 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.796382 13789 consensus_queue.cc:237] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:34.799651 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 77397.3us
I20260709 12:18:34.801046 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:34.801652 13137 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 0.
I20260709 12:18:34.806313 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:34.806875 13137 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.808588 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:34.818814 13032 catalog_manager.cc:5697] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:34.824926 13137 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:34.823388 13032 catalog_manager.cc:5697] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:34.833508 13102 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:18:34.834662 13757 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:34.833082 13207 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:18:34.836755 13252 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:34.837559 13683 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:34.838059 13683 raft_consensus.cc:697] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:34.838920 13683 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:34.890079 13035 catalog_manager.cc:5697] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:34.891866 13035 catalog_manager.cc:5697] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 0 to 1, leader changed from <none> to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:34.946688 13683 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:34.983330 13683 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.028265 13821 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.028710 13821 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:35.030406 13821 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:35.031203 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:18:35.031489 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:18:35.032357 13207 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 1: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:18:35.033309 13252 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:18:35.034015 13821 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.040445 13821 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:35.067528 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:35.075614 13829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:35.082355 13830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:35.086438 11916 server_base.cc:1061] running on GCE node
W20260709 12:18:35.089022 13833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:35.090404 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:35.090679 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:35.090926 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599515090899 us; error 0 us; skew 500 ppm
I20260709 12:18:35.091806 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:35.096448 11916 webserver.cc:533] Webserver started at http://127.11.163.4:33821/ using document root <none> and password file <none>
I20260709 12:18:35.097186 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:35.097427 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:35.097790 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:35.099049 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-3-root/instance:
uuid: "cbc6af7757ec459ab451e47724fdf44b"
format_stamp: "Formatted at 2026-07-09 12:18:35 on dist-test-slave-z9f9"
I20260709 12:18:35.105334 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:35.110432 13837 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:35.111464 11916 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:18:35.111860 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-3-root
uuid: "cbc6af7757ec459ab451e47724fdf44b"
format_stamp: "Formatted at 2026-07-09 12:18:35 on dist-test-slave-z9f9"
I20260709 12:18:35.112515 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:35.170271 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:35.171789 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:35.173573 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:35.177173 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:35.177536 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:18:35.177888 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:35.178130 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:35.215557 13732 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:35.225967 13821 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:35.235929 13757 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.244076 13757 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:35.261854 13757 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.376049 13821 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:35.381588 13821 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:18:35.567903 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 49108us
I20260709 12:18:35.571587 13755 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:18:35.608868 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 47714.2us
I20260709 12:18:35.767230 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.4:37379
I20260709 12:18:35.767364 13911 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.4:37379 every 8 connection(s)
I20260709 12:18:35.787801 11916 auto_leader_rebalancer-test.cc:439] add a tserver: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:35.815970 13912 heartbeater.cc:344] Connected to a master server at 127.11.163.62:33937
I20260709 12:18:35.816869 13912 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:35.818307 13912 heartbeater.cc:507] Master 127.11.163.62:33937 requested a full tablet report, sending...
I20260709 12:18:35.820555 13035 ts_manager.cc:194] Registered new tserver with Master: cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:18:35.821977 13035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51922
I20260709 12:18:36.059581 13207 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:36.065965 13286 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:36.070291 13918 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:36.082158 13916 raft_consensus.cc:2955] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.083338 13286 raft_consensus.cc:2955] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.086344 13135 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:36.096607 13918 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:36.110937 13135 raft_consensus.cc:2955] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.106014 13035 catalog_manager.cc:5697] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
W20260709 12:18:36.133687 13175 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9b25f727caf4a5598422d510a2e6868. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:36.186244 13286 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:36.194844 13209 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:36.196913 13135 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:36.197865 13868 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:36.199807 13821 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:36.216622 13249 consensus_peers.cc:597] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62f45cc6bc2f488697756a90edeec54e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:36.226177 13868 raft_consensus.cc:2955] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.229655 13209 raft_consensus.cc:2955] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.229665 13136 raft_consensus.cc:2955] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.247087 13032 catalog_manager.cc:5697] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:36.301795 13135 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:36.315840 13281 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:36.319108 13207 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:36.319100 13757 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:18:36.322214 13757 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:36.340047 13100 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ec9e4c4c40a4fd8a2fa03ecdfa63507. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:36.341194 13865 raft_consensus.cc:2955] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.346486 13207 raft_consensus.cc:2955] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.356456 13286 raft_consensus.cc:2955] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.373211 13284 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:36.378721 13033 catalog_manager.cc:5697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:36.403193 13209 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:36.408524 13821 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:36.419221 13249 consensus_peers.cc:597] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8719253f6e514245b49fd2d6cf3d0ad4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:36.417346 13135 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:36.431200 13821 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:36.448346 13868 raft_consensus.cc:2955] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.452042 13209 raft_consensus.cc:2955] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.468233 13944 ts_tablet_manager.cc:933] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:36.472875 13135 raft_consensus.cc:2955] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.494506 13033 catalog_manager.cc:5697] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:36.499938 13944 tablet_copy_client.cc:323] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:18:36.527487 13222 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet a9b25f727caf4a5598422d510a2e6868 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:18:36.528144 13222 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet a9b25f727caf4a5598422d510a2e6868 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-a9b25f727caf4a5598422d510a2e6868
I20260709 12:18:36.536558 13222 tablet_copy_source_session.cc:215] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:36.541654 13944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b25f727caf4a5598422d510a2e6868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:36.557931 13944 tablet_copy_client.cc:806] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:36.558559 13944 tablet_copy_client.cc:670] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:36.565536 13944 tablet_copy_client.cc:538] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:36.576480 13944 tablet_bootstrap.cc:492] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:36.630779 13944 tablet_bootstrap.cc:492] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:36.631835 13944 tablet_bootstrap.cc:492] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:36.632540 13944 ts_tablet_manager.cc:1403] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.056s	user 0.028s	sys 0.017s
I20260709 12:18:36.635551 13944 raft_consensus.cc:359] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:36.636504 13944 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:36.637255 13944 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:36.642623 13912 heartbeater.cc:499] Master 127.11.163.62:33937 was elected leader, sending a full tablet report...
I20260709 12:18:36.643350 13944 ts_tablet_manager.cc:1434] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:18:36.645517 13222 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-a9b25f727caf4a5598422d510a2e6868 received from {username='slave'} at 127.0.0.1:36412
I20260709 12:18:36.645989 13222 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-a9b25f727caf4a5598422d510a2e6868 on tablet a9b25f727caf4a5598422d510a2e6868 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:36.769991 13944 ts_tablet_manager.cc:933] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:36.776572 13944 tablet_copy_client.cc:323] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.3:35631
I20260709 12:18:36.808662 13296 tablet_copy_service.cc:140] P b190224a708b4f068a6dda4006c3a133: Received BeginTabletCopySession request for tablet 62f45cc6bc2f488697756a90edeec54e from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:42730)
I20260709 12:18:36.809262 13296 tablet_copy_service.cc:161] P b190224a708b4f068a6dda4006c3a133: Beginning new tablet copy session on tablet 62f45cc6bc2f488697756a90edeec54e from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:42730: session id = cbc6af7757ec459ab451e47724fdf44b-62f45cc6bc2f488697756a90edeec54e
I20260709 12:18:36.816861 13296 tablet_copy_source_session.cc:215] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:36.834749 13944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f45cc6bc2f488697756a90edeec54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:36.852321 13944 tablet_copy_client.cc:806] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:36.852905 13944 tablet_copy_client.cc:670] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:36.856842 13944 tablet_copy_client.cc:538] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:36.866466 13944 tablet_bootstrap.cc:492] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:36.884799 13886 raft_consensus.cc:1217] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:36.898350 13952 ts_tablet_manager.cc:933] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:36.914299 13952 tablet_copy_client.cc:323] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.3:35631
I20260709 12:18:36.916266 13296 tablet_copy_service.cc:140] P b190224a708b4f068a6dda4006c3a133: Received BeginTabletCopySession request for tablet 8719253f6e514245b49fd2d6cf3d0ad4 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:42730)
I20260709 12:18:36.916863 13296 tablet_copy_service.cc:161] P b190224a708b4f068a6dda4006c3a133: Beginning new tablet copy session on tablet 8719253f6e514245b49fd2d6cf3d0ad4 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:42730: session id = cbc6af7757ec459ab451e47724fdf44b-8719253f6e514245b49fd2d6cf3d0ad4
I20260709 12:18:36.931771 13955 ts_tablet_manager.cc:933] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:36.949355 13955 tablet_copy_client.cc:323] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:36.955098 13296 tablet_copy_source_session.cc:215] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:36.963341 13944 tablet_bootstrap.cc:492] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:36.966873 13944 tablet_bootstrap.cc:492] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:36.967528 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:36.968405 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-2ec9e4c4c40a4fd8a2fa03ecdfa63507
I20260709 12:18:36.969329 13952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8719253f6e514245b49fd2d6cf3d0ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:36.975936 13147 tablet_copy_source_session.cc:215] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:36.979396 13955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:36.980195 13944 ts_tablet_manager.cc:1403] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.114s	user 0.024s	sys 0.029s
I20260709 12:18:36.983595 13944 raft_consensus.cc:359] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:36.984586 13944 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:36.990656 13944 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:36.996469 13944 ts_tablet_manager.cc:1434] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:18:36.997072 13955 tablet_copy_client.cc:806] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:36.997637 13955 tablet_copy_client.cc:670] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:36.999359 13296 tablet_copy_service.cc:342] P b190224a708b4f068a6dda4006c3a133: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-62f45cc6bc2f488697756a90edeec54e received from {username='slave'} at 127.0.0.1:42730
I20260709 12:18:36.999859 13296 tablet_copy_service.cc:434] P b190224a708b4f068a6dda4006c3a133: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-62f45cc6bc2f488697756a90edeec54e on tablet 62f45cc6bc2f488697756a90edeec54e with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:37.009536 13952 tablet_copy_client.cc:806] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:37.010236 13952 tablet_copy_client.cc:670] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:37.016918 13955 tablet_copy_client.cc:538] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:37.017342 13952 tablet_copy_client.cc:538] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:37.031713 13955 tablet_bootstrap.cc:492] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:37.039110 13952 tablet_bootstrap.cc:492] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:37.083033 13955 tablet_bootstrap.cc:492] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:37.084017 13955 tablet_bootstrap.cc:492] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:37.084666 13955 ts_tablet_manager.cc:1403] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.020s
I20260709 12:18:37.087698 13955 raft_consensus.cc:359] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:37.088553 13955 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:37.089200 13955 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:37.091548 13955 ts_tablet_manager.cc:1434] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:18:37.093816 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-2ec9e4c4c40a4fd8a2fa03ecdfa63507 received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:37.094292 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-2ec9e4c4c40a4fd8a2fa03ecdfa63507 on tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:37.094703 13952 tablet_bootstrap.cc:492] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:37.095630 13952 tablet_bootstrap.cc:492] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:37.096355 13952 ts_tablet_manager.cc:1403] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.014s
I20260709 12:18:37.099352 13952 raft_consensus.cc:359] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:37.100214 13952 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:37.100814 13952 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:37.103339 13952 ts_tablet_manager.cc:1434] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:37.105072 13296 tablet_copy_service.cc:342] P b190224a708b4f068a6dda4006c3a133: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-8719253f6e514245b49fd2d6cf3d0ad4 received from {username='slave'} at 127.0.0.1:42730
I20260709 12:18:37.105489 13296 tablet_copy_service.cc:434] P b190224a708b4f068a6dda4006c3a133: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-8719253f6e514245b49fd2d6cf3d0ad4 on tablet 8719253f6e514245b49fd2d6cf3d0ad4 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:37.318521 13887 raft_consensus.cc:1217] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:37.380072 13887 raft_consensus.cc:1217] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:37.473325 13887 raft_consensus.cc:1217] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:37.510973 13747 raft_consensus.cc:1064] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:37.514207 13747 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:37.628125 13284 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:37.630740 13887 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:37.633486 13916 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:37.634480 13917 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:37.638773 13135 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:37.640264 13917 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:37.740074 13917 raft_consensus.cc:2955] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:37.769793 13284 raft_consensus.cc:2955] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:37.771193 13135 raft_consensus.cc:2955] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:37.781241 13033 catalog_manager.cc:5697] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:37.795758 13887 raft_consensus.cc:2955] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:37.877930 13207 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:37.882941 13887 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:37.884241 13965 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:37.886502 13136 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:37.888458 13965 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:37.892244 13967 raft_consensus.cc:2955] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:37.899735 13887 raft_consensus.cc:2955] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:37.908665 13136 raft_consensus.cc:2955] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:37.911643 13022 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a9b25f727caf4a5598422d510a2e6868 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:37.919605 13946 raft_consensus.cc:1064] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:37.922155 13946 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:37.938848 13035 catalog_manager.cc:5697] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:37.966403 13207 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:37.968439 13887 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:37.970820 13132 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:37.970701 13960 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:37.975127 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet a9b25f727caf4a5598422d510a2e6868 with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38630
I20260709 12:18:37.975628 13821 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:37.985337 13821 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:37.991698 13974 tablet_replica.cc:333] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:18:37.991920 13940 raft_consensus.cc:1064] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:38.016948 13821 raft_consensus.cc:1064] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:38.023645 13821 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:38.017742 13940 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:38.037959 13974 raft_consensus.cc:2243] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:38.038749 13974 raft_consensus.cc:2272] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:38.042531 13974 ts_tablet_manager.cc:1916] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:38.044385 13960 raft_consensus.cc:2955] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:18:38.120179 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 53506.3us
I20260709 12:18:38.130223 13886 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:38.130607 13286 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:38.143738 13209 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:38.149494 13136 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:38.156930 13757 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:38.160140 13136 raft_consensus.cc:2955] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.163141 13886 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:38.147099 13887 raft_consensus.cc:2955] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.150751 13821 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:18:38.183400 13032 catalog_manager.cc:5697] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:38.192234 13983 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:38.193703 13204 raft_consensus.cc:2955] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.183773 13960 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:18:38.205966 13821 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:18:38.227576 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 77900.3us
W20260709 12:18:38.303666 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 53375.5us
W20260709 12:18:38.312538 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 116036us
W20260709 12:18:38.313558 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 57797.4us
W20260709 12:18:38.313088 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 57952.4us
W20260709 12:18:38.382529 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 126363us
I20260709 12:18:38.394142 13212 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:38.421936 13974 ts_tablet_manager.cc:1929] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:38.422657 13974 log.cc:1199] T a9b25f727caf4a5598422d510a2e6868 P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/a9b25f727caf4a5598422d510a2e6868
W20260709 12:18:38.484648 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 44465.4us
I20260709 12:18:38.507012 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet a9b25f727caf4a5598422d510a2e6868 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
W20260709 12:18:38.511830 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 206757us
I20260709 12:18:38.533006 13946 raft_consensus.cc:2955] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.552117 13886 raft_consensus.cc:2955] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.571636 13981 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:38.585124 13137 raft_consensus.cc:2955] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.589624 13204 raft_consensus.cc:2955] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.594038 13280 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:38.620044 13999 raft_consensus.cc:2955] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.627748 13034 catalog_manager.cc:5697] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.645325 13209 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:38.649587 13277 raft_consensus.cc:2955] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.655061 13887 raft_consensus.cc:2955] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.661144 13885 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:38.675837 13032 catalog_manager.cc:5697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:38.669553 13286 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:38.688349 13980 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:38.737929 13887 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:38.740149 13212 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:38.740067 14002 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:38.743508 13980 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:38.754009 13980 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:38.758423 13207 raft_consensus.cc:2955] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.769083 13821 raft_consensus.cc:2955] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.768775 13980 raft_consensus.cc:2955] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.811022 13887 raft_consensus.cc:2955] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.817883 13136 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:38.833784 13021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 62f45cc6bc2f488697756a90edeec54e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:18:38.837980 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 44877.3us
I20260709 12:18:38.842952 13277 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:38.844177 13212 raft_consensus.cc:2955] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.847975 13886 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:38.848295 13032 catalog_manager.cc:5697] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:38.851994 13885 raft_consensus.cc:2955] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.862885 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet 62f45cc6bc2f488697756a90edeec54e with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58700
I20260709 12:18:38.848951 13204 raft_consensus.cc:2955] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.864344 13021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8719253f6e514245b49fd2d6cf3d0ad4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:38.849967 13983 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:38.871564 13994 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:38.885530 13994 raft_consensus.cc:2955] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.890209 13887 raft_consensus.cc:2955] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.903957 13277 raft_consensus.cc:2955] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.919473 14005 tablet_replica.cc:333] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:18:38.920047 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:38.920912 14005 raft_consensus.cc:2243] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:38.921712 14005 raft_consensus.cc:2272] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:38.925468 14005 ts_tablet_manager.cc:1916] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:38.932008 13032 catalog_manager.cc:5697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:38.906630 13035 catalog_manager.cc:5697] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:38.957674 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507 with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46516
I20260709 12:18:38.974574 14005 ts_tablet_manager.cc:1929] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:38.975231 14005 log.cc:1199] T 62f45cc6bc2f488697756a90edeec54e P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/62f45cc6bc2f488697756a90edeec54e
I20260709 12:18:38.977463 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet 62f45cc6bc2f488697756a90edeec54e (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:38.983302 14006 tablet_replica.cc:333] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:18:38.983865 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet 8719253f6e514245b49fd2d6cf3d0ad4 with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58700
I20260709 12:18:38.984462 14006 raft_consensus.cc:2243] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:38.985286 14005 tablet_replica.cc:333] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:18:38.985347 14006 raft_consensus.cc:2272] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:38.988893 14005 raft_consensus.cc:2243] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:38.992509 14006 ts_tablet_manager.cc:1916] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:38.993403 14005 raft_consensus.cc:2272] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:38.997808 14005 ts_tablet_manager.cc:1916] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:39.013758 14005 ts_tablet_manager.cc:1929] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:39.014163 14005 log.cc:1199] T 8719253f6e514245b49fd2d6cf3d0ad4 P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/8719253f6e514245b49fd2d6cf3d0ad4
I20260709 12:18:39.014322 14006 ts_tablet_manager.cc:1929] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:39.014876 14006 log.cc:1199] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/2ec9e4c4c40a4fd8a2fa03ecdfa63507
I20260709 12:18:39.015961 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet 8719253f6e514245b49fd2d6cf3d0ad4 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:39.016794 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet 2ec9e4c4c40a4fd8a2fa03ecdfa63507 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:40.089408 13136 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:40.103504 13286 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:18:40.103827 13100 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2b4bbf33578469487ada15907f2483a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:40.105109 13204 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:40.105429 13981 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:40.106616 13999 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:40.124912 13994 raft_consensus.cc:2955] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.127556 13281 raft_consensus.cc:2955] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.128285 13204 raft_consensus.cc:2955] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.161614 13136 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:40.168767 13035 catalog_manager.cc:5697] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 2 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:40.202870 13100 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2b8aac4336e49d4bc5ba21f80833bd5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:40.204042 13281 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:40.205241 13204 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:40.205616 13999 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:40.206822 13986 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:40.223076 13994 raft_consensus.cc:2955] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.228071 13204 raft_consensus.cc:2955] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.238224 13281 raft_consensus.cc:2955] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.256690 13136 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:40.268770 13031 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:40.278327 13100 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ad86a9f99c849fa9efa50969bc43d9a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:40.280316 13204 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:40.281832 13281 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:40.283624 13986 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:40.284655 13981 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:40.318184 13994 raft_consensus.cc:2955] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.326813 13277 raft_consensus.cc:2955] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.341055 13209 raft_consensus.cc:2955] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.349443 13034 catalog_manager.cc:5697] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:40.351539 13136 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:18:40.376245 13100 consensus_peers.cc:597] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8820b0db2b544a93ba81b2abe6292404. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:40.377640 13277 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:40.382659 13204 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:40.384146 13999 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:40.386265 13999 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:40.395346 13986 raft_consensus.cc:2955] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.397329 13277 raft_consensus.cc:2955] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.418370 13035 catalog_manager.cc:5697] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:40.426895 13209 raft_consensus.cc:2955] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:40.696254 14026 ts_tablet_manager.cc:933] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:40.698604 14026 tablet_copy_client.cc:323] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:40.700917 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet b2b4bbf33578469487ada15907f2483a from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:40.701607 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet b2b4bbf33578469487ada15907f2483a from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-b2b4bbf33578469487ada15907f2483a
I20260709 12:18:40.737883 13147 tablet_copy_source_session.cc:215] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:40.747714 14026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b4bbf33578469487ada15907f2483a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:40.790292 14026 tablet_copy_client.cc:806] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:40.791015 14026 tablet_copy_client.cc:670] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:40.796408 14026 tablet_copy_client.cc:538] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:40.817616 14026 tablet_bootstrap.cc:492] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:40.829231 14030 ts_tablet_manager.cc:933] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:40.834036 14031 ts_tablet_manager.cc:933] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:40.837695 14030 tablet_copy_client.cc:323] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:40.839382 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet 9ad86a9f99c849fa9efa50969bc43d9a from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:40.839895 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet 9ad86a9f99c849fa9efa50969bc43d9a from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-9ad86a9f99c849fa9efa50969bc43d9a
I20260709 12:18:40.855146 13147 tablet_copy_source_session.cc:215] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:40.873466 14031 tablet_copy_client.cc:323] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:40.876763 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet a2b8aac4336e49d4bc5ba21f80833bd5 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:40.877390 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet a2b8aac4336e49d4bc5ba21f80833bd5 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-a2b8aac4336e49d4bc5ba21f80833bd5
I20260709 12:18:40.873983 14030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ad86a9f99c849fa9efa50969bc43d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:40.894586 13147 tablet_copy_source_session.cc:215] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:40.898123 14031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8aac4336e49d4bc5ba21f80833bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:40.899116 14026 tablet_bootstrap.cc:492] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:40.900194 14026 tablet_bootstrap.cc:492] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:40.900934 14026 ts_tablet_manager.cc:1403] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.019s
I20260709 12:18:40.904278 14026 raft_consensus.cc:359] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:40.905210 14026 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:40.905972 14026 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:40.933847 14031 tablet_copy_client.cc:806] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:40.934497 14031 tablet_copy_client.cc:670] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:40.938661 14031 tablet_copy_client.cc:538] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:40.957173 14031 tablet_bootstrap.cc:492] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:40.995764 14037 ts_tablet_manager.cc:933] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:41.003834 14037 tablet_copy_client.cc:323] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:41.005942 14031 tablet_bootstrap.cc:492] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.011193 14031 tablet_bootstrap.cc:492] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:41.012035 14031 ts_tablet_manager.cc:1403] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.008s
I20260709 12:18:41.015020 14031 raft_consensus.cc:359] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:41.016060 14031 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:41.017609 14031 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:41.033313 14031 ts_tablet_manager.cc:1434] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.005s
I20260709 12:18:41.035161 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-a2b8aac4336e49d4bc5ba21f80833bd5 received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:41.035698 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-a2b8aac4336e49d4bc5ba21f80833bd5 on tablet a2b8aac4336e49d4bc5ba21f80833bd5 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:41.042268 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet 8820b0db2b544a93ba81b2abe6292404 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:41.042826 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet 8820b0db2b544a93ba81b2abe6292404 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-8820b0db2b544a93ba81b2abe6292404
I20260709 12:18:41.050977 13147 tablet_copy_source_session.cc:215] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:41.054914 14037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8820b0db2b544a93ba81b2abe6292404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:41.120749 14037 tablet_copy_client.cc:806] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:41.121655 14037 tablet_copy_client.cc:670] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:41.127110 14037 tablet_copy_client.cc:538] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:41.155848 14037 tablet_bootstrap.cc:492] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:41.196774 14037 tablet_bootstrap.cc:492] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.203500 14037 tablet_bootstrap.cc:492] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:41.205231 14037 ts_tablet_manager.cc:1403] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.006s
I20260709 12:18:41.209002 14037 raft_consensus.cc:359] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:41.213519 14037 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:41.214735 14037 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:41.232905 14037 ts_tablet_manager.cc:1434] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:18:41.247604 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-8820b0db2b544a93ba81b2abe6292404 received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:41.248070 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-8820b0db2b544a93ba81b2abe6292404 on tablet 8820b0db2b544a93ba81b2abe6292404 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:41.256654 14026 ts_tablet_manager.cc:1434] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.355s	user 0.107s	sys 0.136s
I20260709 12:18:41.276561 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-b2b4bbf33578469487ada15907f2483a received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:41.277019 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-b2b4bbf33578469487ada15907f2483a on tablet b2b4bbf33578469487ada15907f2483a with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:41.281467 14030 tablet_copy_client.cc:806] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:41.283222 14030 tablet_copy_client.cc:670] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:41.293488 14030 tablet_copy_client.cc:538] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:41.360175 14030 tablet_bootstrap.cc:492] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:41.415257 13887 raft_consensus.cc:1217] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:41.456655 14030 tablet_bootstrap.cc:492] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.457842 14030 tablet_bootstrap.cc:492] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:41.458618 14030 ts_tablet_manager.cc:1403] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.002s
I20260709 12:18:41.462126 14030 raft_consensus.cc:359] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:41.482450 14030 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:41.483295 14030 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:41.494370 14030 ts_tablet_manager.cc:1434] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.003s
I20260709 12:18:41.503306 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-9ad86a9f99c849fa9efa50969bc43d9a received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:41.503873 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-9ad86a9f99c849fa9efa50969bc43d9a on tablet 9ad86a9f99c849fa9efa50969bc43d9a with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:41.597108 13887 raft_consensus.cc:1217] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:41.787943 13887 raft_consensus.cc:1217] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:18:41.931741 13887 raft_consensus.cc:1217] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:41.955008 13986 raft_consensus.cc:1064] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:41.957628 13986 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:41.965946 13209 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:41.967504 13887 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:41.967314 13986 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:41.968858 13281 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:41.968889 14028 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:41.970772 13986 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:41.986522 14028 raft_consensus.cc:2955] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:41.988461 13281 raft_consensus.cc:2955] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:41.990041 13887 raft_consensus.cc:2955] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.005949 13204 raft_consensus.cc:2955] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.011881 13034 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.045121 14028 raft_consensus.cc:1064] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:42.047621 14028 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:42.054965 13136 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:42.060083 13887 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:42.061098 13204 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:42.062012 14043 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:42.065786 14043 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:42.071345 13887 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:42.073000 13999 raft_consensus.cc:2955] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.074144 13887 raft_consensus.cc:2955] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.073808 13986 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.080987 13204 raft_consensus.cc:2955] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.084227 13281 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:42.085557 14043 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.090512 13031 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.098779 13207 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:42.100373 14043 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.120429 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet a2b8aac4336e49d4bc5ba21f80833bd5 with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38630
I20260709 12:18:42.128679 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a2b8aac4336e49d4bc5ba21f80833bd5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:42.141479 14056 tablet_replica.cc:333] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:18:42.155598 13986 raft_consensus.cc:2955] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.166777 14056 raft_consensus.cc:2243] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:42.168076 14056 raft_consensus.cc:2272] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:42.177594 13207 raft_consensus.cc:2955] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.181505 14056 ts_tablet_manager.cc:1916] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:42.182214 13281 raft_consensus.cc:2955] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.198010 13885 raft_consensus.cc:2955] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.206817 13031 catalog_manager.cc:5697] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.214033 14056 ts_tablet_manager.cc:1929] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:42.217796 14056 log.cc:1199] T a2b8aac4336e49d4bc5ba21f80833bd5 P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/a2b8aac4336e49d4bc5ba21f80833bd5
I20260709 12:18:42.219516 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet a2b8aac4336e49d4bc5ba21f80833bd5 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:42.252254 13136 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:42.260116 13885 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:42.261713 13986 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:42.264662 13209 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:42.267838 14028 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:42.275400 13981 raft_consensus.cc:2955] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.281702 13885 raft_consensus.cc:2955] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.286229 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8820b0db2b544a93ba81b2abe6292404 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:42.290084 13209 raft_consensus.cc:2955] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.303175 13031 catalog_manager.cc:5697] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.325145 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet 8820b0db2b544a93ba81b2abe6292404 with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38630
I20260709 12:18:42.326157 14056 tablet_replica.cc:333] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:18:42.327189 14056 raft_consensus.cc:2243] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:42.328001 14056 raft_consensus.cc:2272] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:42.331750 14056 ts_tablet_manager.cc:1916] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:42.348945 14056 ts_tablet_manager.cc:1929] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:42.349291 14056 log.cc:1199] T 8820b0db2b544a93ba81b2abe6292404 P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/8820b0db2b544a93ba81b2abe6292404
I20260709 12:18:42.350663 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet 8820b0db2b544a93ba81b2abe6292404 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:42.355026 14043 raft_consensus.cc:1064] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:42.357110 14043 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:42.371145 13885 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:42.371291 13281 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:42.373008 13999 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.373322 13209 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:42.374022 14028 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.382896 13999 raft_consensus.cc:1064] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:42.385670 13999 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:42.388430 14028 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.399986 14028 raft_consensus.cc:2955] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.404170 13207 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:42.405721 13999 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.405987 13885 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:42.406318 13286 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:42.407737 14043 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.411573 14043 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.429112 13986 raft_consensus.cc:2955] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.438741 13209 raft_consensus.cc:2955] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.439800 13207 raft_consensus.cc:2955] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.451602 13280 raft_consensus.cc:2955] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.426712 13281 raft_consensus.cc:2955] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.458536 13032 catalog_manager.cc:5697] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.470904 13034 catalog_manager.cc:5697] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.482769 13887 raft_consensus.cc:2955] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.492475 13885 raft_consensus.cc:2955] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.522610 13137 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:42.525379 13136 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:42.530231 13887 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:42.531626 14028 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:42.535466 13885 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:18:42.535708 13286 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:18:42.537583 13994 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:42.538923 13281 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:42.540422 13994 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:42.542414 13986 raft_consensus.cc:2955] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.547628 14028 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:42.546232 13885 raft_consensus.cc:2955] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.550038 13981 raft_consensus.cc:2955] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.553062 13286 raft_consensus.cc:2955] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.558919 13887 raft_consensus.cc:2955] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.568820 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ad86a9f99c849fa9efa50969bc43d9a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:42.577265 13035 catalog_manager.cc:5697] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.585830 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b2b4bbf33578469487ada15907f2483a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:42.590571 13281 raft_consensus.cc:2955] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.599654 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ad86a9f99c849fa9efa50969bc43d9a with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46516
I20260709 12:18:42.609477 13031 catalog_manager.cc:5697] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 2 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:42.627796 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet b2b4bbf33578469487ada15907f2483a with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46516
I20260709 12:18:42.628650 14065 tablet_replica.cc:333] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:18:42.629585 14065 raft_consensus.cc:2243] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:42.630458 14065 raft_consensus.cc:2272] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:42.648152 14065 ts_tablet_manager.cc:1916] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:42.671917 14065 ts_tablet_manager.cc:1929] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:42.672403 14065 log.cc:1199] T 9ad86a9f99c849fa9efa50969bc43d9a P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/9ad86a9f99c849fa9efa50969bc43d9a
I20260709 12:18:42.674369 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet 9ad86a9f99c849fa9efa50969bc43d9a (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:42.675771 14065 tablet_replica.cc:333] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:18:42.678560 14065 raft_consensus.cc:2243] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:42.679369 14065 raft_consensus.cc:2272] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:42.685499 14065 ts_tablet_manager.cc:1916] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:42.719025 14065 ts_tablet_manager.cc:1929] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:18:42.719455 14065 log.cc:1199] T b2b4bbf33578469487ada15907f2483a P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/b2b4bbf33578469487ada15907f2483a
I20260709 12:18:42.720831 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet b2b4bbf33578469487ada15907f2483a (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:43.702906 13280 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:43.709486 13209 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:43.710915 14042 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:43.711545 13137 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:43.711982 13249 consensus_peers.cc:597] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8df593339524328b819bd096f86f17d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:43.712781 14042 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:43.720520 14069 raft_consensus.cc:2955] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.721936 13207 raft_consensus.cc:2955] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.722886 13137 raft_consensus.cc:2955] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.747012 13207 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:43.748221 13035 catalog_manager.cc:5697] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.768471 13280 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:43.770273 13917 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:43.789666 13137 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:43.789888 14066 raft_consensus.cc:2955] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.791441 13280 raft_consensus.cc:2955] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
W20260709 12:18:43.792369 13175 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b675043435441bb980d9a219c4d3450. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:43.793567 13917 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:43.805375 13137 raft_consensus.cc:2955] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.819993 13280 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:43.836045 13032 catalog_manager.cc:5697] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.850375 13204 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:43.851264 13249 consensus_peers.cc:597] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f7a6bb73699404e86b7d94b6633703c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:43.852089 14042 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:43.853415 13137 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:43.855032 14042 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:43.870831 14072 raft_consensus.cc:2955] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.872951 13207 raft_consensus.cc:2955] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.875095 13137 raft_consensus.cc:2955] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.886349 13204 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:43.896471 13281 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:43.896984 13175 consensus_peers.cc:597] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35e9975f4caa4eb7be07cf7ee3aed8b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:43.898016 13137 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:43.897408 13032 catalog_manager.cc:5697] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.899223 14080 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:43.901497 14076 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:43.918291 14080 raft_consensus.cc:2955] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.923530 13136 raft_consensus.cc:2955] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:43.943481 13032 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:43.945020 13281 raft_consensus.cc:2955] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:44.158200 14089 ts_tablet_manager.cc:933] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:44.160331 14089 tablet_copy_client.cc:323] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:18:44.162578 13222 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet 6b675043435441bb980d9a219c4d3450 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:18:44.163152 13222 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet 6b675043435441bb980d9a219c4d3450 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-6b675043435441bb980d9a219c4d3450
I20260709 12:18:44.172147 13222 tablet_copy_source_session.cc:215] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:44.178158 14089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b675043435441bb980d9a219c4d3450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:44.194403 14089 tablet_copy_client.cc:806] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:44.195079 14089 tablet_copy_client.cc:670] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:44.199004 14089 tablet_copy_client.cc:538] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:44.208328 14089 tablet_bootstrap.cc:492] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:44.210250 14091 ts_tablet_manager.cc:933] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:44.216184 14091 tablet_copy_client.cc:323] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.3:35631
I20260709 12:18:44.218133 13296 tablet_copy_service.cc:140] P b190224a708b4f068a6dda4006c3a133: Received BeginTabletCopySession request for tablet c8df593339524328b819bd096f86f17d from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:42730)
I20260709 12:18:44.218686 13296 tablet_copy_service.cc:161] P b190224a708b4f068a6dda4006c3a133: Beginning new tablet copy session on tablet c8df593339524328b819bd096f86f17d from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:42730: session id = cbc6af7757ec459ab451e47724fdf44b-c8df593339524328b819bd096f86f17d
I20260709 12:18:44.230006 13296 tablet_copy_source_session.cc:215] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:44.233944 14091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8df593339524328b819bd096f86f17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:44.234532 14089 tablet_bootstrap.cc:492] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:44.235538 14089 tablet_bootstrap.cc:492] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:44.236223 14089 ts_tablet_manager.cc:1403] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.010s
I20260709 12:18:44.239845 14089 raft_consensus.cc:359] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:44.240770 14089 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:44.241464 14089 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:44.257658 14089 ts_tablet_manager.cc:1434] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 12:18:44.259600 13222 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-6b675043435441bb980d9a219c4d3450 received from {username='slave'} at 127.0.0.1:36412
I20260709 12:18:44.260064 13222 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-6b675043435441bb980d9a219c4d3450 on tablet 6b675043435441bb980d9a219c4d3450 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:44.273415 14091 tablet_copy_client.cc:806] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:44.274187 14091 tablet_copy_client.cc:670] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:44.278630 14091 tablet_copy_client.cc:538] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:44.289072 14091 tablet_bootstrap.cc:492] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:44.313825 14091 tablet_bootstrap.cc:492] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:44.315033 14091 tablet_bootstrap.cc:492] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:44.315819 14091 ts_tablet_manager.cc:1403] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.003s
I20260709 12:18:44.318922 14091 raft_consensus.cc:359] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:44.319938 14091 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:44.320675 14091 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:44.329617 14089 ts_tablet_manager.cc:933] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:44.329955 14091 ts_tablet_manager.cc:1434] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:18:44.333310 13296 tablet_copy_service.cc:342] P b190224a708b4f068a6dda4006c3a133: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-c8df593339524328b819bd096f86f17d received from {username='slave'} at 127.0.0.1:42730
I20260709 12:18:44.333803 13296 tablet_copy_service.cc:434] P b190224a708b4f068a6dda4006c3a133: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-c8df593339524328b819bd096f86f17d on tablet c8df593339524328b819bd096f86f17d with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:44.355449 14089 tablet_copy_client.cc:323] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:18:44.357266 13222 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet 35e9975f4caa4eb7be07cf7ee3aed8b3 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:18:44.357846 13222 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet 35e9975f4caa4eb7be07cf7ee3aed8b3 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-35e9975f4caa4eb7be07cf7ee3aed8b3
I20260709 12:18:44.365576 13222 tablet_copy_source_session.cc:215] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:44.372028 14089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e9975f4caa4eb7be07cf7ee3aed8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:44.391615 14091 ts_tablet_manager.cc:933] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:44.393983 14089 tablet_copy_client.cc:806] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:44.394730 14089 tablet_copy_client.cc:670] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:44.395591 14091 tablet_copy_client.cc:323] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.3:35631
I20260709 12:18:44.397409 13296 tablet_copy_service.cc:140] P b190224a708b4f068a6dda4006c3a133: Received BeginTabletCopySession request for tablet 2f7a6bb73699404e86b7d94b6633703c from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:42730)
I20260709 12:18:44.397922 13296 tablet_copy_service.cc:161] P b190224a708b4f068a6dda4006c3a133: Beginning new tablet copy session on tablet 2f7a6bb73699404e86b7d94b6633703c from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:42730: session id = cbc6af7757ec459ab451e47724fdf44b-2f7a6bb73699404e86b7d94b6633703c
I20260709 12:18:44.401394 14089 tablet_copy_client.cc:538] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:44.405694 13296 tablet_copy_source_session.cc:215] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:44.412626 14091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7a6bb73699404e86b7d94b6633703c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:44.414997 14089 tablet_bootstrap.cc:492] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:44.437062 14091 tablet_copy_client.cc:806] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:44.437711 14091 tablet_copy_client.cc:670] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:44.441849 14091 tablet_copy_client.cc:538] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:44.443619 14089 tablet_bootstrap.cc:492] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:44.444628 14089 tablet_bootstrap.cc:492] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:44.445446 14089 ts_tablet_manager.cc:1403] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.015s
I20260709 12:18:44.448935 14089 raft_consensus.cc:359] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:44.449981 14089 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:44.450793 14089 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:44.453047 14091 tablet_bootstrap.cc:492] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:44.466262 14089 ts_tablet_manager.cc:1434] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:18:44.473502 13222 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-35e9975f4caa4eb7be07cf7ee3aed8b3 received from {username='slave'} at 127.0.0.1:36412
I20260709 12:18:44.473994 13222 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-35e9975f4caa4eb7be07cf7ee3aed8b3 on tablet 35e9975f4caa4eb7be07cf7ee3aed8b3 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:44.497902 14091 tablet_bootstrap.cc:492] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:44.499058 14091 tablet_bootstrap.cc:492] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:44.499841 14091 ts_tablet_manager.cc:1403] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.047s	user 0.026s	sys 0.014s
I20260709 12:18:44.503150 14091 raft_consensus.cc:359] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:44.505115 14091 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:44.505817 14091 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:44.508570 14091 ts_tablet_manager.cc:1434] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:18:44.510464 13296 tablet_copy_service.cc:342] P b190224a708b4f068a6dda4006c3a133: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-2f7a6bb73699404e86b7d94b6633703c received from {username='slave'} at 127.0.0.1:42730
I20260709 12:18:44.510923 13296 tablet_copy_service.cc:434] P b190224a708b4f068a6dda4006c3a133: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-2f7a6bb73699404e86b7d94b6633703c on tablet 2f7a6bb73699404e86b7d94b6633703c with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:44.748226 13887 raft_consensus.cc:1217] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:44.775558 13887 raft_consensus.cc:1217] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:44.803296 13887 raft_consensus.cc:1217] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:44.972764 13887 raft_consensus.cc:1217] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:45.222106 13917 raft_consensus.cc:1064] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:45.224186 13917 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:45.230212 13280 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.231395 13887 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.232221 14066 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:45.234498 14066 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:45.234916 13137 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.242722 13917 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:45.258019 14066 raft_consensus.cc:2955] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.265185 13885 raft_consensus.cc:2955] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.269500 13280 raft_consensus.cc:2955] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.270202 13137 raft_consensus.cc:2955] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.284399 13035 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.361596 13204 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:45.369743 13885 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:45.371212 13280 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:45.372254 14080 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:45.373230 14105 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:45.383001 14066 raft_consensus.cc:2955] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.384613 13885 raft_consensus.cc:2955] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.392398 13917 raft_consensus.cc:1064] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:45.394783 13917 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:45.396484 13280 raft_consensus.cc:2955] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.409199 13022 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 35e9975f4caa4eb7be07cf7ee3aed8b3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:45.426258 14100 raft_consensus.cc:1064] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:45.428972 14100 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:45.429600 13887 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.431027 14105 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:45.434185 13286 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.437376 14080 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:45.438280 14072 raft_consensus.cc:1064] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:45.414554 13032 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.449007 13135 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.456899 13917 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:45.465190 13204 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.467657 13887 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.468410 14069 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:45.470372 14069 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:45.474783 14072 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:45.480180 13137 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.481065 14080 raft_consensus.cc:2955] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.483417 14115 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:45.483676 13887 raft_consensus.cc:2955] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.487488 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet 35e9975f4caa4eb7be07cf7ee3aed8b3 with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58700
I20260709 12:18:45.515992 13135 raft_consensus.cc:2955] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.519416 13280 raft_consensus.cc:2955] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.529726 13034 catalog_manager.cc:5697] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.539340 13132 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.540736 13207 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.540998 14122 tablet_replica.cc:333] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:18:45.542063 14122 raft_consensus.cc:2243] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.544168 13886 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:45.545426 14122 raft_consensus.cc:2272] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.548403 14115 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:45.553464 14122 ts_tablet_manager.cc:1916] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:45.549341 14072 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:18:45.560789 14069 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:18:45.564929 13207 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:45.592495 13135 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:45.597014 13885 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:45.598407 13917 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:45.604046 14100 raft_consensus.cc:2955] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.608515 13204 raft_consensus.cc:2955] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.611182 14122 ts_tablet_manager.cc:1929] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:45.611785 14122 log.cc:1199] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/35e9975f4caa4eb7be07cf7ee3aed8b3
I20260709 12:18:45.613234 14105 raft_consensus.cc:2955] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.614933 13135 raft_consensus.cc:2955] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:18:45.616778 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 59525.2us
I20260709 12:18:45.631840 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet 35e9975f4caa4eb7be07cf7ee3aed8b3 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:45.635135 13032 catalog_manager.cc:5697] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.637356 13022 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b675043435441bb980d9a219c4d3450 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:45.646085 13886 raft_consensus.cc:2955] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.649037 13135 raft_consensus.cc:2955] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.657015 13035 catalog_manager.cc:5697] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:45.660703 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b675043435441bb980d9a219c4d3450 with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38630
I20260709 12:18:45.669209 14066 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:45.678417 14127 raft_consensus.cc:2955] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.688525 13885 raft_consensus.cc:2955] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.697862 13281 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:45.674618 13886 raft_consensus.cc:2955] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.729849 13887 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:45.731712 13135 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:45.737434 14131 tablet_replica.cc:333] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:18:45.739207 13135 raft_consensus.cc:2955] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.740866 13212 raft_consensus.cc:2955] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.743636 14100 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:45.750098 14100 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:45.742097 14131 raft_consensus.cc:2243] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.760234 14131 raft_consensus.cc:2272] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.771590 13032 catalog_manager.cc:5697] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.778366 14100 raft_consensus.cc:2955] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.781380 13886 raft_consensus.cc:2955] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.795676 13135 raft_consensus.cc:2955] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.800798 14131 ts_tablet_manager.cc:1916] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:45.821862 13032 catalog_manager.cc:5697] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.814087 13021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f7a6bb73699404e86b7d94b6633703c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:45.830364 13280 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:45.835052 14131 ts_tablet_manager.cc:1929] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:45.835680 14131 log.cc:1199] T 6b675043435441bb980d9a219c4d3450 P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/6b675043435441bb980d9a219c4d3450
I20260709 12:18:45.840204 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet 6b675043435441bb980d9a219c4d3450 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:45.845902 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f7a6bb73699404e86b7d94b6633703c with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46516
I20260709 12:18:45.857762 14132 tablet_replica.cc:333] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:18:45.858937 14132 raft_consensus.cc:2243] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.859736 14132 raft_consensus.cc:2272] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.865705 14132 ts_tablet_manager.cc:1916] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:45.866514 13885 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:45.869350 13204 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:45.870481 14069 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:45.871625 14100 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:45.878028 14069 raft_consensus.cc:2955] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.881572 13885 raft_consensus.cc:2955] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.883004 13204 raft_consensus.cc:2955] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.888027 14132 ts_tablet_manager.cc:1929] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:45.888587 14132 log.cc:1199] T 2f7a6bb73699404e86b7d94b6633703c P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/2f7a6bb73699404e86b7d94b6633703c
I20260709 12:18:45.890172 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet 2f7a6bb73699404e86b7d94b6633703c (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:45.900727 13032 catalog_manager.cc:5697] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:45.903505 13021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c8df593339524328b819bd096f86f17d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:45.912384 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet c8df593339524328b819bd096f86f17d with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58700
I20260709 12:18:45.913370 14122 tablet_replica.cc:333] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:18:45.914453 14122 raft_consensus.cc:2243] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:45.915082 14122 raft_consensus.cc:2272] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:45.918627 14122 ts_tablet_manager.cc:1916] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:45.933915 14122 ts_tablet_manager.cc:1929] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:45.934365 14122 log.cc:1199] T c8df593339524328b819bd096f86f17d P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/c8df593339524328b819bd096f86f17d
I20260709 12:18:45.935890 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet c8df593339524328b819bd096f86f17d (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:46.999950 13135 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.006703 13286 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:47.006703 13100 consensus_peers.cc:597] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f369b73ff12847ccbbb00601fe431eb4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:47.007967 13212 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:47.008106 14113 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:47.009392 14133 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:47.017185 14113 raft_consensus.cc:2955] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.018838 13286 raft_consensus.cc:2955] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.018597 13212 raft_consensus.cc:2955] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.034394 13035 catalog_manager.cc:5697] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.047381 13132 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.067086 13286 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:47.069072 13100 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f2a264a18f24b6b9933300ddcde0f4e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:47.072485 14143 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:18:47.075183 13212 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:47.077448 14143 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:47.087651 14088 raft_consensus.cc:2955] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.088532 13281 raft_consensus.cc:2955] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.092412 13212 raft_consensus.cc:2955] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.112372 13204 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.119736 13032 catalog_manager.cc:5697] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.124447 13286 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:47.125293 13175 consensus_peers.cc:597] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96956ab507b74b29b91a4c067585d07f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:47.125921 13917 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:47.126286 13132 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:47.135823 14134 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:47.152130 13917 raft_consensus.cc:2955] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.154425 13135 raft_consensus.cc:2955] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.156059 13281 raft_consensus.cc:2955] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.170393 13281 consensus_queue.cc:237] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.173692 13035 catalog_manager.cc:5697] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:47.182020 13249 consensus_peers.cc:597] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5372f0f4e82241658d5d891336a8b6d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:47.182348 13135 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:47.184074 13212 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:47.184406 14121 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:47.185796 14148 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:47.195924 14121 raft_consensus.cc:2955] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.199015 13135 raft_consensus.cc:2955] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.203169 13204 raft_consensus.cc:2955] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:47.213970 13031 catalog_manager.cc:5697] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.464361 14155 ts_tablet_manager.cc:933] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:47.466183 14155 tablet_copy_client.cc:323] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:47.467936 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet 6f2a264a18f24b6b9933300ddcde0f4e from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:47.468564 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet 6f2a264a18f24b6b9933300ddcde0f4e from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-6f2a264a18f24b6b9933300ddcde0f4e
I20260709 12:18:47.477607 13147 tablet_copy_source_session.cc:215] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:47.480898 14155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2a264a18f24b6b9933300ddcde0f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:47.497481 14155 tablet_copy_client.cc:806] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:47.498193 14155 tablet_copy_client.cc:670] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:47.505169 14155 tablet_copy_client.cc:538] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:47.514001 14155 tablet_bootstrap.cc:492] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:47.531754 14155 tablet_bootstrap.cc:492] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:47.532477 14155 tablet_bootstrap.cc:492] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:47.534686 14155 ts_tablet_manager.cc:1403] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.000s
I20260709 12:18:47.537674 14155 raft_consensus.cc:359] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.538589 14155 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:47.539223 14155 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.542721 14155 ts_tablet_manager.cc:1434] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:18:47.544945 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-6f2a264a18f24b6b9933300ddcde0f4e received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:47.545396 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-6f2a264a18f24b6b9933300ddcde0f4e on tablet 6f2a264a18f24b6b9933300ddcde0f4e with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:47.549437 14155 ts_tablet_manager.cc:933] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:47.584987 14159 ts_tablet_manager.cc:933] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:47.632319 14159 tablet_copy_client.cc:323] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.3:35631
I20260709 12:18:47.634269 13296 tablet_copy_service.cc:140] P b190224a708b4f068a6dda4006c3a133: Received BeginTabletCopySession request for tablet 5372f0f4e82241658d5d891336a8b6d4 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:42730)
I20260709 12:18:47.634889 13296 tablet_copy_service.cc:161] P b190224a708b4f068a6dda4006c3a133: Beginning new tablet copy session on tablet 5372f0f4e82241658d5d891336a8b6d4 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:42730: session id = cbc6af7757ec459ab451e47724fdf44b-5372f0f4e82241658d5d891336a8b6d4
I20260709 12:18:47.635923 14155 tablet_copy_client.cc:323] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:47.637660 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet f369b73ff12847ccbbb00601fe431eb4 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:47.638185 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet f369b73ff12847ccbbb00601fe431eb4 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-f369b73ff12847ccbbb00601fe431eb4
I20260709 12:18:47.641134 13296 tablet_copy_source_session.cc:215] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:47.644047 14159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5372f0f4e82241658d5d891336a8b6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:47.645653 13147 tablet_copy_source_session.cc:215] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:47.648795 14155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f369b73ff12847ccbbb00601fe431eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:47.659818 14159 tablet_copy_client.cc:806] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:47.660461 14159 tablet_copy_client.cc:670] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:47.665593 14155 tablet_copy_client.cc:806] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:47.666164 14155 tablet_copy_client.cc:670] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:47.681463 14159 tablet_copy_client.cc:538] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:47.686836 14155 tablet_copy_client.cc:538] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:47.691902 14159 tablet_bootstrap.cc:492] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:47.703528 14155 tablet_bootstrap.cc:492] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:47.722463 14159 tablet_bootstrap.cc:492] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:47.723409 14159 tablet_bootstrap.cc:492] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:47.724220 14159 ts_tablet_manager.cc:1403] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.033s	user 0.025s	sys 0.003s
I20260709 12:18:47.726799 14159 raft_consensus.cc:359] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.727437 14159 raft_consensus.cc:740] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:47.728137 14159 consensus_queue.cc:260] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.732999 14159 ts_tablet_manager.cc:1434] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:18:47.736097 13296 tablet_copy_service.cc:342] P b190224a708b4f068a6dda4006c3a133: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-5372f0f4e82241658d5d891336a8b6d4 received from {username='slave'} at 127.0.0.1:42730
I20260709 12:18:47.736508 13296 tablet_copy_service.cc:434] P b190224a708b4f068a6dda4006c3a133: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-5372f0f4e82241658d5d891336a8b6d4 on tablet 5372f0f4e82241658d5d891336a8b6d4 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:47.744880 14159 ts_tablet_manager.cc:933] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:47.750021 14159 tablet_copy_client.cc:323] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:18:47.751852 13222 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet 96956ab507b74b29b91a4c067585d07f from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:18:47.752399 13222 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet 96956ab507b74b29b91a4c067585d07f from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-96956ab507b74b29b91a4c067585d07f
I20260709 12:18:47.761716 13222 tablet_copy_source_session.cc:215] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:47.766191 14159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96956ab507b74b29b91a4c067585d07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:47.768306 14155 tablet_bootstrap.cc:492] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:47.769663 14155 tablet_bootstrap.cc:492] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:47.770337 14155 ts_tablet_manager.cc:1403] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.018s
I20260709 12:18:47.773344 14155 raft_consensus.cc:359] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.774982 14155 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:47.775684 14155 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.779583 14155 ts_tablet_manager.cc:1434] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:18:47.781610 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-f369b73ff12847ccbbb00601fe431eb4 received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:47.782106 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-f369b73ff12847ccbbb00601fe431eb4 on tablet f369b73ff12847ccbbb00601fe431eb4 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:47.785146 14159 tablet_copy_client.cc:806] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:47.785748 14159 tablet_copy_client.cc:670] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:47.789737 14159 tablet_copy_client.cc:538] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:47.795953 14159 tablet_bootstrap.cc:492] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:47.813090 14159 tablet_bootstrap.cc:492] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:47.813787 14159 tablet_bootstrap.cc:492] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:47.814353 14159 ts_tablet_manager.cc:1403] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:18:47.816936 14159 raft_consensus.cc:359] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.817631 14159 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:47.818130 14159 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:47.820431 14159 ts_tablet_manager.cc:1434] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:18:47.822567 13222 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-96956ab507b74b29b91a4c067585d07f received from {username='slave'} at 127.0.0.1:36412
I20260709 12:18:47.822929 13222 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-96956ab507b74b29b91a4c067585d07f on tablet 96956ab507b74b29b91a4c067585d07f with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:47.960258 13885 raft_consensus.cc:1217] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:47.970045 13886 raft_consensus.cc:1217] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:48.040232 13885 raft_consensus.cc:1217] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:48.310060 13885 raft_consensus.cc:1217] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:48.477478 14121 raft_consensus.cc:1064] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:48.481098 14121 consensus_queue.cc:237] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:48.498054 13204 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.499406 13135 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.499459 13885 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.500566 14121 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:48.501442 14154 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:48.503162 14148 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:48.524919 14148 raft_consensus.cc:2955] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.526561 13135 raft_consensus.cc:2955] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.529517 13212 raft_consensus.cc:2955] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.540673 13886 raft_consensus.cc:2955] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.549226 14143 raft_consensus.cc:1064] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:48.550359 13031 catalog_manager.cc:5697] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.552690 14143 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:48.582798 13281 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.590903 14043 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:48.593421 14043 raft_consensus.cc:1064] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:48.595778 14043 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:48.602082 13886 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.604167 14113 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:48.611680 13204 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.613744 14177 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:48.616107 13885 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.616609 13280 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.618175 14177 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:48.619483 14143 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:48.620472 13204 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.623274 14113 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:48.623674 14143 raft_consensus.cc:2955] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.627383 13886 raft_consensus.cc:2955] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.641363 13277 raft_consensus.cc:2955] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.692770 14177 raft_consensus.cc:2955] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.696635 13885 raft_consensus.cc:2955] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.709197 13280 consensus_queue.cc:237] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:48.708848 13212 raft_consensus.cc:2955] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.711227 13031 catalog_manager.cc:5697] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.729033 13207 raft_consensus.cc:2955] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.746870 13886 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:48.749496 13207 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:48.754524 14172 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:48.759292 13135 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:48.754637 13277 raft_consensus.cc:2955] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.766449 13886 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:48.768110 14177 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:48.775928 13280 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:48.778435 14113 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:48.779968 13031 catalog_manager.cc:5697] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.756891 14172 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:18:48.787715 14121 raft_consensus.cc:2955] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.789672 13212 raft_consensus.cc:2955] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.792917 13886 raft_consensus.cc:2955] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.800585 13887 raft_consensus.cc:2955] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.814112 14043 raft_consensus.cc:2955] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.833488 13021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5372f0f4e82241658d5d891336a8b6d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:48.846469 13031 catalog_manager.cc:5697] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.865881 13280 raft_consensus.cc:2955] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:18:48.874650 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 63815us
I20260709 12:18:48.875731 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f2a264a18f24b6b9933300ddcde0f4e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:48.882154 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet 5372f0f4e82241658d5d891336a8b6d4 with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58700
I20260709 12:18:48.889725 13917 raft_consensus.cc:1064] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:48.890690 13135 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:48.892417 14191 tablet_replica.cc:333] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:18:48.893494 14191 raft_consensus.cc:2243] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:48.894217 14191 raft_consensus.cc:2272] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:48.898552 13204 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:48.894558 13917 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:48.900991 13886 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:48.904656 14143 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:48.907262 14143 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:48.912060 14191 ts_tablet_manager.cc:1916] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:48.916143 14113 raft_consensus.cc:2955] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.922871 13132 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.926618 13886 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.926684 13032 catalog_manager.cc:5697] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.929409 13917 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:48.931083 13917 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:48.930238 13887 raft_consensus.cc:2955] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.917189 13204 raft_consensus.cc:2955] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.947670 13280 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:48.951759 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f369b73ff12847ccbbb00601fe431eb4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:48.952564 14190 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:48.956089 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2a264a18f24b6b9933300ddcde0f4e with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46516
I20260709 12:18:48.965237 14195 tablet_replica.cc:333] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:18:48.971747 13032 catalog_manager.cc:5697] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.977525 14167 raft_consensus.cc:2955] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.989137 13286 raft_consensus.cc:2955] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:48.978812 14191 ts_tablet_manager.cc:1929] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:48.980809 14195 raft_consensus.cc:2243] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.001349 14195 raft_consensus.cc:2272] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.002214 14191 log.cc:1199] T 5372f0f4e82241658d5d891336a8b6d4 P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/5372f0f4e82241658d5d891336a8b6d4
I20260709 12:18:49.008911 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet 5372f0f4e82241658d5d891336a8b6d4 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:49.005268 14195 ts_tablet_manager.cc:1916] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:49.021895 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet f369b73ff12847ccbbb00601fe431eb4 with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38630
I20260709 12:18:49.042709 13887 raft_consensus.cc:2955] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:49.065171 13031 catalog_manager.cc:5697] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:49.086910 14200 tablet_replica.cc:333] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:18:49.088665 14200 raft_consensus.cc:2243] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.093912 14200 raft_consensus.cc:2272] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.094581 13135 raft_consensus.cc:2955] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:49.098539 14200 ts_tablet_manager.cc:1916] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:49.113054 13207 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:49.117594 14195 ts_tablet_manager.cc:1929] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:49.118170 14195 log.cc:1199] T 6f2a264a18f24b6b9933300ddcde0f4e P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/6f2a264a18f24b6b9933300ddcde0f4e
I20260709 12:18:49.119830 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet 6f2a264a18f24b6b9933300ddcde0f4e (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:49.125533 13887 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:49.127020 14167 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:49.132300 13286 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:49.133141 13917 raft_consensus.cc:2955] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:49.136775 14198 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:49.139504 14200 ts_tablet_manager.cc:1929] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:49.139992 14200 log.cc:1199] T f369b73ff12847ccbbb00601fe431eb4 P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/f369b73ff12847ccbbb00601fe431eb4
I20260709 12:18:49.142180 13022 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 96956ab507b74b29b91a4c067585d07f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:49.143627 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet f369b73ff12847ccbbb00601fe431eb4 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:49.142971 13286 raft_consensus.cc:2955] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:49.147831 13887 raft_consensus.cc:2955] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:49.151153 13035 catalog_manager.cc:5697] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:49.163494 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet 96956ab507b74b29b91a4c067585d07f with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58700
I20260709 12:18:49.164448 14191 tablet_replica.cc:333] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:18:49.165469 14191 raft_consensus.cc:2243] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.166123 14191 raft_consensus.cc:2272] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.169080 14191 ts_tablet_manager.cc:1916] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:49.182538 14191 ts_tablet_manager.cc:1929] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:49.182865 14191 log.cc:1199] T 96956ab507b74b29b91a4c067585d07f P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/96956ab507b74b29b91a4c067585d07f
I20260709 12:18:49.184298 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet 96956ab507b74b29b91a4c067585d07f (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:50.242053 13135 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:18:50.250805 13100 consensus_peers.cc:597] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fb24dc556e54ae2bb5b9d6900ea82f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:50.252632 13212 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:50.253134 13280 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:50.254132 14204 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:50.255347 14113 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:50.264058 14204 raft_consensus.cc:2955] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.265950 13280 raft_consensus.cc:2955] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.265748 13212 raft_consensus.cc:2955] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.284469 13135 consensus_queue.cc:237] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:50.291115 13032 catalog_manager.cc:5697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.317490 13280 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:50.317829 13100 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1505ff0869734d74a99b739df5b0530a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:50.318487 13209 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:50.319154 14203 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:50.320169 14204 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:50.333019 14113 raft_consensus.cc:2955] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.337208 13286 raft_consensus.cc:2955] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.342388 13209 raft_consensus.cc:2955] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.354960 13135 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:50.364363 13209 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:50.364737 13100 consensus_peers.cc:597] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c7b93f2b99d4c27915adea1f987deff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:50.366096 14113 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:50.366591 13286 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:50.373942 14113 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:50.384680 13035 catalog_manager.cc:5697] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.398731 14113 raft_consensus.cc:2955] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.402486 13209 raft_consensus.cc:2955] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.408116 13280 raft_consensus.cc:2955] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.418123 13032 catalog_manager.cc:5697] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.421060 13212 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:50.435241 13280 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:50.436616 14197 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:18:50.440248 13175 consensus_peers.cc:597] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75e2a455a56d445bb7942e9f0b3f7f49. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:50.441892 13135 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:50.444535 14198 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:50.457086 14197 raft_consensus.cc:2955] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.459447 13132 raft_consensus.cc:2955] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.462397 13280 raft_consensus.cc:2955] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.477273 13031 catalog_manager.cc:5697] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:50.837256 14222 ts_tablet_manager.cc:933] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:50.839331 14222 tablet_copy_client.cc:323] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:50.841930 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet 3fb24dc556e54ae2bb5b9d6900ea82f5 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:50.842559 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet 3fb24dc556e54ae2bb5b9d6900ea82f5 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-3fb24dc556e54ae2bb5b9d6900ea82f5
I20260709 12:18:50.851096 13147 tablet_copy_source_session.cc:215] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:50.855237 14222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb24dc556e54ae2bb5b9d6900ea82f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.873340 14222 tablet_copy_client.cc:806] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:50.874058 14222 tablet_copy_client.cc:670] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:50.876581 14224 ts_tablet_manager.cc:933] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:50.878568 14222 tablet_copy_client.cc:538] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:50.879815 14224 tablet_copy_client.cc:323] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:18:50.882277 13222 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet 75e2a455a56d445bb7942e9f0b3f7f49 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:18:50.882810 13222 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet 75e2a455a56d445bb7942e9f0b3f7f49 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-75e2a455a56d445bb7942e9f0b3f7f49
I20260709 12:18:50.891863 14222 tablet_bootstrap.cc:492] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:50.896554 13222 tablet_copy_source_session.cc:215] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:50.898761 14226 ts_tablet_manager.cc:933] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:50.908103 14224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e2a455a56d445bb7942e9f0b3f7f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.932183 14226 tablet_copy_client.cc:323] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:50.933959 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet 1505ff0869734d74a99b739df5b0530a from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:50.934482 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet 1505ff0869734d74a99b739df5b0530a from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-1505ff0869734d74a99b739df5b0530a
I20260709 12:18:50.941953 14222 tablet_bootstrap.cc:492] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:50.942301 13147 tablet_copy_source_session.cc:215] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:50.942955 14222 tablet_bootstrap.cc:492] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:50.943717 14222 ts_tablet_manager.cc:1403] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.015s
I20260709 12:18:50.947008 14222 raft_consensus.cc:359] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:50.947860 14222 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:50.948550 14222 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:50.952075 14222 ts_tablet_manager.cc:1434] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:18:50.952744 14224 tablet_copy_client.cc:806] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:50.954272 14224 tablet_copy_client.cc:670] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:50.954419 14226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1505ff0869734d74a99b739df5b0530a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.959765 14224 tablet_copy_client.cc:538] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:50.963696 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-3fb24dc556e54ae2bb5b9d6900ea82f5 received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:50.964275 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-3fb24dc556e54ae2bb5b9d6900ea82f5 on tablet 3fb24dc556e54ae2bb5b9d6900ea82f5 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:50.967356 14222 ts_tablet_manager.cc:933] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:50.973371 14226 tablet_copy_client.cc:806] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:50.974254 14226 tablet_copy_client.cc:670] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:50.977628 14222 tablet_copy_client.cc:323] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:50.979400 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet 1c7b93f2b99d4c27915adea1f987deff from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:50.979920 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet 1c7b93f2b99d4c27915adea1f987deff from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-1c7b93f2b99d4c27915adea1f987deff
I20260709 12:18:50.980156 14226 tablet_copy_client.cc:538] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:51.002199 14224 tablet_bootstrap.cc:492] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:51.005702 14226 tablet_bootstrap.cc:492] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:51.010789 13147 tablet_copy_source_session.cc:215] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:51.093040 14224 tablet_bootstrap.cc:492] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:51.099980 14224 tablet_bootstrap.cc:492] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:51.100978 14224 ts_tablet_manager.cc:1403] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.017s
I20260709 12:18:51.104408 14224 raft_consensus.cc:359] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:51.105638 14224 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:51.106657 14224 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:51.110205 14224 ts_tablet_manager.cc:1434] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:18:51.113235 13222 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-75e2a455a56d445bb7942e9f0b3f7f49 received from {username='slave'} at 127.0.0.1:36412
I20260709 12:18:51.113840 13222 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-75e2a455a56d445bb7942e9f0b3f7f49 on tablet 75e2a455a56d445bb7942e9f0b3f7f49 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:51.144387 14222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7b93f2b99d4c27915adea1f987deff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.163148 14222 tablet_copy_client.cc:806] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:51.163843 14222 tablet_copy_client.cc:670] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:51.164122 14226 tablet_bootstrap.cc:492] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:51.165846 14226 tablet_bootstrap.cc:492] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:51.166548 14226 ts_tablet_manager.cc:1403] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.161s	user 0.081s	sys 0.065s
I20260709 12:18:51.167842 14222 tablet_copy_client.cc:538] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:51.169683 14226 raft_consensus.cc:359] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:51.170583 14226 raft_consensus.cc:740] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:51.171219 14226 consensus_queue.cc:260] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:51.173659 14226 ts_tablet_manager.cc:1434] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:18:51.175274 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-1505ff0869734d74a99b739df5b0530a received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:51.175707 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-1505ff0869734d74a99b739df5b0530a on tablet 1505ff0869734d74a99b739df5b0530a with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:51.178936 14222 tablet_bootstrap.cc:492] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:51.206473 14222 tablet_bootstrap.cc:492] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:51.207193 14222 tablet_bootstrap.cc:492] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:51.207760 14222 ts_tablet_manager.cc:1403] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.004s
I20260709 12:18:51.209880 14222 raft_consensus.cc:359] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:51.210469 14222 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:51.211071 14222 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:51.213689 14222 ts_tablet_manager.cc:1434] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:18:51.215880 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-1c7b93f2b99d4c27915adea1f987deff received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:51.216286 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-1c7b93f2b99d4c27915adea1f987deff on tablet 1c7b93f2b99d4c27915adea1f987deff with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:51.283777 13886 raft_consensus.cc:1217] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:51.357270 13886 raft_consensus.cc:1217] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:51.368600 13886 raft_consensus.cc:1217] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:51.439684 13887 raft_consensus.cc:1217] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:51.772111 14189 raft_consensus.cc:1064] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:51.774782 14189 consensus_queue.cc:237] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:51.784825 13887 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:51.786383 14204 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:51.786695 13280 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:51.786691 13212 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:51.788504 14113 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:51.789317 14204 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:51.808116 14113 raft_consensus.cc:2955] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:51.809988 13280 raft_consensus.cc:2955] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:51.811079 13887 raft_consensus.cc:2955] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:51.828249 13032 catalog_manager.cc:5697] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:51.841266 13212 raft_consensus.cc:2955] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:51.855571 14113 raft_consensus.cc:1064] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:51.857734 14113 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:51.881279 14189 raft_consensus.cc:1064] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:51.883133 14189 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:51.902117 13280 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:51.902117 13886 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:51.903648 14189 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:51.905761 14240 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:51.906157 13212 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:51.909511 14240 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:51.911150 13286 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:51.913798 13887 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:51.915130 14113 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:51.920800 13209 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:51.924402 14240 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:51.926241 13135 consensus_queue.cc:237] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:51.927518 14113 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:51.944746 13209 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:51.946904 14240 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:51.952554 13885 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:51.954792 14113 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:51.964108 14204 raft_consensus.cc:2955] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:51.972729 14219 raft_consensus.cc:1064] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:51.977289 14219 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:51.987039 13885 raft_consensus.cc:2955] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:51.997578 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1505ff0869734d74a99b739df5b0530a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:52.005946 13280 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:52.018647 14258 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:18:52.015976 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49427.5us
I20260709 12:18:52.023046 13212 raft_consensus.cc:2955] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.027021 14240 raft_consensus.cc:2955] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.029951 13034 catalog_manager.cc:5697] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.037818 14254 raft_consensus.cc:2955] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.040861 13282 raft_consensus.cc:2955] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.044571 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet 1505ff0869734d74a99b739df5b0530a with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38630
I20260709 12:18:52.048300 13885 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:52.056880 14263 tablet_replica.cc:333] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:18:52.059659 14260 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:52.060954 13884 raft_consensus.cc:2955] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.074919 13209 raft_consensus.cc:2955] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.082012 13135 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:52.083590 14259 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:52.104321 13032 catalog_manager.cc:5697] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.106026 14263 raft_consensus.cc:2243] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.106876 14263 raft_consensus.cc:2272] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:52.105333 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 97911.4us
I20260709 12:18:52.109184 13034 catalog_manager.cc:5697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.112877 13887 raft_consensus.cc:2955] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.123898 13282 raft_consensus.cc:2955] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.135761 14263 ts_tablet_manager.cc:1916] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:52.152823 13207 raft_consensus.cc:2955] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.159998 13286 raft_consensus.cc:2955] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.161567 14257 raft_consensus.cc:2955] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.164566 14263 ts_tablet_manager.cc:1929] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:52.194126 13132 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:52.198487 13035 catalog_manager.cc:5697] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.199064 13887 raft_consensus.cc:2955] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.206869 14263 log.cc:1199] T 1505ff0869734d74a99b739df5b0530a P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/1505ff0869734d74a99b739df5b0530a
I20260709 12:18:52.210108 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet 1505ff0869734d74a99b739df5b0530a (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:52.198101 13135 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:52.211998 13886 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:52.215271 14262 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:52.226161 13286 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:52.224871 13212 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:52.228144 14254 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:52.230161 14241 raft_consensus.cc:2955] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.237397 13884 raft_consensus.cc:2955] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.262938 13887 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:52.264389 13132 raft_consensus.cc:2955] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.277251 14189 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:52.280121 14189 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:52.287741 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3fb24dc556e54ae2bb5b9d6900ea82f5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:52.292323 13207 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:52.292927 13277 raft_consensus.cc:2955] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.293476 14262 raft_consensus.cc:2955] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.302970 13886 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:52.298071 13207 raft_consensus.cc:2955] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.306907 14259 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:52.315095 13286 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:52.318411 14257 raft_consensus.cc:2955] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.323936 14259 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:52.310473 13886 raft_consensus.cc:2955] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.321841 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1c7b93f2b99d4c27915adea1f987deff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:52.321024 13885 raft_consensus.cc:2955] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.333072 13034 catalog_manager.cc:5697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.338845 13022 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75e2a455a56d445bb7942e9f0b3f7f49 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:52.345669 13277 raft_consensus.cc:2955] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.348085 13031 catalog_manager.cc:5697] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.357969 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fb24dc556e54ae2bb5b9d6900ea82f5 with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46516
I20260709 12:18:52.360210 14268 tablet_replica.cc:333] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:18:52.361404 14268 raft_consensus.cc:2243] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.362138 14268 raft_consensus.cc:2272] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.365821 14268 ts_tablet_manager.cc:1916] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:52.375559 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c7b93f2b99d4c27915adea1f987deff with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38630
I20260709 12:18:52.376611 14263 tablet_replica.cc:333] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:18:52.381198 14263 raft_consensus.cc:2243] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.381886 14263 raft_consensus.cc:2272] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.384739 14268 ts_tablet_manager.cc:1929] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:52.385301 14268 log.cc:1199] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/3fb24dc556e54ae2bb5b9d6900ea82f5
I20260709 12:18:52.386663 14263 ts_tablet_manager.cc:1916] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:52.390184 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet 3fb24dc556e54ae2bb5b9d6900ea82f5 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:52.393954 13032 catalog_manager.cc:5697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:52.414085 14263 ts_tablet_manager.cc:1929] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:52.414465 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet 75e2a455a56d445bb7942e9f0b3f7f49 with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58700
I20260709 12:18:52.416801 14269 tablet_replica.cc:333] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:18:52.414577 14263 log.cc:1199] T 1c7b93f2b99d4c27915adea1f987deff P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/1c7b93f2b99d4c27915adea1f987deff
I20260709 12:18:52.419572 14269 raft_consensus.cc:2243] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.419615 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet 1c7b93f2b99d4c27915adea1f987deff (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:52.420298 14269 raft_consensus.cc:2272] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.422489 14269 ts_tablet_manager.cc:1916] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:52.433303 14269 ts_tablet_manager.cc:1929] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:52.433665 14269 log.cc:1199] T 75e2a455a56d445bb7942e9f0b3f7f49 P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/75e2a455a56d445bb7942e9f0b3f7f49
I20260709 12:18:52.435055 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet 75e2a455a56d445bb7942e9f0b3f7f49 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:53.479966 13277 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:53.488590 13135 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:53.488678 13207 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:53.489452 13249 consensus_peers.cc:597] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2ad0088ea4e4b988f1c76b3260f2b55. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:53.490422 14265 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:53.491806 14270 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.500845 14121 raft_consensus.cc:2955] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.502225 13212 raft_consensus.cc:2955] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.515574 13132 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:53.515951 13135 raft_consensus.cc:2955] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.526332 13031 catalog_manager.cc:5697] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.542968 13277 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:18:53.543143 13100 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 904dfe40ae474e1689d6b8be4e1dba77. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:53.544757 14276 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.546106 13212 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:53.547504 14276 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.554875 14240 raft_consensus.cc:2955] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.557175 13277 raft_consensus.cc:2955] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.579615 13281 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:53.592954 13034 catalog_manager.cc:5697] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.581104 13212 raft_consensus.cc:2955] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
W20260709 12:18:53.607003 13249 consensus_peers.cc:597] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c6b052993424c29a7d49943db353a08. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:53.610072 13207 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:53.611658 13135 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:53.614192 14265 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.615573 14121 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.626535 14265 raft_consensus.cc:2955] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.628355 13212 raft_consensus.cc:2955] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.637117 13135 raft_consensus.cc:2955] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.644434 13132 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:53.648337 13034 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
W20260709 12:18:53.653757 13100 consensus_peers.cc:597] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4b0e40c530c4ec4b4ac3137f7bbe1f2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:53.655589 13277 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:53.657249 13212 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:53.657212 14240 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:53.659603 14276 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.666599 14262 raft_consensus.cc:2955] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.668458 13277 raft_consensus.cc:2955] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.684226 13212 raft_consensus.cc:2955] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:53.703001 13034 catalog_manager.cc:5697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:54.143460 14289 ts_tablet_manager.cc:933] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:54.164213 14289 tablet_copy_client.cc:323] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.3:35631
I20260709 12:18:54.350075 14297 ts_tablet_manager.cc:933] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:54.361351 13296 tablet_copy_service.cc:140] P b190224a708b4f068a6dda4006c3a133: Received BeginTabletCopySession request for tablet f2ad0088ea4e4b988f1c76b3260f2b55 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:42730)
I20260709 12:18:54.362164 13296 tablet_copy_service.cc:161] P b190224a708b4f068a6dda4006c3a133: Beginning new tablet copy session on tablet f2ad0088ea4e4b988f1c76b3260f2b55 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:42730: session id = cbc6af7757ec459ab451e47724fdf44b-f2ad0088ea4e4b988f1c76b3260f2b55
I20260709 12:18:54.370973 14301 ts_tablet_manager.cc:933] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:54.377400 14297 tablet_copy_client.cc:323] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:54.377861 13296 tablet_copy_source_session.cc:215] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:54.379357 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:54.379896 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-f4b0e40c530c4ec4b4ac3137f7bbe1f2
I20260709 12:18:54.382998 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ad0088ea4e4b988f1c76b3260f2b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:54.388409 13147 tablet_copy_source_session.cc:215] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:54.385118 14295 ts_tablet_manager.cc:933] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:54.393244 14297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:54.395972 14301 tablet_copy_client.cc:323] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:54.399180 14295 tablet_copy_client.cc:323] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.3:35631
I20260709 12:18:54.400394 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet 904dfe40ae474e1689d6b8be4e1dba77 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:54.403738 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet 904dfe40ae474e1689d6b8be4e1dba77 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-904dfe40ae474e1689d6b8be4e1dba77
I20260709 12:18:54.404553 13296 tablet_copy_service.cc:140] P b190224a708b4f068a6dda4006c3a133: Received BeginTabletCopySession request for tablet 4c6b052993424c29a7d49943db353a08 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:42730)
I20260709 12:18:54.405097 13296 tablet_copy_service.cc:161] P b190224a708b4f068a6dda4006c3a133: Beginning new tablet copy session on tablet 4c6b052993424c29a7d49943db353a08 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:42730: session id = cbc6af7757ec459ab451e47724fdf44b-4c6b052993424c29a7d49943db353a08
I20260709 12:18:54.410267 14289 tablet_copy_client.cc:806] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:54.418160 14289 tablet_copy_client.cc:670] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:54.413394 13147 tablet_copy_source_session.cc:215] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:54.413394 13296 tablet_copy_source_session.cc:215] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:54.425064 14301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904dfe40ae474e1689d6b8be4e1dba77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:54.428824 14297 tablet_copy_client.cc:806] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:54.429585 14297 tablet_copy_client.cc:670] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:54.430555 14289 tablet_copy_client.cc:538] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:54.439581 14297 tablet_copy_client.cc:538] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:54.440752 14289 tablet_bootstrap.cc:492] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:54.440793 14295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6b052993424c29a7d49943db353a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:54.454684 14297 tablet_bootstrap.cc:492] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:54.448395 14301 tablet_copy_client.cc:806] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:54.459836 14301 tablet_copy_client.cc:670] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:54.464414 14301 tablet_copy_client.cc:538] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:54.491521 14301 tablet_bootstrap.cc:492] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:54.491876 14295 tablet_copy_client.cc:806] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:54.492559 14295 tablet_copy_client.cc:670] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:54.499675 14295 tablet_copy_client.cc:538] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:54.514392 14289 tablet_bootstrap.cc:492] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:54.521430 14297 tablet_bootstrap.cc:492] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:54.524241 14289 tablet_bootstrap.cc:492] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:54.524502 14297 tablet_bootstrap.cc:492] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:54.525096 14289 ts_tablet_manager.cc:1403] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.008s
I20260709 12:18:54.525275 14297 ts_tablet_manager.cc:1403] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.000s
I20260709 12:18:54.528417 14289 raft_consensus.cc:359] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:54.531045 14295 tablet_bootstrap.cc:492] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:54.529359 14297 raft_consensus.cc:359] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:54.531401 14289 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
W20260709 12:18:54.533632 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 65642.9us
I20260709 12:18:54.540310 14289 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:54.542912 14301 tablet_bootstrap.cc:492] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:54.544081 14301 tablet_bootstrap.cc:492] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:54.544899 14301 ts_tablet_manager.cc:1403] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.010s
I20260709 12:18:54.548843 14301 raft_consensus.cc:359] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:54.549803 14301 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:54.550576 14301 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:54.534826 14297 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:54.561657 14301 ts_tablet_manager.cc:1434] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.008s
I20260709 12:18:54.571023 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-904dfe40ae474e1689d6b8be4e1dba77 received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:54.576046 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-904dfe40ae474e1689d6b8be4e1dba77 on tablet 904dfe40ae474e1689d6b8be4e1dba77 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:54.577512 14297 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:54.591539 14289 ts_tablet_manager.cc:1434] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.008s
I20260709 12:18:54.592859 14297 ts_tablet_manager.cc:1434] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.002s
I20260709 12:18:54.599674 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-f4b0e40c530c4ec4b4ac3137f7bbe1f2 received from {username='slave'} at 127.0.0.1:60854
I20260709 12:18:54.599974 13296 tablet_copy_service.cc:342] P b190224a708b4f068a6dda4006c3a133: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-f2ad0088ea4e4b988f1c76b3260f2b55 received from {username='slave'} at 127.0.0.1:42730
I20260709 12:18:54.600175 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-f4b0e40c530c4ec4b4ac3137f7bbe1f2 on tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:54.600461 13296 tablet_copy_service.cc:434] P b190224a708b4f068a6dda4006c3a133: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-f2ad0088ea4e4b988f1c76b3260f2b55 on tablet f2ad0088ea4e4b988f1c76b3260f2b55 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:54.604815 14295 tablet_bootstrap.cc:492] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:54.605602 14295 tablet_bootstrap.cc:492] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:54.606169 14295 ts_tablet_manager.cc:1403] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.007s
I20260709 12:18:54.609122 14295 raft_consensus.cc:359] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:54.610011 14295 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:54.610695 14295 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:54.612857 14295 ts_tablet_manager.cc:1434] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:18:54.614907 13296 tablet_copy_service.cc:342] P b190224a708b4f068a6dda4006c3a133: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-4c6b052993424c29a7d49943db353a08 received from {username='slave'} at 127.0.0.1:42730
I20260709 12:18:54.615329 13296 tablet_copy_service.cc:434] P b190224a708b4f068a6dda4006c3a133: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-4c6b052993424c29a7d49943db353a08 on tablet 4c6b052993424c29a7d49943db353a08 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:54.800197 13883 raft_consensus.cc:1217] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:54.858952 13883 raft_consensus.cc:1217] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:54.927816 13883 raft_consensus.cc:1217] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:54.928679 13887 raft_consensus.cc:1217] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:18:55.171785 13158 debug-util.cc:398] Leaking SignalData structure 0x7b08001a97e0 after lost signal to thread 11919
W20260709 12:18:55.172901 13158 debug-util.cc:398] Leaking SignalData structure 0x7b08001bc4c0 after lost signal to thread 13069
W20260709 12:18:55.174118 13158 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8fa0 after lost signal to thread 13161
W20260709 12:18:55.175225 13158 debug-util.cc:398] Leaking SignalData structure 0x7b0800077480 after lost signal to thread 13236
W20260709 12:18:55.176290 13158 debug-util.cc:398] Leaking SignalData structure 0x7b0800329b20 after lost signal to thread 13310
W20260709 12:18:55.177415 13158 debug-util.cc:398] Leaking SignalData structure 0x7b08002d7020 after lost signal to thread 13911
I20260709 12:18:55.312539 14121 raft_consensus.cc:1064] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:55.314810 14121 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:55.341918 13209 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.344738 14265 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:55.346379 13883 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.349253 14265 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:55.356048 13132 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.364898 14288 raft_consensus.cc:1064] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:55.367388 14288 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:55.404215 14316 raft_consensus.cc:1064] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:55.403985 14270 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:55.407048 14316 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:55.418262 14298 raft_consensus.cc:1064] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:55.421491 14298 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:55.450137 13883 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.451866 14262 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:55.456111 14320 raft_consensus.cc:2955] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.459250 13209 raft_consensus.cc:2955] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.464581 13206 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.464933 13887 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.468039 13135 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.467521 13132 raft_consensus.cc:2955] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.469250 14270 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:55.476279 14270 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:55.478082 14270 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:55.492256 13034 catalog_manager.cc:5697] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.499212 13886 raft_consensus.cc:2955] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.523589 13884 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.527161 14330 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:55.527545 13209 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.531456 13209 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.535343 14293 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:55.536918 13277 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.537325 13282 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:55.539093 14121 raft_consensus.cc:2955] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.533805 14330 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:18:55.554735 14294 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:55.554895 14293 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:55.558403 14316 raft_consensus.cc:2955] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.559083 13887 raft_consensus.cc:2955] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.570072 13135 raft_consensus.cc:2955] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.579712 13209 raft_consensus.cc:2955] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.579804 13883 raft_consensus.cc:2955] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.580534 13206 raft_consensus.cc:2955] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.654265 14262 raft_consensus.cc:2955] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.659408 13282 raft_consensus.cc:2955] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.662159 13283 raft_consensus.cc:2955] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.683866 13282 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:55.692480 13209 raft_consensus.cc:2955] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.698586 13883 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:55.698859 13135 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:55.701470 14328 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:55.706408 14265 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:55.702180 13034 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:55.709751 13034 catalog_manager.cc:5697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.711948 13034 catalog_manager.cc:5697] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.722250 14270 raft_consensus.cc:2955] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.725402 13135 raft_consensus.cc:2955] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.734740 13884 raft_consensus.cc:2955] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.760735 13021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2ad0088ea4e4b988f1c76b3260f2b55 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:55.762714 13135 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:55.774505 13208 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:55.775419 13283 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:55.776177 14262 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:55.783679 13886 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:55.789124 14294 raft_consensus.cc:2955] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.790704 13886 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:55.790243 13208 raft_consensus.cc:2955] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.792992 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:55.796512 14328 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:55.808182 13209 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:55.810256 13886 raft_consensus.cc:2955] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.811899 14265 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:55.809989 13031 catalog_manager.cc:5697] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.818477 13034 catalog_manager.cc:5697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.831833 14330 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:55.834455 14121 raft_consensus.cc:2955] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.840442 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2 with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38630
I20260709 12:18:55.840543 13883 raft_consensus.cc:2955] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.851475 13208 raft_consensus.cc:2955] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.861125 13886 raft_consensus.cc:2955] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.883193 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet f2ad0088ea4e4b988f1c76b3260f2b55 with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46516
I20260709 12:18:55.886704 13132 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:55.896099 13021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4c6b052993424c29a7d49943db353a08 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:55.902448 14340 tablet_replica.cc:333] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:18:55.909332 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:55.911309 14340 raft_consensus.cc:2243] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:55.912178 14340 raft_consensus.cc:2272] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.932771 13034 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:55.937089 13282 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:55.939131 14288 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:55.940678 13884 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:55.942217 14262 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:55.944705 14341 tablet_replica.cc:333] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:18:55.950742 14262 raft_consensus.cc:2955] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.952163 13282 raft_consensus.cc:2955] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.957609 14340 ts_tablet_manager.cc:1916] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:55.956727 13884 raft_consensus.cc:2955] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:55.960619 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c6b052993424c29a7d49943db353a08 with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58700
I20260709 12:18:55.963761 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 904dfe40ae474e1689d6b8be4e1dba77 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:55.964525 14341 raft_consensus.cc:2243] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:55.966557 14341 raft_consensus.cc:2272] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.978025 14341 ts_tablet_manager.cc:1916] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:55.985216 14342 tablet_replica.cc:333] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:18:55.980952 14340 ts_tablet_manager.cc:1929] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:55.997587 14340 log.cc:1199] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/f4b0e40c530c4ec4b4ac3137f7bbe1f2
I20260709 12:18:55.999146 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet f4b0e40c530c4ec4b4ac3137f7bbe1f2 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:55.999416 14342 raft_consensus.cc:2243] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:55.999060 13035 catalog_manager.cc:5697] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:56.000094 14342 raft_consensus.cc:2272] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:56.014981 14342 ts_tablet_manager.cc:1916] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:56.021396 14341 ts_tablet_manager.cc:1929] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:56.022101 14341 log.cc:1199] T f2ad0088ea4e4b988f1c76b3260f2b55 P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/f2ad0088ea4e4b988f1c76b3260f2b55
I20260709 12:18:56.023798 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet f2ad0088ea4e4b988f1c76b3260f2b55 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:56.043841 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet 904dfe40ae474e1689d6b8be4e1dba77 with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46516
I20260709 12:18:56.045257 14341 tablet_replica.cc:333] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:18:56.045464 14342 ts_tablet_manager.cc:1929] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:56.046433 14341 raft_consensus.cc:2243] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:56.047055 14341 raft_consensus.cc:2272] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:56.047912 14342 log.cc:1199] T 4c6b052993424c29a7d49943db353a08 P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/4c6b052993424c29a7d49943db353a08
I20260709 12:18:56.053236 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet 4c6b052993424c29a7d49943db353a08 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:56.053669 14341 ts_tablet_manager.cc:1916] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:56.073979 14341 ts_tablet_manager.cc:1929] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:56.074548 14341 log.cc:1199] T 904dfe40ae474e1689d6b8be4e1dba77 P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/904dfe40ae474e1689d6b8be4e1dba77
I20260709 12:18:56.076992 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet 904dfe40ae474e1689d6b8be4e1dba77 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:18:56.082227 13209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:18:56.082849 13209 raft_consensus.cc:606] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:18:56.085127 13209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:18:56.085548 13209 raft_consensus.cc:606] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:18:56.096783 13132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:56.097406 13132 raft_consensus.cc:606] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:56.100129 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "937887e1967840639df25a74d4e57bfd"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:56.100713 13135 raft_consensus.cc:606] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:18:56.103216 13132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:56.103816 13132 raft_consensus.cc:606] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:18:56.104938 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:56.106483 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:56.107297 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:56.160061 14330 raft_consensus.cc:993] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:56.160640 14330 raft_consensus.cc:1081] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:56.162741 13282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "937887e1967840639df25a74d4e57bfd"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38644
I20260709 12:18:56.167855 14262 raft_consensus.cc:993] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:18:56.178014 14330 raft_consensus.cc:1081] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:18:56.178071 13282 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:56.179968 13282 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.180009 13886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45944
I20260709 12:18:56.180644 13886 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:56.181011 13886 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.187682 13282 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.189848 13282 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:56.190901 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:56.188257 13886 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:56.191669 13132 raft_consensus.cc:3055] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:56.192023 13132 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:56.192808 13132 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.193547 13886 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:56.193902 13132 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.194617 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:56.195200 13209 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.196640 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:56.197242 13208 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.201304 13132 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:56.202806 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:56.203305 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:56.203626 14265 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:56.203979 13135 raft_consensus.cc:3055] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:56.204128 14265 raft_consensus.cc:697] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:56.204331 13135 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:56.205015 14265 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.206277 13209 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:56.205101 13135 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:56.209587 13135 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.219192 13208 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:18:56.226333 13841 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:18:56.227139 14331 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:56.228842 14331 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:18:56.229943 14331 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:56.228828 13135 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:18:56.244042 13035 catalog_manager.cc:5697] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.246317 13034 catalog_manager.cc:5697] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 2 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.382287 14257 raft_consensus.cc:993] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:56.382771 14257 raft_consensus.cc:1081] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:56.384768 13282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:18:56.386821 13282 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:56.387257 13282 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.390276 14330 raft_consensus.cc:993] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:56.390828 14262 raft_consensus.cc:1081] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:56.394034 13277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38644
I20260709 12:18:56.394565 13277 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:56.394934 13277 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.395896 13282 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.398823 13282 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:56.399925 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:56.400528 13209 raft_consensus.cc:3055] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:56.400429 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:56.401240 13135 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.402331 13277 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.403972 13209 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:56.404764 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:56.404865 13209 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.405356 13132 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:56.405671 13132 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:56.405215 13277 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:56.406083 13209 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.406143 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:56.406368 13132 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.406761 13208 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.407590 13132 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.408756 13135 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:56.410615 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:56.411317 14121 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:56.411783 14121 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:56.412506 14121 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.413061 13208 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:56.413866 13132 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:56.414398 13252 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:56.415370 14328 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:56.415925 14328 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:56.416802 14328 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.430075 13209 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:56.443193 13034 catalog_manager.cc:5697] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.444953 13034 catalog_manager.cc:5697] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.614560 14305 raft_consensus.cc:993] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:56.615135 14305 raft_consensus.cc:1081] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:56.616732 13282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:18:56.617337 13282 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:56.617666 13282 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.622462 13282 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.624429 13282 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:56.624841 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:56.625419 13132 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.626998 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:56.627599 13209 raft_consensus.cc:3055] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:56.627904 13209 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:56.628610 13209 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.629245 13135 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:56.629789 13209 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:56.630667 14331 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:56.632052 13132 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:56.633054 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:56.633858 14328 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:56.634388 14328 raft_consensus.cc:697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:56.635293 14328 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:56.651878 13209 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:56.662606 13035 catalog_manager.cc:5697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.671079 13208 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:56.673709 13209 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:56.675125 14347 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:56.689596 14328 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:56.765894 13132 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:56.767338 14265 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:56.828147 13132 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:56.829330 14270 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:56.844838 13209 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:56.846277 14265 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:57.000393 13132 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:57.001681 14265 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:57.024281 13209 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:57.026237 14265 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:57.112920 13132 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:57.116638 13209 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:57.118886 14265 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:57.135007 14265 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:57.133802 13206 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:57.170863 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:57.189157 13282 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:57.191634 14257 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:57.193297 13175 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3642b79a5a004395947fefe912c71406. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.197477 13132 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:57.209936 14259 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:57.219332 14259 raft_consensus.cc:2955] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.228638 13277 raft_consensus.cc:2955] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.246197 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:57.247036 13135 raft_consensus.cc:606] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:18:57.251811 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:57.252682 13135 raft_consensus.cc:606] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:57.275619 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:57.276566 13135 raft_consensus.cc:606] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:57.277944 13206 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:57.296741 13132 raft_consensus.cc:2955] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.300724 13032 catalog_manager.cc:5697] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.340343 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:57.340948 13135 raft_consensus.cc:606] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:18:57.363458 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:57.364245 13135 raft_consensus.cc:606] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:57.368208 13277 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:57.369432 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:57.369552 14259 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:57.373314 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:57.382400 13175 consensus_peers.cc:597] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fc9abc16270419796fe8ad939321769. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.392867 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:57.403967 13135 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:57.410394 14262 raft_consensus.cc:993] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:57.410857 14262 raft_consensus.cc:1081] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:57.415225 14257 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:57.419118 13277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38644
I20260709 12:18:57.419718 13277 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.420068 13277 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.420574 13282 raft_consensus.cc:2955] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.427688 13277 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:57.438485 14262 raft_consensus.cc:993] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:18:57.439034 14262 raft_consensus.cc:1081] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:18:57.439178 13132 raft_consensus.cc:2955] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.441470 13277 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:57.442999 13886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45944
I20260709 12:18:57.443368 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:57.443647 13886 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.444068 13206 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.444087 13886 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:57.448237 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:57.448836 13135 raft_consensus.cc:3055] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:57.449136 13135 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:57.449999 13135 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:57.451253 13135 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.458114 13886 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:57.462159 13886 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:57.463691 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:57.464319 13277 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:57.465493 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:57.466147 13137 raft_consensus.cc:3055] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:57.466425 13137 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:57.466634 14259 raft_consensus.cc:2955] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.467276 13137 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:57.468624 13137 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:57.471298 13206 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:57.473441 13252 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:57.475121 14265 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:57.475590 14265 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:57.476354 14265 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:57.478459 13137 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:18:57.486600 13135 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:57.493098 14330 raft_consensus.cc:993] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:18:57.493647 14330 raft_consensus.cc:1081] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:18:57.495119 13277 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:18:57.496356 13838 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:18:57.499270 14331 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:57.499825 14331 raft_consensus.cc:697] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:18:57.500692 14331 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:57.508250 13886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45944
I20260709 12:18:57.508876 13886 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.509233 13886 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.511847 13032 catalog_manager.cc:5697] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.566015 13277 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:18:57.580364 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6fd86be5bbd94b1aa09465a16ec1c5b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.582589 13135 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:57.593596 13032 catalog_manager.cc:5697] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 2 to 3, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 3 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.616638 14265 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:57.628350 13886 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:57.631184 14270 raft_consensus.cc:2955] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.632735 14379 ts_tablet_manager.cc:933] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:57.638645 13135 raft_consensus.cc:2955] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
W20260709 12:18:57.639420 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 133510us
I20260709 12:18:57.656682 13032 catalog_manager.cc:5697] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.657719 14379 tablet_copy_client.cc:323] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:18:57.659031 13209 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:57.659765 13222 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet 3642b79a5a004395947fefe912c71406 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:18:57.660348 13222 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet 3642b79a5a004395947fefe912c71406 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-3642b79a5a004395947fefe912c71406
I20260709 12:18:57.669831 13222 tablet_copy_source_session.cc:215] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:57.673979 14379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3642b79a5a004395947fefe912c71406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.678943 13886 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:57.684263 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:57.684883 13132 raft_consensus.cc:3055] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:57.685170 13132 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:57.685971 13132 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:57.686975 13132 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.696295 14121 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:57.703362 13034 catalog_manager.cc:5697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.704154 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:57.708146 13206 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.708948 13135 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:57.711489 13132 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:18:57.712673 14379 tablet_copy_client.cc:806] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:57.713063 13838 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:18:57.713286 14379 tablet_copy_client.cc:670] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:57.716356 14331 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:57.719903 14331 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:18:57.722831 14330 raft_consensus.cc:993] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:18:57.723281 14330 raft_consensus.cc:1081] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:18:57.720944 14331 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:57.724985 13884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45944
I20260709 12:18:57.725538 13884 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.725878 13884 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.739552 14330 raft_consensus.cc:993] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:18:57.740226 14330 raft_consensus.cc:1081] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:18:57.754184 13206 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:18:57.754925 13209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:18:57.755539 13209 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.757664 13209 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:57.759107 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 68560.4us
I20260709 12:18:57.762979 13208 raft_consensus.cc:2955] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.772974 13032 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 2 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.774995 14379 tablet_copy_client.cc:538] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:57.783994 13884 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:57.787578 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:57.788141 13132 raft_consensus.cc:3055] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:57.788424 13132 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:57.779451 13209 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:57.792235 13277 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:57.792017 13132 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:57.793471 13132 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.794864 14262 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:57.796440 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:57.800362 13277 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.804066 13208 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:18:57.805622 14262 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:57.806087 13132 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:18:57.806875 13277 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:57.808012 13177 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:57.808912 14378 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:57.809600 14378 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:57.810667 14378 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:57.795871 13209 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:18:57.799770 13100 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9cf69f9fcd1a4ec4a5526f84e6d06eba. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.815577 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:18:57.816354 14331 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:57.816826 14331 raft_consensus.cc:697] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:18:57.816885 14294 raft_consensus.cc:2955] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.817695 14331 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:57.798518 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:57.825886 13135 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:57.826203 13135 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:57.823103 13277 raft_consensus.cc:2955] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.834141 13208 raft_consensus.cc:2955] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.835786 13135 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:57.837031 13135 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.839613 14379 tablet_bootstrap.cc:492] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:57.845431 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:57.846083 13206 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.850571 13032 catalog_manager.cc:5697] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 2 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.866175 13135 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:57.863556 13884 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:57.872546 13034 catalog_manager.cc:5697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:18:57.879914 13206 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:18:57.902544 13035 catalog_manager.cc:5697] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.957091 13209 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:18:57.963176 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 56679.4us
W20260709 12:18:57.972180 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 65243.8us
I20260709 12:18:57.975508 14121 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:58.045945 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 53558.9us
I20260709 12:18:58.065925 13281 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:58.067308 14347 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:58.076165 14390 ts_tablet_manager.cc:933] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:58.084241 14379 tablet_bootstrap.cc:492] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:58.085129 14389 ts_tablet_manager.cc:933] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:58.093340 13132 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.085201 14379 tablet_bootstrap.cc:492] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:58.104697 14389 tablet_copy_client.cc:323] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:18:58.104732 14379 ts_tablet_manager.cc:1403] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.265s	user 0.023s	sys 0.000s
I20260709 12:18:58.111294 13135 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:58.114989 14265 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:58.119131 13135 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:58.128243 14390 tablet_copy_client.cc:323] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.3:35631
I20260709 12:18:58.119295 14379 raft_consensus.cc:359] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:58.150048 13222 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet 5fc9abc16270419796fe8ad939321769 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:18:58.151027 13222 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet 5fc9abc16270419796fe8ad939321769 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-5fc9abc16270419796fe8ad939321769
I20260709 12:18:58.151057 14347 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:58.147563 14379 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:58.160125 14379 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:58.172788 13209 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:58.175679 13296 tablet_copy_service.cc:140] P b190224a708b4f068a6dda4006c3a133: Received BeginTabletCopySession request for tablet 6fd86be5bbd94b1aa09465a16ec1c5b3 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:42730)
I20260709 12:18:58.175468 14397 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:58.176301 13296 tablet_copy_service.cc:161] P b190224a708b4f068a6dda4006c3a133: Beginning new tablet copy session on tablet 6fd86be5bbd94b1aa09465a16ec1c5b3 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:42730: session id = cbc6af7757ec459ab451e47724fdf44b-6fd86be5bbd94b1aa09465a16ec1c5b3
I20260709 12:18:58.142292 14331 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:18:58.187012 13222 tablet_copy_source_session.cc:215] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:18:58.304483 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 99614.3us
I20260709 12:18:58.337400 13209 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:58.366766 13296 tablet_copy_source_session.cc:215] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:58.372174 13281 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.372323 13136 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:58.373116 14379 ts_tablet_manager.cc:1434] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.263s	user 0.014s	sys 0.013s
I20260709 12:18:58.359417 14397 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:18:58.378650 13222 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-3642b79a5a004395947fefe912c71406 received from {username='slave'} at 127.0.0.1:36412
I20260709 12:18:58.379165 13222 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-3642b79a5a004395947fefe912c71406 on tablet 3642b79a5a004395947fefe912c71406 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:58.375677 14378 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:18:58.390765 14405 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:58.405911 13129 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.408886 14389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc9abc16270419796fe8ad939321769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:58.411554 14395 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:58.418346 14379 ts_tablet_manager.cc:933] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:18:58.418866 14390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd86be5bbd94b1aa09465a16ec1c5b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:58.509459 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:58.527755 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 44068.4us
W20260709 12:18:58.529603 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 48665.6us
I20260709 12:18:58.528069 14379 tablet_copy_client.cc:323] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:18:58.560825 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:18:58.561504 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-9cf69f9fcd1a4ec4a5526f84e6d06eba
I20260709 12:18:58.643404 13147 tablet_copy_source_session.cc:215] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:58.694197 13884 raft_consensus.cc:1217] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:58.712677 13206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:18:58.713254 13206 raft_consensus.cc:606] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:18:58.725672 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:58.726243 13135 raft_consensus.cc:606] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:18:58.730810 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:58.731343 13135 raft_consensus.cc:606] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:18:58.755582 14377 raft_consensus.cc:993] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:58.756353 14377 raft_consensus.cc:1081] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:58.759064 13286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:18:58.759788 13286 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.760257 13286 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.781987 13286 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:18:58.779956 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 122329us
I20260709 12:18:58.791275 13286 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:58.846613 13281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:18:58.792703 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:58.847213 13281 raft_consensus.cc:606] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:18:58.847637 13206 raft_consensus.cc:3055] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:58.848035 13206 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:58.849105 14379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:58.816648 14390 tablet_copy_client.cc:806] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:58.829492 14423 raft_consensus.cc:993] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:18:58.850183 14423 raft_consensus.cc:1081] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:18:58.794422 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:58.850910 13129 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.851323 14390 tablet_copy_client.cc:670] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:58.853022 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:58.853582 13135 raft_consensus.cc:606] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:18:58.848685 13206 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:58.855024 13208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:18:58.857350 13208 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.857764 13208 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.860149 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:18:58.860697 13135 raft_consensus.cc:606] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:18:58.862812 14390 tablet_copy_client.cc:538] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:58.866647 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:58.866842 13206 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.887218 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:58.888060 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:58.904055 13208 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:58.906533 13208 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:58.907106 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:58.907780 13135 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:58.908178 13135 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:58.909237 13135 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:58.910544 13135 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.911656 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:58.912214 13281 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.908107 14416 raft_consensus.cc:993] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:18:58.916658 14416 raft_consensus.cc:1081] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:18:58.924218 13211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46536
I20260709 12:18:58.924759 13211 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.925102 13211 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.928625 13281 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:58.930480 14419 raft_consensus.cc:993] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:18:58.933761 14390 tablet_bootstrap.cc:492] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:58.937798 14419 raft_consensus.cc:1081] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:18:58.938426 13211 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:58.945413 13211 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:58.950026 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:58.950570 13286 raft_consensus.cc:3055] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:58.950876 13286 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:58.951557 13286 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:58.952553 13286 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.954669 13211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:18:58.955399 13211 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.955770 13211 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.954794 13129 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:58.957403 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:58.959601 13132 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:58.958789 13206 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:58.961673 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:58.966578 13135 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:58.968962 13252 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:58.970284 13286 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:58.972376 14121 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:58.972891 14121 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:58.973609 14121 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:58.973206 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:58.975332 13211 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:58.980346 14381 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:58.981333 14389 tablet_copy_client.cc:806] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:58.989380 13132 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:58.994601 13211 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:58.985018 14377 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:59.003931 14377 raft_consensus.cc:697] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:58.996896 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:58.999154 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:58.995347 14381 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:59.005402 13286 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.005605 13135 raft_consensus.cc:3055] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:59.006702 13135 raft_consensus.cc:740] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:59.004817 14377 consensus_queue.cc:237] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:59.007714 13135 consensus_queue.cc:260] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:59.007478 14381 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:58.996469 14389 tablet_copy_client.cc:670] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:59.034909 14389 tablet_copy_client.cc:538] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:59.039539 14391 raft_consensus.cc:993] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:59.040705 14391 raft_consensus.cc:1081] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:18:59.044672 13286 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:59.046167 13177 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:59.047160 13135 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.052953 13135 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:59.078941 14259 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:59.086959 13286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38644
I20260709 12:18:59.087795 13286 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.087846 14259 raft_consensus.cc:697] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:59.088361 13286 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.101866 13286 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:59.106689 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:59.107368 13132 raft_consensus.cc:3055] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:59.111660 13132 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:59.121299 14259 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:59.124079 13286 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:18:59.125034 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:18:59.126588 13132 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:59.129500 13206 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.139155 14379 tablet_copy_client.cc:806] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:59.139830 14379 tablet_copy_client.cc:670] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:59.140945 13206 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:59.142160 13252 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:59.143088 14401 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:59.143622 14401 raft_consensus.cc:697] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:18:59.144914 14389 tablet_bootstrap.cc:492] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:59.146126 14257 raft_consensus.cc:1064] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:18:59.143153 13034 catalog_manager.cc:5697] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.158282 13132 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.162484 14379 tablet_copy_client.cc:538] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:59.149240 14257 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:18:59.187108 13132 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:18:59.212338 14391 raft_consensus.cc:993] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:18:59.245337 14330 raft_consensus.cc:1081] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:18:59.144521 14401 consensus_queue.cc:237] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:59.255033 14390 tablet_bootstrap.cc:492] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:59.256114 14390 tablet_bootstrap.cc:492] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:59.257145 14390 ts_tablet_manager.cc:1403] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.324s	user 0.028s	sys 0.022s
I20260709 12:18:59.257609 14379 tablet_bootstrap.cc:492] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:18:59.257668 13206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:18:59.260033 13206 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.260423 13206 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.266883 14389 tablet_bootstrap.cc:492] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:59.268599 14389 tablet_bootstrap.cc:492] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:59.269368 14389 ts_tablet_manager.cc:1403] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.011s
I20260709 12:18:59.272522 14389 raft_consensus.cc:359] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:59.273495 14389 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:59.274178 14389 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:59.266430 14390 raft_consensus.cc:359] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:59.275676 14390 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:18:59.276791 14389 ts_tablet_manager.cc:1434] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:59.276391 14390 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:59.278831 13222 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-5fc9abc16270419796fe8ad939321769 received from {username='slave'} at 127.0.0.1:36412
I20260709 12:18:59.279263 13222 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-5fc9abc16270419796fe8ad939321769 on tablet 5fc9abc16270419796fe8ad939321769 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:59.279676 14390 ts_tablet_manager.cc:1434] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 12:18:59.281530 13296 tablet_copy_service.cc:342] P b190224a708b4f068a6dda4006c3a133: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-6fd86be5bbd94b1aa09465a16ec1c5b3 received from {username='slave'} at 127.0.0.1:42730
I20260709 12:18:59.281963 13296 tablet_copy_service.cc:434] P b190224a708b4f068a6dda4006c3a133: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-6fd86be5bbd94b1aa09465a16ec1c5b3 on tablet 6fd86be5bbd94b1aa09465a16ec1c5b3 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:18:59.288455 13884 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:59.291060 13135 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:59.302912 13281 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:18:59.297880 13032 catalog_manager.cc:5697] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.311291 14259 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:59.290753 13206 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:59.320750 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:18:59.321368 13281 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.327977 13281 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:59.329308 13177 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:18:59.329365 14259 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:59.331782 14259 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:59.332613 14259 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:18:59.333635 14259 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:59.337628 13206 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:18:59.341007 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:18:59.341774 13135 raft_consensus.cc:3055] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:59.342142 13135 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:18:59.346684 14381 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:59.343037 13135 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:18:59.351775 13135 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.405354 13135 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:18:59.421797 13282 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.433594 14259 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.435566 13129 raft_consensus.cc:2955] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:59.432674 14381 raft_consensus.cc:2955] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:59.445878 13883 raft_consensus.cc:1217] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:18:59.460541 13883 raft_consensus.cc:2955] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:59.470873 13035 catalog_manager.cc:5697] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:59.472587 13211 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.472260 13031 catalog_manager.cc:5697] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.477142 13286 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.478521 14377 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.484858 13282 raft_consensus.cc:2955] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:18:59.493425 14401 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.495375 13132 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.498837 14259 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.504845 13032 catalog_manager.cc:5697] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.506537 13032 catalog_manager.cc:5697] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.508322 13032 catalog_manager.cc:5697] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.544044 13132 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.545881 14416 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.610945 13282 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.615170 14395 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:59.624619 13135 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.628193 14377 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:59.734669 14379 tablet_bootstrap.cc:492] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:59.735872 14379 tablet_bootstrap.cc:492] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:18:59.738745 13135 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.593300 13884 raft_consensus.cc:1217] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:18:59.764665 13132 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.765341 14379 ts_tablet_manager.cc:1403] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.508s	user 0.034s	sys 0.039s
I20260709 12:18:59.915820 14429 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:59.919796 14259 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:59.958217 13281 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.975957 14381 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:59.989509 14379 raft_consensus.cc:359] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:18:59.991055 14379 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:19:00.020498 13206 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.023144 13212 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:00.014139 14379 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:00.077307 14401 raft_consensus.cc:1064] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:00.078789 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:00.167955 14401 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.178866 14417 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:00.193456 13883 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:00.211755 13134 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:00.212859 13135 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:00.223038 14259 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:00.236096 14379 ts_tablet_manager.cc:1434] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.353s	user 0.007s	sys 0.011s
I20260709 12:19:00.236581 13883 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:00.240471 14401 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:00.242551 14381 raft_consensus.cc:1064] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:00.245728 14381 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.286253 14257 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:19:00.299041 13130 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:00.306953 14121 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:00.313941 14259 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:00.343600 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-9cf69f9fcd1a4ec4a5526f84e6d06eba received from {username='slave'} at 127.0.0.1:60854
I20260709 12:19:00.344285 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-9cf69f9fcd1a4ec4a5526f84e6d06eba on tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:00.344345 13886 raft_consensus.cc:1217] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:00.370213 13277 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:00.372341 14474 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:19:00.403704 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 89907.9us
I20260709 12:19:00.462111 13211 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:00.474215 13884 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:00.493132 13281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:19:00.494165 13281 raft_consensus.cc:606] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:00.499177 13205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b675043435441bb980d9a219c4d3450"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:00.499874 13205 raft_consensus.cc:606] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:00.501528 14416 raft_consensus.cc:2955] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:00.510895 14270 raft_consensus.cc:993] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:00.511511 14401 raft_consensus.cc:1081] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:00.515251 13137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:00.516031 13137 raft_consensus.cc:606] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:00.518213 13136 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:00.520387 13136 raft_consensus.cc:2955] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:00.525568 13206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:00.526157 13206 raft_consensus.cc:606] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:00.525314 13887 raft_consensus.cc:2955] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:00.530211 13206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:00.530869 13206 raft_consensus.cc:606] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:00.534479 13206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9377aea669547028ee8449f654c60b7"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:00.535221 13206 raft_consensus.cc:606] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:00.537011 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:00.536635 13035 catalog_manager.cc:5697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:00.538774 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:00.540512 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:00.575731 14401 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:00.583917 14457 raft_consensus.cc:993] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:00.584551 14423 raft_consensus.cc:1081] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:00.587961 13887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45944
I20260709 12:19:00.588593 13887 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:00.588958 13887 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:00.602056 13887 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.604708 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:00.605399 13134 raft_consensus.cc:3055] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:00.605705 13134 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:00.606604 13134 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.607846 13134 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:00.620173 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:00.620848 13277 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:00.625198 14474 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:00.629130 14305 raft_consensus.cc:2955] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:00.634038 13205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46536
I20260709 12:19:00.634680 13205 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:00.635056 13205 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:00.636808 13887 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:00.642398 13277 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:00.644147 13840 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:00.645382 14467 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:00.645860 14467 raft_consensus.cc:697] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:00.646678 14467 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.662001 13205 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:00.665736 14381 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:00.666240 13134 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:00.668115 13211 raft_consensus.cc:2955] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:00.674144 14464 raft_consensus.cc:993] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:00.674690 14464 raft_consensus.cc:1081] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:00.678023 13206 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:00.681658 13886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45928
I20260709 12:19:00.682108 13205 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:00.682230 13886 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:00.682703 13886 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:00.682493 13136 raft_consensus.cc:2955] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:00.688086 13887 raft_consensus.cc:2955] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:00.693367 13022 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3642b79a5a004395947fefe912c71406 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:00.695670 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:00.698051 13886 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.696250 13277 raft_consensus.cc:3055] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:00.698798 13277 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:00.699932 13277 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:00.701030 13277 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:00.702090 13031 catalog_manager.cc:5697] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:00.705973 14381 raft_consensus.cc:993] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:00.705843 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:00.703383 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:00.706558 13281 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:00.714104 13281 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:00.715474 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:00.716586 14403 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:00.717072 14403 raft_consensus.cc:697] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:00.717978 14403 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.719609 13277 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:00.707240 13206 raft_consensus.cc:3055] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:00.722000 13206 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:00.706272 13886 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:00.731812 13177 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:00.706559 14381 raft_consensus.cc:1081] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:00.739837 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:00.740538 13136 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:00.737900 13206 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.736850 14474 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:00.743332 14474 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:00.746016 13206 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:00.744295 14474 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:00.758323 13136 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:00.759768 13884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b675043435441bb980d9a219c4d3450"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45928
I20260709 12:19:00.760331 13884 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:00.760664 13884 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:00.769546 13206 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:00.772496 13884 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.780215 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:00.780928 13136 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:00.779309 14381 raft_consensus.cc:993] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:00.781921 14381 raft_consensus.cc:1081] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:00.784720 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:00.785321 13206 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:00.785597 13206 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:00.779911 13884 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:00.786314 13206 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.788733 13136 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:00.789062 13281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9377aea669547028ee8449f654c60b7"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:19:00.788889 13206 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:00.789633 13281 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:00.789964 13281 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:00.792451 14457 raft_consensus.cc:1064] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:00.792543 13838 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:00.795189 14457 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.808521 13206 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:00.813683 14403 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:00.815634 14403 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:00.816493 14403 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.834472 13281 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:00.862246 13281 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:00.868355 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:00.869031 13134 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:00.924167 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:00.925063 13209 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:00.925405 13209 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:00.926316 13209 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:00.938481 13209 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:00.950778 13209 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:00.966075 13134 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:00.972616 13886 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:00.980376 14495 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:00.989588 14381 raft_consensus.cc:993] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:00.989710 13211 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:00.990142 14381 raft_consensus.cc:1081] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:00.990031 13277 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:00.991714 14461 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:00.999286 13286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:19:00.999341 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet 3642b79a5a004395947fefe912c71406 with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38630
I20260709 12:19:01.000111 13286 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:01.000519 13286 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:00.999239 13249 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:01.022768 13884 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:01.023932 14416 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:01.024634 14416 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:01.025513 14416 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:01.031311 13277 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:01.033641 13130 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:01.037106 13286 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:01.038825 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 115874us
I20260709 12:19:01.042150 14459 raft_consensus.cc:2955] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.044052 14498 tablet_replica.cc:333] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:19:01.046568 14401 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:01.048460 14495 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:01.059640 14457 raft_consensus.cc:2955] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.061070 13211 raft_consensus.cc:2955] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.075114 14462 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:01.077030 13886 raft_consensus.cc:2955] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.078300 13281 raft_consensus.cc:2955] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.090708 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:01.091513 13130 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.096542 13032 catalog_manager.cc:5697] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 2 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:01.098225 13032 catalog_manager.cc:5697] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 2 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:01.102636 13032 catalog_manager.cc:5697] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 2 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:01.116107 13886 raft_consensus.cc:2955] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.117689 13137 raft_consensus.cc:2955] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.125236 13281 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:01.126813 14467 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:01.140596 13286 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:01.141956 13130 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:01.146409 14498 raft_consensus.cc:2243] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:01.153334 14498 raft_consensus.cc:2272] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:01.152891 13031 catalog_manager.cc:5697] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 3, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 3 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:01.156553 14498 ts_tablet_manager.cc:1916] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:01.149662 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:01.159735 13211 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:01.160104 13211 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:01.160897 13211 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:01.162027 13211 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:01.161978 14464 consensus_queue.cc:1175] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "af3f42f0797349058724e0cb2e637d24" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:19:01.170828 13035 catalog_manager.cc:5697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:01.172387 13286 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:01.174013 14467 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:01.193064 14401 raft_consensus.cc:2955] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.200261 13035 catalog_manager.cc:5697] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.204737 13249 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:01.242056 14416 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:01.140059 13034 catalog_manager.cc:5697] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 2 to 3, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 3 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:01.231724 13205 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:01.242668 14416 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:01.243664 14416 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:01.249866 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 45187.4us
I20260709 12:19:01.256237 13134 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:01.265398 13135 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:01.267640 14494 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:01.271924 14405 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:01.275203 13137 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:01.239262 13211 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:01.282361 13886 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:01.287750 14492 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:01.294451 13277 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:01.300351 13281 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:01.310698 14498 ts_tablet_manager.cc:1929] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:01.310555 14492 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:01.321687 13211 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:01.311467 14498 log.cc:1199] T 3642b79a5a004395947fefe912c71406 P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/3642b79a5a004395947fefe912c71406
I20260709 12:19:01.335705 14494 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:19:01.344195 13137 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:01.353118 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet 3642b79a5a004395947fefe912c71406 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:19:01.385793 14492 raft_consensus.cc:2955] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.419749 13021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6fd86be5bbd94b1aa09465a16ec1c5b3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:19:01.457454 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54345.6us
I20260709 12:19:01.465802 13886 raft_consensus.cc:2955] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.501606 13884 raft_consensus.cc:2955] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.419869 13135 raft_consensus.cc:2955] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:01.450249 14403 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:19:01.590413 13886 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:19:01.603611 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 141374us
W20260709 12:19:01.641621 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 224021us
I20260709 12:19:01.673692 14515 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:19:01.739825 13022 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5fc9abc16270419796fe8ad939321769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:01.743731 13209 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:19:01.665892 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 209731us
W20260709 12:19:01.736757 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 58222.2us
I20260709 12:19:01.757835 13205 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:01.673805 14516 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:19:01.788878 14419 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:01.802114 13130 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:01.782344 14517 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:19:01.842330 13206 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:01.850585 13032 catalog_manager.cc:5697] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 2 to 3, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 3 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:01.875314 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:01.947726 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 155709us
W20260709 12:19:01.921175 14476 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:19:01.900044 14462 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 12:19:01.979369 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 83996.5us
I20260709 12:19:02.026805 14526 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 12:19:02.074383 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 95971.1us
W20260709 12:19:02.274902 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 465808us
I20260709 12:19:02.289642 14540 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:02.290377 14540 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:02.293277 14540 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:02.434370 13279 raft_consensus.cc:2955] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:02.447122 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:02.460249 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:02.481827 13137 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:19:02.483320 13032 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.003s	sys 0.004s
W20260709 12:19:02.483731 13032 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.004s	sys 0.004s
I20260709 12:19:02.518399 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:02.528199 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 60033.6us
I20260709 12:19:02.538702 13207 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:02.546487 14521 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:02.575356 13175 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:02.579989 14492 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:02.590159 13031 catalog_manager.cc:5697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 4 to 5, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:02.593621 13034 catalog_manager.cc:5697] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:02.604530 13032 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42070 (request call id 261) took 1012 ms. Trace:
I20260709 12:19:02.604842 14520 raft_consensus.cc:2955] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:19:02.613811 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 81107.5us
I20260709 12:19:02.605669 13032 rpcz_store.cc:276] 0709 12:19:01.592082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.592303 (+   221us) service_pool.cc:224] Handling call
0709 12:19:02.484030 (+891727us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:02.484057 (+    27us) write_op.cc:454] Released schema lock
0709 12:19:02.604444 (+120387us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:02.069556 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:02.070259 (+   703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:02.070310 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:19:02.070328 (+    18us) tablet.cc:662] Decoding operations
0709 12:19:02.070711 (+   383us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:02.070787 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:02.070819 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:02.071043 (+   224us) tablet.cc:701] Row locks acquired
0709 12:19:02.071061 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:19:02.071201 (+   140us) write_op.cc:270] Start()
0709 12:19:02.071327 (+   126us) write_op.cc:276] Timestamp: P: 1783599542071153 usec, L: 0
0709 12:19:02.071356 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:19:02.072149 (+   793us) log.cc:844] Serialized 538 byte log entry
0709 12:19:02.076715 (+  4566us) op_driver.cc:464] REPLICATION: finished
0709 12:19:02.092280 (+ 15565us) write_op.cc:301] APPLY: starting
0709 12:19:02.092381 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:02.092477 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:02.092622 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:02.092835 (+   213us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:02.093022 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:19:02.093091 (+    69us) write_op.cc:312] APPLY: finished
0709 12:19:02.093334 (+   243us) log.cc:844] Serialized 23 byte log entry
0709 12:19:02.094157 (+   823us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:02.094249 (+    92us) write_op.cc:454] Released schema lock
0709 12:19:02.094285 (+    36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":155120,"reported_tablets":4,"spinlock_wait_cycles":676096,"child_traces":[["op",{"apply.queue_time_us":15292,"apply.run_cpu_time_us":1715,"apply.run_wall_time_us":2327,"num_ops":1,"prepare.queue_time_us":214250,"prepare.run_cpu_time_us":2842,"prepare.run_wall_time_us":6205,"replication_time_us":5243,"thread_start_us":643656,"threads_started":2}]]}
I20260709 12:19:02.641253 14519 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:02.662319 14461 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:02.664634 14461 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:02.679852 14461 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:02.658069 14526 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:19:02.681550 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:02.642022 14519 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:02.684880 14519 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:02.686988 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:02.692222 14520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58700 (request call id 79) took 1456 ms. Trace:
I20260709 12:19:02.692890 14520 rpcz_store.cc:276] 0709 12:19:01.235710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.237743 (+  2033us) service_pool.cc:224] Handling call
0709 12:19:01.317748 (+ 80005us) log.cc:844] Serialized 494 byte log entry
0709 12:19:01.601693 (+283945us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b54003433a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e06142 00007f70f4de6eaa 00007f70f4dedd53 00007f70f4dedcd9 00007f70f4dedc69 00007f70f4dedc31 00007f70f4decdfd 0000000000388634 0000000000388479 00007f70f1da0475
0709 12:19:02.692092 (+1090399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91956,"raft.queue_time_us":2720,"raft.run_cpu_time_us":3964,"raft.run_wall_time_us":401318,"spinlock_wait_cycles":2786560}
I20260709 12:19:02.695240 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:02.691053 13103 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:02.706840 13283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:19:02.707474 13283 raft_consensus.cc:606] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:19:02.709785 13883 raft_consensus.cc:2955] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:02.714754 14463 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:02.688306 13208 raft_consensus.cc:2955] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:19:02.738247 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 71697.5us
I20260709 12:19:02.753360 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fd86be5bbd94b1aa09465a16ec1c5b3 with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:02.764523 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:02.783641 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 122720us
I20260709 12:19:02.786878 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:02.787992 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:02.790180 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fc9abc16270419796fe8ad939321769 with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58700
I20260709 12:19:02.790462 13137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:02.791054 13137 raft_consensus.cc:606] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:02.800009 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:02.810523 13249 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:02.812806 14270 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:02.815227 13130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:02.815860 13130 raft_consensus.cc:606] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:02.838860 13209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:02.839468 13209 raft_consensus.cc:606] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:02.849769 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:02.850427 13211 raft_consensus.cc:606] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:02.853775 14539 raft_consensus.cc:993] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: : Instructing follower af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:02.854296 14526 raft_consensus.cc:1081] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Signalling peer af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:02.867985 14558 tablet_replica.cc:333] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:19:02.872633 13134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:02.873291 13134 raft_consensus.cc:606] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:02.893599 13136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:19:02.894196 13136 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.894550 13136 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:02.896283 13034 catalog_manager.cc:5697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:02.912642 14559 tablet_replica.cc:333] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:19:02.913714 14559 raft_consensus.cc:2243] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:02.914480 14559 raft_consensus.cc:2272] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:02.918895 13136 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:02.919936 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:02.921018 13136 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:02.921725 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:02.922497 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:02.926371 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:02.926986 13211 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:02.930596 14558 raft_consensus.cc:2243] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:02.931337 14558 raft_consensus.cc:2272] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:02.934183 14558 ts_tablet_manager.cc:1916] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:02.937762 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38630
I20260709 12:19:02.938181 13211 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:02.940001 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:02.940842 14495 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:02.941296 14495 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:02.942124 14495 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:02.944430 14559 ts_tablet_manager.cc:1916] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:19:02.947753 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 45114.4us
I20260709 12:19:02.960947 14461 raft_consensus.cc:993] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:02.961422 14461 raft_consensus.cc:1081] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:02.963706 13884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45944
I20260709 12:19:02.964048 13210 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:02.964311 13884 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.964699 14492 raft_consensus.cc:993] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:02.965936 14474 raft_consensus.cc:1081] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:02.964744 13884 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:02.973042 14461 raft_consensus.cc:993] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:02.973585 14461 raft_consensus.cc:1081] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:02.976038 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:02.976677 13279 raft_consensus.cc:3055] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:02.976998 13279 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:02.977754 13279 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:02.978866 13279 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:02.981642 14563 tablet_replica.cc:333] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:19:02.983084 13883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45928
I20260709 12:19:02.983124 13208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:19:03.012288 13883 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:03.012393 13208 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:03.012553 14563 raft_consensus.cc:2243] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:03.012687 13883 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:03.012830 13208 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:03.013185 14563 pending_rounds.cc:70] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133: Trying to abort 1 pending ops.
I20260709 12:19:03.013551 14563 pending_rounds.cc:77] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305623719090663424 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } } }
I20260709 12:19:03.014788 14563 raft_consensus.cc:2917] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:19:02.986586 13279 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:03.022589 13208 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:03.024636 13208 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:03.025276 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:03.025835 13136 raft_consensus.cc:3055] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:03.026130 13136 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:03.023159 13883 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:03.026839 13136 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:03.029585 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:03.030242 13279 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:03.030260 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:03.030930 13283 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:03.038147 13279 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:03.040081 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:03.041057 14513 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:03.041586 14513 raft_consensus.cc:697] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:03.042416 14513 consensus_queue.cc:237] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:03.005086 13035 catalog_manager.cc:5697] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 3, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.011284 14559 ts_tablet_manager.cc:1929] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:02.986678 13884 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:03.029788 13136 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:03.063725 13136 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:03.045867 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:03.046515 14559 log.cc:1199] T 5fc9abc16270419796fe8ad939321769 P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/5fc9abc16270419796fe8ad939321769
I20260709 12:19:03.064836 13208 raft_consensus.cc:3055] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:03.065167 13208 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:03.015210 14563 raft_consensus.cc:2889] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:19:03.066277 14563 raft_consensus.cc:2272] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:03.066329 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet 5fc9abc16270419796fe8ad939321769 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:19:03.067129 13883 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:03.067983 14558 ts_tablet_manager.cc:1929] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:19:03.068440 14558 log.cc:1199] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/6fd86be5bbd94b1aa09465a16ec1c5b3
I20260709 12:19:03.069336 14563 ts_tablet_manager.cc:1916] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:03.072201 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet 6fd86be5bbd94b1aa09465a16ec1c5b3 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:19:03.074404 13283 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:03.075518 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:03.076397 14405 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:03.079753 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:03.080395 13136 raft_consensus.cc:3055] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:03.081274 14405 raft_consensus.cc:697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:03.080696 13136 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:03.082418 14405 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:03.083247 13136 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:03.084455 13136 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:03.090145 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:03.090227 13208 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:03.090888 13280 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:03.090958 13136 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:03.091650 13884 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:03.092753 13208 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:03.092269 13838 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:03.095543 14403 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:03.096930 14403 raft_consensus.cc:697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:03.097812 14403 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:03.110723 14563 ts_tablet_manager.cc:1929] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:03.111225 14563 log.cc:1199] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/9cf69f9fcd1a4ec4a5526f84e6d06eba
I20260709 12:19:03.113147 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet 9cf69f9fcd1a4ec4a5526f84e6d06eba (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:19:03.120126 13280 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:03.123443 13035 catalog_manager.cc:5697] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 3 to 4, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.131083 13208 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:03.143116 13032 catalog_manager.cc:5697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 2 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:03.163513 13032 catalog_manager.cc:5697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 2 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:03.171069 14463 raft_consensus.cc:993] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:03.171600 14463 raft_consensus.cc:1081] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:03.173491 13208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:19:03.174053 13208 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:19:03.174979 13233 debug-util.cc:398] Leaking SignalData structure 0x7b08001ae420 after lost signal to thread 11919
W20260709 12:19:03.176079 13233 debug-util.cc:398] Leaking SignalData structure 0x7b0800211d40 after lost signal to thread 13069
W20260709 12:19:03.177206 13233 debug-util.cc:398] Leaking SignalData structure 0x7b0800163a00 after lost signal to thread 13161
W20260709 12:19:03.178224 13233 debug-util.cc:398] Leaking SignalData structure 0x7b08000dd1e0 after lost signal to thread 13236
I20260709 12:19:03.174412 13208 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:03.179252 13233 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6800 after lost signal to thread 13310
W20260709 12:19:03.183404 13233 debug-util.cc:398] Leaking SignalData structure 0x7b0800367600 after lost signal to thread 13911
I20260709 12:19:03.186676 13208 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:03.189787 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:03.190161 13208 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:03.190418 13136 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:03.190750 13136 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:03.191393 13136 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:03.192806 13136 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:03.193810 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:03.194446 13283 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:03.202301 13283 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:03.203644 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:03.204552 14474 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:03.205076 14474 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:03.206022 14474 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:03.207604 13136 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:03.219992 13032 catalog_manager.cc:5697] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.341663 14513 raft_consensus.cc:993] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:03.342211 14381 raft_consensus.cc:1081] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:03.343958 13883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45928
I20260709 12:19:03.344537 13883 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:03.344898 13883 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:03.352916 13883 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:03.355626 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:03.356230 13136 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:03.364799 13883 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:03.365041 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:03.363372 13136 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:03.366323 13211 raft_consensus.cc:3055] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:03.366734 13211 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:03.366904 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:03.367877 14405 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:03.368428 14405 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:03.369511 14405 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:03.382412 13280 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:03.367751 13211 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:03.405305 14495 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:03.410841 13211 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:03.418198 13208 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:03.422791 14495 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:03.459087 13136 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:03.478132 14474 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:03.509115 13211 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:03.588353 13280 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:03.603057 14381 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:19:03.646629 13034 catalog_manager.cc:5697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 2 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:03.652017 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 55761.3us
I20260709 12:19:03.655259 13208 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:03.658473 14515 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:03.665544 13283 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:03.669175 13283 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:03.668916 14405 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:19:03.687674 14405 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:03.692739 13130 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:03.736827 13279 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:03.740334 14474 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:03.779479 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 68837.8us
W20260709 12:19:03.806897 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 85709.4us
I20260709 12:19:03.812116 14403 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:19:03.861790 13136 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:03.865525 14584 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:19:03.884413 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 59522.7us
W20260709 12:19:03.938443 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 53057.4us
W20260709 12:19:03.939667 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 69694.8us
I20260709 12:19:03.997857 13209 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:19:04.013187 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 50707.8us
I20260709 12:19:04.007977 14518 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 12:19:04.089547 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 265458us
I20260709 12:19:04.108933 13136 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:19:04.114044 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 58396.8us
I20260709 12:19:04.115213 14515 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:04.116916 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:04.124421 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 78359us
I20260709 12:19:04.137831 13283 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:19:04.210318 13249 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 937887e1967840639df25a74d4e57bfd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:04.212092 13134 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:04.227084 13134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:04.227326 13211 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:04.227756 13134 raft_consensus.cc:606] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:04.227851 14581 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:04.235656 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:04.236388 13211 raft_consensus.cc:606] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:19:04.239816 13283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:19:04.240600 13283 raft_consensus.cc:606] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:19:04.244022 13283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "937887e1967840639df25a74d4e57bfd"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:19:04.244685 13283 raft_consensus.cc:606] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:04.245882 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:04.264290 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:04.265202 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:04.301401 14581 raft_consensus.cc:2955] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.313715 14583 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:04.326448 13136 raft_consensus.cc:2955] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.356355 13034 catalog_manager.cc:5697] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.391798 13211 raft_consensus.cc:2955] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.407771 13208 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:04.437647 14581 raft_consensus.cc:993] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:04.438124 14581 raft_consensus.cc:1081] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:04.440019 13209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "937887e1967840639df25a74d4e57bfd"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46536
I20260709 12:19:04.440593 13209 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.440956 13209 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:04.449366 13209 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:04.452199 13283 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:04.453589 13209 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:04.454047 14584 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:04.454859 13136 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:04.455227 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:04.455832 13283 raft_consensus.cc:3055] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:04.456115 13283 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:04.456840 13283 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:04.458176 13283 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:04.458778 13175 consensus_peers.cc:597] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bac590852a8a4f4ea0a35528a7ae147d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:04.459601 14584 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:04.461544 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:04.462090 13136 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:04.465021 13283 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:04.468290 13177 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:04.468803 13136 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:04.469045 14577 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:04.477239 14577 raft_consensus.cc:697] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:04.478358 14577 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:04.503885 14555 raft_consensus.cc:993] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: : Instructing follower af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:04.504365 14555 raft_consensus.cc:1081] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Signalling peer af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:04.503305 13035 catalog_manager.cc:5697] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 3, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 3 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.505467 13283 raft_consensus.cc:2955] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.497206 14584 raft_consensus.cc:2955] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.520390 13136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:19:04.520998 13136 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.521363 13136 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.525065 13135 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:04.532459 14580 raft_consensus.cc:993] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:04.532951 14575 raft_consensus.cc:1081] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:04.534176 13136 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:04.535989 13211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:19:04.536542 13211 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.536886 13211 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.499238 13130 raft_consensus.cc:2955] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.542079 13032 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.560214 13136 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:04.563581 14579 raft_consensus.cc:993] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca: : Instructing follower af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:04.564085 14579 raft_consensus.cc:1081] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Signalling peer af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:04.565928 13136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:58712
I20260709 12:19:04.566458 13136 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.566788 13136 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:04.569373 13211 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:04.569989 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:04.570858 13884 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.571738 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:04.572508 13283 raft_consensus.cc:3055] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:04.572882 13283 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:04.574318 13211 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:04.576152 13283 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:04.578476 13283 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.577886 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:04.584914 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:04.588788 13279 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.589758 13283 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:04.587692 13134 raft_consensus.cc:3055] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:04.591638 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:04.591815 13134 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:04.593015 14588 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:04.593017 13134 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:04.594810 13134 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.596625 14588 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:04.598280 14588 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:04.629786 13136 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:04.631826 13136 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:04.633489 13884 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:04.645588 13134 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:04.648815 13280 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:04.655552 14592 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:04.670215 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:04.672155 13283 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:04.676331 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:04.676889 13211 raft_consensus.cc:3055] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:04.677186 13211 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:04.677940 13211 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:04.678812 13211 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:04.680748 13209 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:04.664829 13279 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:04.689513 13283 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:04.690569 13102 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:04.691748 13175 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:04.694067 13211 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:04.695453 14577 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:04.695995 14577 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:04.696851 14577 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:04.705505 14588 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:04.706133 14588 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:04.707034 14588 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:04.690213 14622 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 12:19:04.725744 13100 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1a3fa2c26ae4d9a8803582f91f9cff2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:04.731388 13032 catalog_manager.cc:5697] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 2, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.771014 14592 raft_consensus.cc:2955] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.773267 13035 catalog_manager.cc:5697] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 3 to 4, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 4 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.775098 13032 catalog_manager.cc:5697] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.778110 13283 raft_consensus.cc:2955] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.792196 13209 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:04.783731 13211 raft_consensus.cc:2955] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.824036 13035 catalog_manager.cc:5697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.829602 13282 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:04.831373 14492 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:04.832677 13175 consensus_peers.cc:597] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7285cfe46adb4975a532c3df36e5203e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:04.835326 13135 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:04.836712 14492 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:04.841630 14577 raft_consensus.cc:2955] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.844823 13282 raft_consensus.cc:2955] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.847446 13135 raft_consensus.cc:2955] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:04.867007 13209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "937887e1967840639df25a74d4e57bfd"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:04.868863 13209 raft_consensus.cc:606] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Received request to transfer leadership
I20260709 12:19:04.872148 13035 catalog_manager.cc:5697] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.885550 13210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "937887e1967840639df25a74d4e57bfd"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:04.886173 13210 raft_consensus.cc:606] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Received request to transfer leadership
W20260709 12:19:04.887862 13022 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 937887e1967840639df25a74d4e57bfd already in progress [suppressed 5 similar messages]
W20260709 12:19:04.899657 13175 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 937887e1967840639df25a74d4e57bfd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:04.905270 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "937887e1967840639df25a74d4e57bfd"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:04.905944 13211 raft_consensus.cc:606] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Received request to transfer leadership
I20260709 12:19:04.911314 13282 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:19:04.911568 13083 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:19:04.912000 13083 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 937887e1967840639df25a74d4e57bfd already in progress
W20260709 12:19:04.912286 13083 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 937887e1967840639df25a74d4e57bfd already in progress
I20260709 12:19:04.913189 14492 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:04.920064 14584 raft_consensus.cc:993] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:04.920560 14584 raft_consensus.cc:1081] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:04.923146 13279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "937887e1967840639df25a74d4e57bfd"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:19:04.923719 13279 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.924093 13279 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:04.985286 13279 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:04.992501 13282 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:05.000356 14492 consensus_queue.cc:1059] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:05.002831 13279 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:05.003352 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:05.003507 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:05.005277 13134 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:05.008126 13210 raft_consensus.cc:3055] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:05.008585 13210 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:05.009372 13210 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:05.010911 13210 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:05.018546 14631 ts_tablet_manager.cc:933] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:05.021130 13210 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
W20260709 12:19:05.021689 14492 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:19:05.026150 13134 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:05.026923 13129 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:05.029376 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:05.030498 14583 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:05.030985 14583 raft_consensus.cc:697] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:05.031908 14583 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:05.035225 14631 tablet_copy_client.cc:323] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:19:05.037364 13222 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet bac590852a8a4f4ea0a35528a7ae147d from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:19:05.037937 13222 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet bac590852a8a4f4ea0a35528a7ae147d from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-bac590852a8a4f4ea0a35528a7ae147d
I20260709 12:19:05.046252 13222 tablet_copy_source_session.cc:215] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:05.051116 14631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac590852a8a4f4ea0a35528a7ae147d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:05.056622 13279 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:05.058219 14592 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:05.061054 13884 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:05.062527 14592 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:05.060272 13035 catalog_manager.cc:5697] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 3 to 4, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 4 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:05.104965 13210 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:05.107858 14592 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:05.112610 14631 tablet_copy_client.cc:806] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:05.113344 14631 tablet_copy_client.cc:670] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:05.133118 13129 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:05.133349 14631 tablet_copy_client.cc:538] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:05.136904 14584 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:05.222188 14631 tablet_bootstrap.cc:492] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:19:05.292160 14641 ts_tablet_manager.cc:933] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
W20260709 12:19:05.348976 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 56402.8us
I20260709 12:19:05.383558 14641 tablet_copy_client.cc:323] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:19:05.401286 13282 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:05.453450 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:05.478904 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:19:05.482338 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet e1a3fa2c26ae4d9a8803582f91f9cff2 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-e1a3fa2c26ae4d9a8803582f91f9cff2
I20260709 12:19:05.491689 13147 tablet_copy_source_session.cc:215] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:05.515161 14641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a3fa2c26ae4d9a8803582f91f9cff2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:05.516992 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 95386.4us
I20260709 12:19:05.531618 13129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:05.532382 13129 raft_consensus.cc:606] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:05.552116 13211 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:05.560292 14651 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:05.572976 13282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:19:05.573676 13282 raft_consensus.cc:606] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:19:05.575080 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:05.576756 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:05.577520 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:05.602854 14639 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:05.603271 13282 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:05.618083 14641 tablet_copy_client.cc:806] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:05.618752 14631 tablet_bootstrap.cc:492] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:05.618852 14641 tablet_copy_client.cc:670] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:05.619853 14631 tablet_bootstrap.cc:492] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:19:05.620865 14631 ts_tablet_manager.cc:1403] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.399s	user 0.023s	sys 0.014s
I20260709 12:19:05.624163 14631 raft_consensus.cc:359] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:05.625036 14631 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:19:05.625111 13129 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:05.629858 14641 tablet_copy_client.cc:538] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:05.634503 14653 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:05.640404 14641 tablet_bootstrap.cc:492] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:19:05.625772 14631 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:05.651188 14631 ts_tablet_manager.cc:1434] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:19:05.652297 14662 raft_consensus.cc:993] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: : Instructing follower af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:05.652798 14662 raft_consensus.cc:1081] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Signalling peer af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:05.655050 13222 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-bac590852a8a4f4ea0a35528a7ae147d received from {username='slave'} at 127.0.0.1:36412
I20260709 12:19:05.655602 13222 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-bac590852a8a4f4ea0a35528a7ae147d on tablet bac590852a8a4f4ea0a35528a7ae147d with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:05.656667 14603 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:19:05.660702 13249 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 937887e1967840639df25a74d4e57bfd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:05.666769 13129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:19:05.685353 14631 ts_tablet_manager.cc:933] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:05.693081 13129 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:05.699674 13129 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:05.724268 14631 tablet_copy_client.cc:323] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:19:05.726305 13222 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet 7285cfe46adb4975a532c3df36e5203e from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:19:05.726895 13222 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet 7285cfe46adb4975a532c3df36e5203e from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-7285cfe46adb4975a532c3df36e5203e
I20260709 12:19:05.736716 13222 tablet_copy_source_session.cc:215] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:05.741091 14631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7285cfe46adb4975a532c3df36e5203e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:05.759552 14641 tablet_bootstrap.cc:492] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:05.772948 14641 tablet_bootstrap.cc:492] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:19:05.778437 14641 ts_tablet_manager.cc:1403] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.138s	user 0.023s	sys 0.015s
I20260709 12:19:05.787398 13129 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:05.789794 13135 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:05.788394 14641 raft_consensus.cc:359] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:05.799722 14641 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:19:05.794394 14631 tablet_copy_client.cc:806] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:05.800787 14631 tablet_copy_client.cc:670] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:05.803324 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:05.803978 13210 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:05.804781 14631 tablet_copy_client.cc:538] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:05.804680 13129 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:05.802202 14641 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:05.808254 14649 consensus_queue.cc:1059] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:05.811087 14649 raft_consensus.cc:3055] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:05.811493 14649 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:05.812369 14649 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:05.808851 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:05.813714 14649 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:05.816831 13210 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:05.818056 13103 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:05.818979 14653 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:05.819790 14653 raft_consensus.cc:697] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:05.820779 14653 consensus_queue.cc:237] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:05.833343 14631 tablet_bootstrap.cc:492] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:19:05.847092 14641 ts_tablet_manager.cc:1434] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.001s
I20260709 12:19:05.848630 13282 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:05.850066 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-e1a3fa2c26ae4d9a8803582f91f9cff2 received from {username='slave'} at 127.0.0.1:60854
I20260709 12:19:05.850548 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-e1a3fa2c26ae4d9a8803582f91f9cff2 on tablet e1a3fa2c26ae4d9a8803582f91f9cff2 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:05.901887 13034 catalog_manager.cc:5697] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 2, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:05.904657 14631 tablet_bootstrap.cc:492] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:05.905680 14631 tablet_bootstrap.cc:492] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:19:05.906455 14631 ts_tablet_manager.cc:1403] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.011s
I20260709 12:19:05.910501 14631 raft_consensus.cc:359] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:05.911451 14631 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:19:05.912465 14631 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:05.915349 14631 ts_tablet_manager.cc:1434] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:19:05.918699 13222 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-7285cfe46adb4975a532c3df36e5203e received from {username='slave'} at 127.0.0.1:36412
I20260709 12:19:05.919154 13222 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-7285cfe46adb4975a532c3df36e5203e on tablet 7285cfe46adb4975a532c3df36e5203e with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:05.959093 13884 raft_consensus.cc:1217] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:06.032239 14631 ts_tablet_manager.cc:933] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:06.038100 14623 raft_consensus.cc:993] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:06.038647 14623 raft_consensus.cc:1081] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:06.052421 13210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:19:06.052986 13210 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.053359 13210 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:06.061440 14631 tablet_copy_client.cc:323] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.3:35631
I20260709 12:19:06.063436 13296 tablet_copy_service.cc:140] P b190224a708b4f068a6dda4006c3a133: Received BeginTabletCopySession request for tablet 937887e1967840639df25a74d4e57bfd from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:42730)
I20260709 12:19:06.064023 13296 tablet_copy_service.cc:161] P b190224a708b4f068a6dda4006c3a133: Beginning new tablet copy session on tablet 937887e1967840639df25a74d4e57bfd from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:42730: session id = cbc6af7757ec459ab451e47724fdf44b-937887e1967840639df25a74d4e57bfd
I20260709 12:19:06.072324 13296 tablet_copy_source_session.cc:215] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:06.075825 14631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937887e1967840639df25a74d4e57bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:06.115680 14631 tablet_copy_client.cc:806] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:06.116348 14631 tablet_copy_client.cc:670] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:06.120538 14631 tablet_copy_client.cc:538] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:06.139513 14631 tablet_bootstrap.cc:492] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:19:06.155954 13210 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:06.161917 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:06.162541 13136 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:06.162839 13136 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:06.163637 13136 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:06.164804 13136 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:06.196378 14631 tablet_bootstrap.cc:492] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:06.197293 14631 tablet_bootstrap.cc:492] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:19:06.210194 13210 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:06.213239 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:06.213831 13884 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:06.216837 13283 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:06.218878 14647 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:06.197243 13136 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:06.211328 14631 ts_tablet_manager.cc:1403] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.072s	user 0.027s	sys 0.004s
W20260709 12:19:06.310379 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 81356.3us
I20260709 12:19:06.310680 13884 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:06.228555 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:06.324967 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 96485.8us
I20260709 12:19:06.326326 14648 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:06.326805 14648 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:06.327677 14648 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:06.356297 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 44664.1us
I20260709 12:19:06.356870 14631 raft_consensus.cc:359] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:06.360054 14631 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:19:06.360683 14631 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:06.382318 13883 raft_consensus.cc:1217] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:19:06.394354 14631 ts_tablet_manager.cc:1434] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.165s	user 0.011s	sys 0.000s
I20260709 12:19:06.400308 13034 catalog_manager.cc:5697] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:06.418787 13296 tablet_copy_service.cc:342] P b190224a708b4f068a6dda4006c3a133: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-937887e1967840639df25a74d4e57bfd received from {username='slave'} at 127.0.0.1:42730
I20260709 12:19:06.419287 13296 tablet_copy_service.cc:434] P b190224a708b4f068a6dda4006c3a133: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-937887e1967840639df25a74d4e57bfd on tablet 937887e1967840639df25a74d4e57bfd with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:06.437302 13883 raft_consensus.cc:1217] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:06.444425 13883 raft_consensus.cc:1217] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 LEARNER]: Deduplicated request from leader. Original: 3.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 12:19:06.461840 13210 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:06.467445 14621 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:06.559273 14661 raft_consensus.cc:1064] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:06.565059 14661 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:06.590132 13279 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:06.594691 14579 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:06.596730 13886 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:06.602448 14648 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:06.656399 13129 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:06.662701 14579 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:19:06.839036 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 46413.8us
I20260709 12:19:06.859387 14621 raft_consensus.cc:1064] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:06.861979 14648 raft_consensus.cc:1064] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:06.862459 14621 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:06.867965 14648 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:06.871618 14678 raft_consensus.cc:1064] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:06.874133 14678 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:06.881474 14677 raft_consensus.cc:2955] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:06.908492 13886 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:06.909811 13282 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:06.911088 13208 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:06.912719 14623 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:06.915607 14681 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:06.929054 13886 raft_consensus.cc:2955] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:06.932816 13883 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:06.934146 13135 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:06.938553 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:06.939960 13034 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:06.942504 14621 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:06.945823 14649 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:06.948572 14649 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:06.968506 13279 raft_consensus.cc:2955] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:07.030638 13208 raft_consensus.cc:2955] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:07.026990 14681 raft_consensus.cc:2955] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:07.085959 13129 raft_consensus.cc:2955] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:07.104388 13136 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:07.105603 13130 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:07.109153 13210 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:07.112712 13883 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:07.115675 13886 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:07.147804 14649 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:07.152936 14579 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:19:07.142385 14696 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 12:19:07.156169 14677 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:07.165059 14648 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:07.167479 14661 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:07.168184 14581 raft_consensus.cc:2955] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:07.180107 13282 raft_consensus.cc:2955] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:07.180409 13884 raft_consensus.cc:2955] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:19:07.196621 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 195383us
W20260709 12:19:07.321532 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 124261us
W20260709 12:19:07.337399 14696 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.136s	user 0.010s	sys 0.003s
W20260709 12:19:07.373021 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 226274us
I20260709 12:19:07.370991 13209 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:07.476724 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 152063us
W20260709 12:19:07.477547 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 44903.4us
W20260709 12:19:07.476915 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 46685.7us
I20260709 12:19:07.498245 13282 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:19:07.499336 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 125465us
I20260709 12:19:07.516930 13134 raft_consensus.cc:2955] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:07.538174 13884 raft_consensus.cc:2955] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:19:07.548996 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 70775.5us
W20260709 12:19:07.585179 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 69560.4us
W20260709 12:19:07.598742 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 68885.6us
W20260709 12:19:07.584381 14719 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
W20260709 12:19:07.636965 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 87700.5us
I20260709 12:19:07.660192 13034 catalog_manager.cc:5697] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 6, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:07.661762 13035 catalog_manager.cc:5697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:07.600601 14709 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.132s
W20260709 12:19:07.747910 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 151131us
I20260709 12:19:07.799206 13884 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:07.929095 14579 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:07.939134 13209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:07.939859 13209 raft_consensus.cc:606] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:07.907486 13208 raft_consensus.cc:2955] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:07.982484 14739 raft_consensus.cc:2955] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:07.991627 13129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:07.992401 13129 raft_consensus.cc:606] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:07.995872 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:07.997731 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:07.998603 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:08.113308 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 224750us
W20260709 12:19:08.120152 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 193527us
W20260709 12:19:08.129734 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 295164us
I20260709 12:19:08.138839 13279 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:08.144028 13134 raft_consensus.cc:2955] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:19:08.248584 14721 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:19:08.256244 13879 raft_consensus.cc:2955] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.232128 14680 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 12:19:08.331981 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 84586.1us
I20260709 12:19:08.354792 13283 raft_consensus.cc:2955] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:19:08.358438 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 111028us
I20260709 12:19:08.414999 14767 raft_consensus.cc:2955] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.421181 13879 raft_consensus.cc:2955] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.441816 13279 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:08.441943 13283 raft_consensus.cc:2955] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.462980 13031 catalog_manager.cc:5697] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.470311 14767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46516 (request call id 78) took 1117 ms. Trace:
I20260709 12:19:08.470414 13884 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:08.474637 13134 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:08.476351 14581 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:19:08.471814 14767 rpcz_store.cc:276] 0709 12:19:07.353327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.353966 (+   639us) service_pool.cc:224] Handling call
0709 12:19:07.369463 (+ 15497us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b2c0000e5c8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3795a0a 00007f70f3795693 00007f70f3795631 00007f70f4ec8902 00007f70f4ec86dd 00007f70f4e93f3f 00007f70f4e936b3 00007f70f4e8b9fa 00007f70f9e534c9 00007f70f33cfc54
0709 12:19:07.541382 (+171919us) log.cc:844] Serialized 494 byte log entry
0709 12:19:07.825470 (+284088us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b18001be220. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4ec9d01 00007f70f4e06691 00007f70f4de6eaa 00007f70f4dedd53 00007f70f4dedcd9 00007f70f4dedc69 00007f70f4dedc31 00007f70f4decdfd 0000000000388634 0000000000388479
0709 12:19:08.470225 (+644755us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":252,"mutex_wait_us":57851,"raft.queue_time_us":89332,"raft.run_cpu_time_us":16250,"raft.run_wall_time_us":448221,"spinlock_wait_cycles":26479360,"thread_start_us":218029,"threads_started":1}
I20260709 12:19:08.490329 14651 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:08.490918 14767 raft_consensus.cc:993] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:08.491410 14661 raft_consensus.cc:1081] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:08.494024 13022 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bac590852a8a4f4ea0a35528a7ae147d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:08.495323 13283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:19:08.497531 13283 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:08.497864 13283 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:08.508699 13283 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:08.511193 13283 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:08.516786 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:08.533304 14714 raft_consensus.cc:993] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:08.534662 13134 raft_consensus.cc:2955] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.520538 14581 raft_consensus.cc:2955] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.522183 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:08.539109 13209 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:08.539402 13209 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:08.540148 13209 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:08.540897 13209 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:08.534984 13212 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:08.556809 14759 raft_consensus.cc:1081] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:08.569886 13035 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 3 to 4, term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to <none>, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 2 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.581215 13032 catalog_manager.cc:5697] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 6 to 7, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 4 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.586319 14759 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:08.586905 14759 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:08.591115 13021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 937887e1967840639df25a74d4e57bfd with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:08.592923 13279 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:08.603902 13209 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:08.604311 13212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:19:08.613766 13212 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:08.614271 13212 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:08.605093 13019 catalog_manager.cc:4755] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): ChangeConfig:REMOVE_PEER RPC failed for tablet e1a3fa2c26ae4d9a8803582f91f9cff2: Remote error: Service unavailable: leader transfer in progress
I20260709 12:19:08.606141 13884 raft_consensus.cc:2955] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.617797 13879 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:08.621989 13252 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:08.618494 14766 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:19:08.623538 14755 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:08.624271 14755 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:08.630861 14766 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:08.631253 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:08.631497 14759 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:08.631858 13209 raft_consensus.cc:1813] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Handling vote request from an unknown peer af3f42f0797349058724e0cb2e637d24
I20260709 12:19:08.632316 13209 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 2: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:08.634447 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:08.635967 13100 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:08.635861 13212 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:08.636982 14759 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:08.638397 13212 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:08.629030 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 72289.9us
I20260709 12:19:08.644556 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:08.645136 13279 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:08.648962 14759 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:08.657999 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:08.658658 13136 raft_consensus.cc:3055] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:08.658941 13136 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:08.659752 13136 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:08.661342 13136 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:08.662078 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:08.625430 14755 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:08.670917 13279 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:08.669075 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:08.671963 13884 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:08.673894 14661 raft_consensus.cc:2955] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.683907 13034 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 2 to 1, leader changed from <none> to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.692126 13136 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
W20260709 12:19:08.695999 13019 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica af3f42f0797349058724e0cb2e637d24 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.698689 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet 937887e1967840639df25a74d4e57bfd with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:08.707029 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet bac590852a8a4f4ea0a35528a7ae147d with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58700
I20260709 12:19:08.709501 13879 raft_consensus.cc:2955] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.702409 13279 raft_consensus.cc:2955] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:08.735357 13022 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7285cfe46adb4975a532c3df36e5203e with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:08.738180 13035 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:08.739195 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:08.742287 14767 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:08.742800 14767 raft_consensus.cc:697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:08.741357 14773 tablet_replica.cc:333] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:19:08.743716 14767 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:08.745169 14773 raft_consensus.cc:2243] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.745878 14773 raft_consensus.cc:2272] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.749475 14773 ts_tablet_manager.cc:1916] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:08.765321 14774 tablet_replica.cc:333] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:19:08.774127 13884 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:08.789187 13035 catalog_manager.cc:5697] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 4 to 5, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:08.793438 14774 raft_consensus.cc:2243] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.794267 14774 raft_consensus.cc:2272] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.796583 13035 catalog_manager.cc:5697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:08.826412 14774 ts_tablet_manager.cc:1916] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:08.838117 13212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:08.838544 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet 7285cfe46adb4975a532c3df36e5203e with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:58700
I20260709 12:19:08.838827 13212 raft_consensus.cc:606] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Received request to transfer leadership
I20260709 12:19:08.842967 13212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:08.843534 13212 raft_consensus.cc:606] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Received request to transfer leadership
I20260709 12:19:08.846154 13212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:08.846657 13212 raft_consensus.cc:606] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Received request to transfer leadership
W20260709 12:19:08.853801 13083 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:19:08.854244 13083 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for e1a3fa2c26ae4d9a8803582f91f9cff2 already in progress
W20260709 12:19:08.854615 13083 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for e1a3fa2c26ae4d9a8803582f91f9cff2 already in progress
I20260709 12:19:08.866966 14773 ts_tablet_manager.cc:1929] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 12:19:08.867559 14773 log.cc:1199] T 937887e1967840639df25a74d4e57bfd P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/937887e1967840639df25a74d4e57bfd
I20260709 12:19:08.869400 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet 937887e1967840639df25a74d4e57bfd (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:19:08.870714 14774 ts_tablet_manager.cc:1929] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:08.871209 14774 log.cc:1199] T bac590852a8a4f4ea0a35528a7ae147d P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/bac590852a8a4f4ea0a35528a7ae147d
I20260709 12:19:08.874246 14774 tablet_replica.cc:333] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:19:08.875310 14774 raft_consensus.cc:2243] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.876101 14774 raft_consensus.cc:2272] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.878435 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet bac590852a8a4f4ea0a35528a7ae147d (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:19:08.897861 14774 ts_tablet_manager.cc:1916] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:08.921496 14774 ts_tablet_manager.cc:1929] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:19:08.923269 14774 log.cc:1199] T 7285cfe46adb4975a532c3df36e5203e P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/7285cfe46adb4975a532c3df36e5203e
I20260709 12:19:08.925484 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet 7285cfe46adb4975a532c3df36e5203e (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:19:09.180308 13136 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:09.181767 14739 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:09.183795 13879 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:09.186623 13279 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:09.188303 14739 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:09.210489 14739 raft_consensus.cc:993] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:09.211047 14739 raft_consensus.cc:1081] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:09.202577 13879 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:09.213704 13280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:19:09.214280 13280 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:09.214097 14746 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:09.214676 13280 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:09.222484 13280 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:09.236851 13884 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:09.238790 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:09.238761 14739 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:09.248759 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:09.249265 13212 raft_consensus.cc:3055] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:09.249572 13212 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:09.251606 13280 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:09.250262 13212 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:09.253847 13212 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:09.261165 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:09.264325 13249 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:09.268594 13212 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:09.269914 14746 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:09.287272 13212 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:09.294178 14746 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:19:09.575655 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:09.643663 13209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:09.644325 13209 raft_consensus.cc:606] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:09.717607 13209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:09.718263 13209 raft_consensus.cc:606] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:09.723555 13280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:19:09.724283 13280 raft_consensus.cc:606] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:19:09.743333 13136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:09.746127 13136 raft_consensus.cc:606] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:09.760927 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:09.762916 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:09.778151 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:09.846868 14714 raft_consensus.cc:993] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:09.847422 14714 raft_consensus.cc:1081] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:09.857651 13212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:19:09.858202 13212 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:09.858526 13212 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:09.881381 13212 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:09.882519 13022 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a99436c294734e5cbc3657b2517cefca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:09.884169 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:09.884780 13130 raft_consensus.cc:3055] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:09.885072 13130 raft_consensus.cc:740] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:09.885764 13130 consensus_queue.cc:260] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:09.886788 13130 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:09.908623 13130 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:09.910549 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:09.911916 13280 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:09.918625 13280 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:09.921120 13177 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:09.921980 14766 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:09.922448 14766 raft_consensus.cc:697] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:09.923316 14766 consensus_queue.cc:237] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:09.945125 14739 raft_consensus.cc:993] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:09.945629 14739 raft_consensus.cc:1081] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:09.947592 13279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:19:09.948170 13279 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:09.948504 13279 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:09.911058 13212 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:09.961424 13279 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:09.963371 13279 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:09.964805 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:09.965922 13212 raft_consensus.cc:3055] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:09.966305 13212 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:09.967128 13212 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:09.968331 13212 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.020929 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:10.022784 13134 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.054612 13134 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
W20260709 12:19:10.108521 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 43930.6us
I20260709 12:19:10.122031 13035 catalog_manager.cc:5697] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:10.140653 13212 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:10.155465 14739 raft_consensus.cc:993] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:10.156448 14739 raft_consensus.cc:1081] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:10.179744 13879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45928
I20260709 12:19:10.180759 13879 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:10.181283 13879 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:10.173637 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:10.235623 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 62297.9us
I20260709 12:19:10.203068 13879 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:10.255743 14800 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:10.257411 14800 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:10.258512 14800 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:10.259567 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:10.260275 13209 raft_consensus.cc:3055] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:10.260622 13209 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:10.261497 13209 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:10.263949 13209 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:10.273726 13209 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:10.277344 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:10.280054 13083 auto_rebalancer.cc:629] Failed to schedule move for tablet 79d6c326c49e497ab8d45ac2cf85f71f: Illegal state: Replica af3f42f0797349058724e0cb2e637d24 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:19:10.288342 13279 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:10.263031 13879 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:10.331881 13841 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:10.333835 14792 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:10.334498 14792 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:10.337772 14781 raft_consensus.cc:993] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: : Instructing follower af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:10.338389 14781 raft_consensus.cc:1081] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Signalling peer af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:10.337735 14792 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:10.374539 13279 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:10.378870 13130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:19:10.379792 13130 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:10.380260 13130 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.400033 13130 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:10.424664 13130 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:10.428138 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:10.428830 13886 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.429881 13034 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 2 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:10.430895 13031 catalog_manager.cc:5697] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 2 to 3, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 3 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:10.434454 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:10.435025 13279 raft_consensus.cc:3055] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:10.435328 13279 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:10.438733 13279 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:10.440557 13886 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:10.445765 13886 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:10.444857 13100 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:10.447733 14802 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:10.448266 14802 raft_consensus.cc:697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:10.449242 14802 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:10.454008 13209 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:10.467990 13279 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.487157 13279 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
W20260709 12:19:10.502115 13175 consensus_peers.cc:597] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06fdf45f6d794f90a80b05b5fe3f2316. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:10.504312 13130 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:10.504518 13279 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:10.510973 13032 catalog_manager.cc:5697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 3, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:10.508123 14805 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:19:10.521059 14806 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:19:10.529428 13130 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:10.532648 14767 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:10.541420 13279 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:10.550411 14805 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:10.568228 14739 raft_consensus.cc:2955] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:10.570186 13279 raft_consensus.cc:2955] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:10.589298 13136 raft_consensus.cc:2955] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:10.597772 13209 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:19:10.643610 13175 consensus_peers.cc:597] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86b4311504b54b2c8d99d43a9b057e8f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:10.643975 13277 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:10.644825 13135 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:10.645638 14805 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:10.651252 14766 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:10.662947 13032 catalog_manager.cc:5697] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:10.682658 14767 raft_consensus.cc:2955] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:10.684294 13135 raft_consensus.cc:2955] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:10.697180 14802 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:10.697896 14802 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:10.699147 13209 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:10.701730 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:10.702600 13209 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:10.706920 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:10.708092 13283 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:10.709728 13102 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:10.710749 14791 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.721225 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:10.721252 14800 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:19:10.724735 14802 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:10.737543 14791 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:10.742705 14792 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:10.742372 13279 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:10.743593 14792 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:10.746088 13135 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:10.747637 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:10.747889 14799 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:10.749234 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:10.750124 13206 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:10.752301 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:10.753217 13283 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:10.754923 13840 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:10.755975 14772 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.760387 13283 raft_consensus.cc:2955] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:10.782179 14792 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:10.798039 13212 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:10.800321 13130 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:10.804113 14800 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:10.806275 14800 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:10.790937 13032 catalog_manager.cc:5697] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:10.828100 13135 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:10.804575 14772 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:10.854944 14789 raft_consensus.cc:2955] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:10.860917 14767 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.861558 14767 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:10.862273 13130 raft_consensus.cc:2955] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:10.871048 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:10.872391 13135 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
W20260709 12:19:10.876058 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 88996.5us
I20260709 12:19:10.877164 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:10.877800 13279 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:10.874656 14767 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:10.880817 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:10.881475 13886 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:10.881512 13209 raft_consensus.cc:2955] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:10.884873 13177 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:10.886273 14805 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:10.886713 14805 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:10.887094 14805 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:10.894285 13279 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:10.896440 14825 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:19:10.902890 13249 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93c48a9952404409941f272f18f7aa28. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:10.907701 13032 catalog_manager.cc:5697] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:10.918067 14805 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:10.923568 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:10.924185 13135 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:10.931318 13135 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
W20260709 12:19:10.933216 13022 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a99436c294734e5cbc3657b2517cefca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:10.947023 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:10.947580 13283 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:10.947793 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:10.948541 13879 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:10.951939 14805 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:10.955049 13209 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:10.957625 14825 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:10.955991 13886 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:10.959968 14791 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:10.979306 13283 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:10.980502 13177 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:10.981282 14767 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:10.981786 14767 raft_consensus.cc:697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:10.982756 14767 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:10.959297 13879 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:11.028446 13035 catalog_manager.cc:5697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:11.076303 13277 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:11.079053 14791 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:11.141121 14835 ts_tablet_manager.cc:933] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:11.230156 14834 ts_tablet_manager.cc:933] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:11.252082 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:11.259994 14835 tablet_copy_client.cc:323] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:19:11.269138 14834 tablet_copy_client.cc:323] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:19:11.276849 13221 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet 06fdf45f6d794f90a80b05b5fe3f2316 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:19:11.277446 13221 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet 06fdf45f6d794f90a80b05b5fe3f2316 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-06fdf45f6d794f90a80b05b5fe3f2316
I20260709 12:19:11.276849 13222 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet 86b4311504b54b2c8d99d43a9b057e8f from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:19:11.280112 13222 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet 86b4311504b54b2c8d99d43a9b057e8f from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-86b4311504b54b2c8d99d43a9b057e8f
I20260709 12:19:11.337139 13221 tablet_copy_source_session.cc:215] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:11.335323 13222 tablet_copy_source_session.cc:215] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:11.345474 14834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fdf45f6d794f90a80b05b5fe3f2316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:11.347983 14835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b4311504b54b2c8d99d43a9b057e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:11.361004 14840 ts_tablet_manager.cc:933] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:11.391865 14840 tablet_copy_client.cc:323] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.3:35631
I20260709 12:19:11.392586 14835 tablet_copy_client.cc:806] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:11.393316 14835 tablet_copy_client.cc:670] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:11.394203 13296 tablet_copy_service.cc:140] P b190224a708b4f068a6dda4006c3a133: Received BeginTabletCopySession request for tablet 93c48a9952404409941f272f18f7aa28 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:42730)
I20260709 12:19:11.394819 13296 tablet_copy_service.cc:161] P b190224a708b4f068a6dda4006c3a133: Beginning new tablet copy session on tablet 93c48a9952404409941f272f18f7aa28 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:42730: session id = cbc6af7757ec459ab451e47724fdf44b-93c48a9952404409941f272f18f7aa28
I20260709 12:19:11.396600 13282 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:11.397971 14739 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:11.398948 14835 tablet_copy_client.cc:538] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:11.402863 13296 tablet_copy_source_session.cc:215] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:11.409971 14840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c48a9952404409941f272f18f7aa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:11.428570 14835 tablet_bootstrap.cc:492] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:19:11.437904 14834 tablet_copy_client.cc:806] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:11.438681 14834 tablet_copy_client.cc:670] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:11.443990 14834 tablet_copy_client.cc:538] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:11.463289 14834 tablet_bootstrap.cc:492] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:19:11.472935 13879 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:11.477716 13135 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:11.479163 14739 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:11.484484 14739 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:11.490180 14840 tablet_copy_client.cc:806] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:11.490862 14840 tablet_copy_client.cc:670] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:11.495123 14840 tablet_copy_client.cc:538] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:11.497189 14835 tablet_bootstrap.cc:492] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:11.498217 14835 tablet_bootstrap.cc:492] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:19:11.499037 14835 ts_tablet_manager.cc:1403] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.071s	user 0.045s	sys 0.014s
I20260709 12:19:11.508347 14835 raft_consensus.cc:359] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:11.514796 14835 raft_consensus.cc:740] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:19:11.515643 14835 consensus_queue.cc:260] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:11.514428 14840 tablet_bootstrap.cc:492] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:19:11.528854 14835 ts_tablet_manager.cc:1434] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:19:11.531111 13222 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-86b4311504b54b2c8d99d43a9b057e8f received from {username='slave'} at 127.0.0.1:36412
I20260709 12:19:11.531636 13222 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-86b4311504b54b2c8d99d43a9b057e8f on tablet 86b4311504b54b2c8d99d43a9b057e8f with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:11.604269 13282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c6b052993424c29a7d49943db353a08"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:19:11.620242 13282 raft_consensus.cc:606] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:11.641848 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:11.642465 13211 raft_consensus.cc:606] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:11.643178 14840 tablet_bootstrap.cc:492] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:11.644209 14840 tablet_bootstrap.cc:492] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:19:11.645632 14840 ts_tablet_manager.cc:1403] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.131s	user 0.046s	sys 0.026s
I20260709 12:19:11.649271 13134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:11.649849 13134 raft_consensus.cc:606] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:11.652034 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:11.653852 14840 raft_consensus.cc:359] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:11.654711 14840 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:19:11.655376 14840 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:11.664772 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:11.665936 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:11.666162 14840 ts_tablet_manager.cc:1434] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.001s
I20260709 12:19:11.676921 13296 tablet_copy_service.cc:342] P b190224a708b4f068a6dda4006c3a133: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-93c48a9952404409941f272f18f7aa28 received from {username='slave'} at 127.0.0.1:42730
I20260709 12:19:11.677451 13296 tablet_copy_service.cc:434] P b190224a708b4f068a6dda4006c3a133: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-93c48a9952404409941f272f18f7aa28 on tablet 93c48a9952404409941f272f18f7aa28 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:11.714371 14834 tablet_bootstrap.cc:492] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:11.717538 14834 tablet_bootstrap.cc:492] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:19:11.721282 14834 ts_tablet_manager.cc:1403] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.258s	user 0.028s	sys 0.005s
I20260709 12:19:11.750303 13879 raft_consensus.cc:1217] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:19:11.751690 13884 raft_consensus.cc:1217] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:11.761476 14834 raft_consensus.cc:359] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:11.762583 14834 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:19:11.763321 14834 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:11.798350 14834 ts_tablet_manager.cc:1434] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.001s
W20260709 12:19:11.827579 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 89688.3us
W20260709 12:19:11.829382 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 90737.8us
I20260709 12:19:11.864053 13222 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-06fdf45f6d794f90a80b05b5fe3f2316 received from {username='slave'} at 127.0.0.1:36412
I20260709 12:19:11.864539 13222 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-06fdf45f6d794f90a80b05b5fe3f2316 on tablet 06fdf45f6d794f90a80b05b5fe3f2316 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:11.866401 14806 raft_consensus.cc:993] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:11.867278 14806 raft_consensus.cc:1081] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:11.887877 13282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:19:11.888453 13282 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:11.888779 13282 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:11.896884 13282 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:11.915439 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:11.916043 13135 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:11.934859 13135 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:11.936241 13249 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:11.936846 13282 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:11.937280 14856 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:11.937168 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:11.937872 14856 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:11.937917 13203 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:11.938400 13203 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:11.938838 14856 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:11.939179 13203 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:11.940469 13203 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:11.950802 13203 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:11.970726 14800 raft_consensus.cc:993] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:11.971215 14800 raft_consensus.cc:1081] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:11.973656 13203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c6b052993424c29a7d49943db353a08"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46536
I20260709 12:19:11.975132 13203 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:11.975633 13203 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:11.972965 13031 catalog_manager.cc:5697] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:11.986567 13203 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:11.989041 13203 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:11.989516 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:11.990186 13282 raft_consensus.cc:3055] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:11.990501 13282 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:11.991240 13282 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:11.991348 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:11.992168 13884 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:11.992515 13282 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:12.003201 13884 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:12.007212 13175 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:12.009521 14806 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:12.010044 14806 raft_consensus.cc:697] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:12.011579 13282 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:12.010953 14806 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:12.045606 14802 raft_consensus.cc:993] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:12.046154 14782 raft_consensus.cc:1081] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:12.048085 13203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:19:12.048687 13203 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:12.049077 13203 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:12.059715 13031 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:12.070608 13203 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:12.074121 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:12.074719 13136 raft_consensus.cc:3055] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:12.075007 13136 raft_consensus.cc:740] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:12.075093 13203 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:12.075742 13136 consensus_queue.cc:260] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:12.076951 13136 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:12.080354 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:12.080940 13282 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:12.112480 13282 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:12.115550 13177 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:12.116518 14806 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:12.116988 14806 raft_consensus.cc:697] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:12.117822 14806 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:12.136157 14739 raft_consensus.cc:1064] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:12.138813 14739 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:12.168241 13279 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:12.169685 14853 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:12.133808 13136 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:12.185258 13886 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:12.188400 14849 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:12.204789 13130 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:12.206449 14853 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:12.230273 14856 raft_consensus.cc:1064] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:12.230480 13884 raft_consensus.cc:1217] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:12.270280 14856 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:12.280815 13035 catalog_manager.cc:5697] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:12.328231 14806 raft_consensus.cc:2955] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.336546 13203 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:12.339314 13884 raft_consensus.cc:2955] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.332911 13130 raft_consensus.cc:2955] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.347990 13277 raft_consensus.cc:2955] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.353380 14856 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:12.364959 13136 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:12.366304 13886 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:12.366515 14800 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:12.367893 14856 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:12.395121 14856 raft_consensus.cc:2955] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.397480 13886 raft_consensus.cc:2955] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.398110 13031 catalog_manager.cc:5697] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 4, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.405058 13884 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:12.404150 13136 raft_consensus.cc:2955] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.411682 14806 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:12.424690 13203 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:12.436980 13035 catalog_manager.cc:5697] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.456037 13884 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:12.457768 13134 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:12.460011 14739 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:12.461951 13277 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:12.463606 14806 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:12.461859 14849 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:12.486505 13211 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:12.490455 14789 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:12.496137 14767 raft_consensus.cc:2955] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.499261 13135 raft_consensus.cc:2955] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.505373 13884 raft_consensus.cc:2955] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.507498 13212 raft_consensus.cc:2955] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.559059 13134 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:12.562194 14800 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:12.582844 13022 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 86b4311504b54b2c8d99d43a9b057e8f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:12.612903 13032 catalog_manager.cc:5697] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 4 to 5, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.628219 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet 86b4311504b54b2c8d99d43a9b057e8f with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38630
I20260709 12:19:12.639371 13282 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:12.641263 13135 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:12.662422 14885 tablet_replica.cc:333] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:19:12.665537 14886 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:12.669939 13279 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:12.677855 14886 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:12.712495 13879 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:12.714028 14856 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:19:12.719698 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 99843.6us
I20260709 12:19:12.750772 14885 raft_consensus.cc:2243] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:12.751988 14885 raft_consensus.cc:2272] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.755075 13135 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:12.773469 14885 ts_tablet_manager.cc:1916] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:12.779369 14799 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:12.783461 14856 raft_consensus.cc:2955] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.794100 13135 raft_consensus.cc:2955] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.790725 13884 raft_consensus.cc:2955] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.801527 14885 ts_tablet_manager.cc:1929] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:19:12.802150 14885 log.cc:1199] T 86b4311504b54b2c8d99d43a9b057e8f P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/86b4311504b54b2c8d99d43a9b057e8f
I20260709 12:19:12.805732 13021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 93c48a9952404409941f272f18f7aa28 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:12.816653 14855 raft_consensus.cc:1064] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:12.819921 14855 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:12.807662 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet 86b4311504b54b2c8d99d43a9b057e8f (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:19:12.834077 13032 catalog_manager.cc:5697] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 3 to 4, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 1 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.846148 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet 93c48a9952404409941f272f18f7aa28 with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:12.854740 14893 tablet_replica.cc:333] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:19:12.855962 14893 raft_consensus.cc:2243] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:12.856693 14893 raft_consensus.cc:2272] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.861048 14893 ts_tablet_manager.cc:1916] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:12.873150 13282 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:12.876507 14767 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:12.880674 13886 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:12.881299 13134 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:12.892234 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:12.905180 14886 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:12.904271 14893 ts_tablet_manager.cc:1929] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:12.907780 14893 log.cc:1199] T 93c48a9952404409941f272f18f7aa28 P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/93c48a9952404409941f272f18f7aa28
I20260709 12:19:12.908232 14886 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:12.910617 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet 93c48a9952404409941f272f18f7aa28 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:19:12.941295 14855 raft_consensus.cc:2955] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.943568 13134 raft_consensus.cc:2955] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.946810 13884 raft_consensus.cc:2955] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:12.955214 13282 raft_consensus.cc:2955] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:19:13.003850 13022 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer a99436c294734e5cbc3657b2517cefca from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:13.013376 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:13.014200 13211 raft_consensus.cc:606] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Received request to transfer leadership to TS cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:12.973003 13033 catalog_manager.cc:5697] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 2 to 3, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:13.032248 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:13.033613 13211 raft_consensus.cc:606] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:19:13.051736 13277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9377aea669547028ee8449f654c60b7"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:19:13.052577 13277 raft_consensus.cc:606] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:13.054189 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:13.055908 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:13.056651 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:13.106696 13211 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:13.121372 14767 raft_consensus.cc:993] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca: : Instructing follower af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:13.122027 14855 raft_consensus.cc:1081] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Signalling peer af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:19:13.125516 13134 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:13.126734 13130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:58712
I20260709 12:19:13.127390 13130 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:13.127815 13130 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:13.139185 13884 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:13.140095 13130 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:13.144304 14849 raft_consensus.cc:993] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:13.144172 14739 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:13.144871 14849 raft_consensus.cc:1081] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:19:13.146323 13130 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:13.147553 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:13.148229 13277 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:13.150699 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:13.151379 13203 raft_consensus.cc:3055] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:13.151857 13203 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:13.152786 13203 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:13.153968 13203 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:13.166220 14739 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:13.169327 13884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45928
I20260709 12:19:13.169996 13884 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:13.170384 13884 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:13.190925 13884 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:13.190620 14739 raft_consensus.cc:2955] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:13.213883 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:13.214552 13212 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:13.214872 13212 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:13.215711 13212 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:13.216894 13212 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:13.221678 13277 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:13.223269 13102 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:13.224591 14884 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:13.225904 14884 raft_consensus.cc:697] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:13.227559 13879 raft_consensus.cc:2955] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:13.239188 14884 consensus_queue.cc:237] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:13.246074 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:13.251187 13282 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:13.257870 13033 catalog_manager.cc:5697] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New cstate: current_term: 1 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:13.193960 13203 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:13.270550 13270 tablet_service.cc:1558] Processing DeleteTablet for tablet 06fdf45f6d794f90a80b05b5fe3f2316 with delete_type TABLET_DATA_TOMBSTONED (TS b190224a708b4f068a6dda4006c3a133 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38630
I20260709 12:19:13.271596 14885 tablet_replica.cc:333] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:19:13.272811 14885 raft_consensus.cc:2243] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.273559 14885 raft_consensus.cc:2272] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.277242 14885 ts_tablet_manager.cc:1916] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:13.271150 13282 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:13.283046 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:13.284147 14772 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:13.284694 14772 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:13.285748 14772 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:13.246929 13884 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:13.245903 13130 raft_consensus.cc:2955] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:13.306545 14885 ts_tablet_manager.cc:1929] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:13.307164 14885 log.cc:1199] T 06fdf45f6d794f90a80b05b5fe3f2316 P b190224a708b4f068a6dda4006c3a133: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/wals/06fdf45f6d794f90a80b05b5fe3f2316
I20260709 12:19:13.311750 13021 catalog_manager.cc:5028] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): tablet 06fdf45f6d794f90a80b05b5fe3f2316 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:19:13.335170 13033 catalog_manager.cc:5697] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 3, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.247723 13212 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:13.249557 13022 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 06fdf45f6d794f90a80b05b5fe3f2316 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:13.250533 14874 raft_consensus.cc:993] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
W20260709 12:19:13.344048 13022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 94509.2us
I20260709 12:19:13.344133 14874 raft_consensus.cc:1081] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:13.362048 13035 catalog_manager.cc:5697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 2 to 3, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 3 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:13.366779 13211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9377aea669547028ee8449f654c60b7"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46536
I20260709 12:19:13.368368 13211 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:13.368753 13211 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:13.380231 13211 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:13.382761 13211 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:13.385241 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:13.385937 13282 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:13.386266 13282 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:13.387104 13282 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:13.388679 13282 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:13.385241 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:13.396515 13130 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:13.406908 13130 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:13.406801 13282 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:13.410287 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:13.411278 14855 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:13.411859 14855 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:13.412758 14855 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:13.429792 13035 catalog_manager.cc:5697] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 3 to 4, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.721199 13211 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:13.722452 14884 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:13.744304 13283 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:13.745759 14884 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:13.837376 13206 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:13.838701 14899 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:13.854318 13283 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:13.865324 14849 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:13.892917 13282 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:13.904664 14909 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:13.911818 13130 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:13.913657 14855 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:14.896858 13101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.005s	sys 0.002s
W20260709 12:19:14.897322 13101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.005s	sys 0.002s
W20260709 12:19:15.020047 13103 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.000s	sys 0.010s
W20260709 12:19:15.020466 13103 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.000s	sys 0.011s
I20260709 12:19:15.030465 14916 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:15.031116 14916 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:15.084398 14916 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:15.090063 14915 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:15.090799 14915 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:15.096808 14915 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:15.082353 14914 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:15.109530 14914 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:15.122701 14914 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:15.615705 13178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.004s	sys 0.039s
W20260709 12:19:15.616420 13178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.005s	sys 0.039s
W20260709 12:19:16.054603 13176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.002s	sys 0.009s
W20260709 12:19:16.055174 13176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.002s	sys 0.009s
W20260709 12:19:16.074223 13102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.016s	sys 0.046s
W20260709 12:19:16.074811 13102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.016s	sys 0.046s
I20260709 12:19:16.089587 14918 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:16.090478 14918 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:16.403399 13103 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.347s	user 0.025s	sys 0.038s
W20260709 12:19:16.404579 13103 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.026s	sys 0.038s
W20260709 12:19:16.460507 13101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.382s	user 0.018s	sys 0.048s
W20260709 12:19:16.461167 13101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.383s	user 0.018s	sys 0.048s
I20260709 12:19:16.487597 14923 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:16.488551 14923 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:16.491398 14923 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:16.493265 14923 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:16.493960 14923 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:16.496430 14923 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:16.528005 14924 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:16.528857 14918 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:16.672245 14918 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:16.672088 14924 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:19:16.672989 14918 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:16.675012 14924 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:19:16.675812 14924 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:16.676484 14924 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:16.679025 14924 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:16.679745 14924 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:16.680367 14924 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:16.682842 14924 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:16.534348 14919 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:16.692989 14919 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:16.535790 14921 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:16.695791 14921 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:16.698267 14921 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:16.698872 14921 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:16.536754 14920 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:16.699791 14920 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:16.699393 14921 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:16.705699 14918 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:16.706012 14921 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:16.706552 14918 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:16.706707 14921 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:16.537796 14922 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:16.707350 14921 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:16.721016 14921 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:16.723444 14921 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:16.724133 14921 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:16.700835 14919 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.064045 14919 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.064575 14919 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:17.065898 13102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.001s	sys 0.016s
W20260709 12:19:17.066250 13102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.002s	sys 0.016s
I20260709 12:19:17.066557 14919 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:16.707523 14920 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.067750 14920 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.068011 14919 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.068338 14920 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.068542 14919 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.069690 14929 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:16.722015 14922 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:16.725419 14927 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.070350 14920 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.070688 14927 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.071202 14920 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:16.685844 14923 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.071902 14920 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.072403 14923 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.073004 14927 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:16.707302 14918 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.074445 14923 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:16.931871 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 247) took 2792 ms. Trace:
I20260709 12:19:17.070346 14919 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:16.531358 14925 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.075101 13208 rpcz_store.cc:276] 0709 12:19:14.139168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:16.930798 (+2791630us) service_pool.cc:224] Handling call
0709 12:19:16.931154 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:16.931341 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:16.931374 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:16.931413 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:16.931467 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:16.931524 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:16.931673 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:17.071983 14922 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.076159 14925 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.061784 13134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 962) took 2915 ms. Trace:
I20260709 12:19:17.075044 14918 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:17.061920 13103 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.003s	sys 0.016s
W20260709 12:19:17.077653 13103 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.003s	sys 0.016s
I20260709 12:19:17.077315 13134 rpcz_store.cc:276] 0709 12:19:14.146612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.060909 (+2914297us) service_pool.cc:224] Handling call
0709 12:19:17.061266 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:17.061441 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:17.061468 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:17.061509 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:17.061535 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:17.061584 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:17.061718 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:17.078567 14922 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.078662 14927 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.079172 14922 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.081383 14922 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.081840 14922 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.079003 14925 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:16.923198 13176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.017s	sys 0.004s
W20260709 12:19:17.084045 13176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.017s	sys 0.004s
I20260709 12:19:17.085368 14921 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.085703 14923 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.086179 14923 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.088514 14923 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.089012 14923 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.089504 14923 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.089313 14917 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.090807 14917 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.083566 14919 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.107851 14919 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.110268 14838 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.110705 14919 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.074604 14920 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.089890 14924 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.091568 14923 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.093645 13134 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:17.111153 14838 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.079172 14927 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.113399 14919 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.113924 14919 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.114694 14927 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.076802 14930 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.082280 14922 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.115702 14930 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.116555 14919 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.117502 14922 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:17.067796 13178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.001s	sys 0.001s
I20260709 12:19:17.118631 14917 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.094656 14918 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.119752 14918 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.120463 14927 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.121021 14927 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.122524 14918 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.096963 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.098922 14932 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.124260 14922 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.124934 14922 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.124795 14932 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.111920 14924 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.127564 14922 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.128820 14927 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.129374 14924 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:17.127235 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:17.130414 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.102909 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.131721 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.119104 14930 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.134478 14838 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.135040 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.136488 14932 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.137089 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.137952 13212 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:17.139403 14920 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.119141 14917 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.140017 14920 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.140762 14922 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.141279 14922 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.142197 14920 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:17.142416 13022 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer a99436c294734e5cbc3657b2517cefca from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:17.142865 14920 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.143342 14920 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.143755 14922 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.144433 14922 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.144971 14922 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.145573 14920 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.146143 14920 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.146610 14920 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.151571 14838 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.151800 14920 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.152146 14838 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.150944 14917 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.153888 14930 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.154419 14930 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.155627 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.156324 13212 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:17.070398 14929 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:17.164585 13175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.912s	user 0.007s	sys 0.034s
I20260709 12:19:17.165426 14932 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:19:17.173365 13233 debug-util.cc:398] Leaking SignalData structure 0x7b080032d320 after lost signal to thread 11919
W20260709 12:19:17.201421 13175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.948s	user 0.008s	sys 0.034s
I20260709 12:19:17.201478 14932 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.204375 14932 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.205710 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1139) took 3098 ms. Trace:
I20260709 12:19:17.217253 14899 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.222719 14899 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.220674 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.223682 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.221832 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.224699 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.225320 13210 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:17.226662 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.226938 14899 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.227246 13210 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:17.219619 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1432) took 3081 ms. Trace:
I20260709 12:19:17.223404 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.228215 13130 rpcz_store.cc:276] 0709 12:19:14.138698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.218662 (+3079964us) service_pool.cc:224] Handling call
0709 12:19:17.218983 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:17.219195 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:17.219233 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:17.219283 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:17.219324 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:17.219394 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:17.219547 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:17.230857 14909 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.231566 14909 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.234642 14909 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.191306 13033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42070 (request call id 321) took 3219 ms. Trace:
I20260709 12:19:17.242051 13033 rpcz_store.cc:276] 0709 12:19:14.143094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:16.928494 (+2785400us) service_pool.cc:224] Handling call
0709 12:19:17.191213 (+262719us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:19:17.247439 14932 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.248343 14932 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.252692 14922 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.262482 14932 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.263175 14932 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.206264 13206 rpcz_store.cc:276] 0709 12:19:14.106990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.204662 (+3097672us) service_pool.cc:224] Handling call
0709 12:19:17.205052 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:17.205272 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:17.205318 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:17.205376 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:17.205420 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:17.205492 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:17.205640 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:17.263787 14932 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } }
I20260709 12:19:17.264346 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.265956 14932 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.266050 14917 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.313639 14938 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.315627 14932 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.316247 14932 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.318022 14950 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.316596 14938 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.320317 14950 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.268309 14930 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.268839 14799 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.269541 14933 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.275625 14935 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.276369 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.277766 14739 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.278604 14838 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.280403 14899 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.282565 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1433) took 3131 ms. Trace:
I20260709 12:19:17.285277 14909 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:19:17.286322 13233 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8060 after lost signal to thread 13069
I20260709 12:19:17.290000 14924 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.296633 14939 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.296868 14937 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.297453 14942 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.297590 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.299922 14946 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.300632 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.280496 14929 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.303776 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.304032 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.305433 14936 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.305652 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.305922 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.324034 14799 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.307816 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.308017 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.371408 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.309788 14941 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.310921 14945 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.309470 14948 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.268105 14931 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.328053 14739 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.344787 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.374598 13136 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:17.374806 13209 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:17.346484 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:17.351656 13233 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9b00 after lost signal to thread 13161
I20260709 12:19:17.375639 13212 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
W20260709 12:19:17.376379 13233 debug-util.cc:398] Leaking SignalData structure 0x7b080033bac0 after lost signal to thread 13236
W20260709 12:19:17.377472 13233 debug-util.cc:398] Leaking SignalData structure 0x7b080016c420 after lost signal to thread 13310
W20260709 12:19:17.378885 13233 debug-util.cc:398] Leaking SignalData structure 0x7b080034d860 after lost signal to thread 13911
I20260709 12:19:17.353274 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.360422 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.361171 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:17.349377 13129 rpcz_store.cc:276] 0709 12:19:14.151377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.281466 (+3130089us) service_pool.cc:224] Handling call
0709 12:19:17.281800 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:17.282007 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:17.282045 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:17.282104 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:17.282159 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:17.282229 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:17.282362 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:17.327560 14938 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.360320 14849 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.368196 13210 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:17.306571 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.337001 14930 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.370841 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.309461 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.348971 14917 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.380960 13884 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:19:17.365089 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.362783 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.367552 14884 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.396265 14739 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.402992 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.403266 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.362361 14924 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.362560 14909 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.357955 14899 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.413385 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.411803 13103 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:17.414508 13103 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:17.395242 14855 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.400113 14918 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.400763 14849 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.422772 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.415691 14947 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.424155 14906 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:17.424572 14943 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.424623 14906 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.424819 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:17.420576 13206 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:17.372267 14939 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.425400 14838 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:17.415925 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.446259 14838 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.446738 14838 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:17.357635 14935 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.414443 14932 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.404522 14930 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.432216 13103 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:17.445580 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.416271 14950 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.445777 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.452482 13883 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:19:17.408582 14917 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.376035 14946 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.425200 14906 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:17.372548 14937 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.468195 14930 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.418318 14855 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.469554 14909 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.366743 14933 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.448593 14921 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:17.423656 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.453029 14932 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.460345 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:17.460472 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 70040.5us
I20260709 12:19:17.461097 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.462251 14944 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.460489 14951 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.431370 14918 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.464870 14899 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.465601 13210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:17.466522 14849 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.467528 14799 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.451602 14952 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.469581 14937 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.415874 14884 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.433372 14940 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.481475 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:17.483289 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.464133 14924 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.405857 14931 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.401124 14945 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.400209 14941 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.399967 14948 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.485047 13203 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:17.424126 14947 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.425216 14943 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.373867 14942 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.483003 14919 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:19:17.492415 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.519088 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.519747 13209 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:17.520059 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.486723 14930 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:17.494971 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.523860 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.496421 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.497417 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.503582 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.525125 13134 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 1.
I20260709 12:19:17.487519 13210 raft_consensus.cc:606] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:17.503209 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.491946 14849 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.527659 14849 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.476166 14921 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.529923 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.530647 13886 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:17.518133 13135 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:17.531121 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.508388 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.507566 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.532282 13132 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:17.530161 14921 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:17.529927 14849 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.508044 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.392354 14936 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.534171 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.535897 14933 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.495639 14938 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.486709 14932 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.538105 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.541575 13212 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 1.
I20260709 12:19:17.524765 13175 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:17.508006 14929 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:17.509701 14855 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.555202 14942 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.557106 14947 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.507227 14953 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.507220 14899 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.504364 14952 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:17.620610 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 62379.7us
I20260709 12:19:17.550662 14933 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.552698 14929 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:17.628062 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 111118us
W20260709 12:19:17.630578 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 150734us
I20260709 12:19:17.563510 14926 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:17.631315 13175 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:17.636555 14739 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:17.637097 14739 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.637542 14739 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:17.624715 14849 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:17.620609 14950 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.560756 14943 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.552839 14938 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.549844 14930 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.620334 14799 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.618191 14937 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.493640 14944 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.518173 14940 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.651901 14949 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:17.631323 14929 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:17.649977 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.631057 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.668165 14959 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.657829 14799 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.652341 14918 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.625825 14899 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.651347 14926 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.496416 14951 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.668167 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.632624 14933 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.654430 13103 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:17.671094 13885 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:17.673166 13277 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:17.677086 14944 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.662575 14935 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.654572 14950 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.687428 13886 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:17.692377 14927 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:17.694155 14927 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.694536 14927 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:17.694695 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.686510 14942 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.696182 14942 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.696669 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:17.697438 14918 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:17.697819 14918 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.698163 14918 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:17.698258 14942 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.682027 14884 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.699407 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.700016 13132 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:19:17.700475 14938 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.701874 14930 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.703658 14945 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.703682 14939 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.705927 14918 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.706796 14838 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.658272 14937 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.708859 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:17.674446 14926 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:17.668776 14959 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.563769 14953 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.671938 14917 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.694384 14952 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.718993 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.718202 13838 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:17.682121 14946 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.721320 13175 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:17.723274 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.692163 14936 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.725380 13838 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:17.718250 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:17.726771 13277 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:19:17.718061 14739 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.687187 14941 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.684927 14931 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.728863 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.729182 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.730887 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.731721 13252 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:17.731555 13103 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:17.734102 14884 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:17.733681 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.741539 14928 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:17.741863 14958 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:17.742363 14958 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.742739 14958 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:17.741773 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.743161 14937 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.672062 14949 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:17.744163 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.729718 14917 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:17.741780 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.743009 14931 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:17.744777 13132 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 1.
I20260709 12:19:17.751565 13883 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:19:17.755617 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:17.755745 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.734820 14936 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:17.758857 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.757133 14949 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.760068 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.739511 14920 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:17.761502 13175 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:17.732581 14948 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.745013 14884 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.748986 14918 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.738390 14906 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.784428 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:17.894305 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.913245 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:17.924527 13129 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:17.909273 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.867082 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.875099 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.886991 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.913870 13883 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:19:17.862777 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:17.927074 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 165632us
I20260709 12:19:17.767621 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:17.930698 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 163162us
I20260709 12:19:17.931229 13175 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:17.932367 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:17.932960 13879 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:17.752895 14838 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:17.750982 14917 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.928153 13283 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:17.799268 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.952286 13281 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:17.936609 13212 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:17.938227 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.905869 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:17.944139 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 185151us
I20260709 12:19:17.766039 13132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:17.946341 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.948177 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.953665 13132 raft_consensus.cc:606] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:17.753654 14931 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.971403 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.799875 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.800364 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.923318 14920 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:17.800472 14954 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:17.998437 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 44872.4us
I20260709 12:19:17.762893 14936 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.886272 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.007762 14936 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:17.761483 14957 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:18.011196 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.011790 13281 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:17.887784 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.855576 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:17.908802 14932 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:18.000371 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.905143 14950 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.855067 14921 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.949807 14906 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.995797 13284 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:19:18.029042 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:18.029548 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.030146 13284 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 1.
I20260709 12:19:18.030252 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.030975 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.926378 14884 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:17.886309 14899 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:18.009234 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.874359 14929 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:17.908603 14940 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.957401 14948 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:18.011004 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:17.763226 14799 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:17.784380 14962 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:18.000171 14923 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:18.041199 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.971447 14931 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:17.861575 14849 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:17.904572 14953 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:17.855191 14959 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.051002 13137 raft_consensus.cc:2393] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:18.055017 13879 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:17.957876 14917 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:17.972759 14918 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:18.063732 14918 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:18.027786 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:18.028265 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.028419 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.033020 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.046110 14849 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.038316 13136 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.034138 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:17.799906 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.008703 14933 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.039036 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.031412 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:18.045351 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 132894us
I20260709 12:19:18.056461 13884 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:18.000377 14927 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.072686 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:18.058262 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 127257us
I20260709 12:19:18.059558 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.041334 14923 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:18.060742 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.075273 13281 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:18.033829 14929 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.003871 14920 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.064203 14918 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:17.817520 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.033433 14948 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:18.031776 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.069340 13129 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
W20260709 12:19:18.069769 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 60313.1us
I20260709 12:19:18.071098 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.073987 13177 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.065629 14962 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.090405 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.071839 14909 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:18.097288 14739 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.135311 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.136584 14921 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.136745 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.137982 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.143626 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:18.144869 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:18.145694 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.140980 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.146742 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.087270 14923 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:18.148185 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.148339 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.031486 14954 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.149837 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.168952 14739 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:18.169512 14739 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:18.075285 13278 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:18.151113 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.169890 14739 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.170610 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.094223 14937 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:18.178486 13129 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.171772 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.066418 14951 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.094028 14948 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:18.147966 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.171240 13133 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:18.176625 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:18.177608 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:18.177968 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.178514 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:18.173051 13284 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:19:18.180824 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.033371 14957 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.182742 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:18.193557 14954 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.193981 14957 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:18.142287 14909 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:18.194939 14909 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:18.194159 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:18.195638 13286 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:18.184254 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.196432 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:18.202643 14909 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.204147 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.206408 14917 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.211793 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.215056 14739 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.217211 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.217128 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.178725 14937 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:18.189260 13203 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 1.
I20260709 12:19:18.224749 14739 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.224743 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.239811 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.249666 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.231150 14937 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:18.254956 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:18.255452 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 181523us
I20260709 12:19:18.256212 13177 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.258996 13177 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.258939 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.223909 14926 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.264062 13134 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.263566 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.267118 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.222888 14943 consensus_queue.cc:1059] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:19:18.238070 14884 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.271209 14739 raft_consensus.cc:993] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:19:18.270598 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.271842 14739 raft_consensus.cc:1081] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
W20260709 12:19:18.263244 14958 consensus_meta.cc:287] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.003s
I20260709 12:19:18.272549 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.273590 13177 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.263558 14974 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:18.276213 13177 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.278717 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.279013 13177 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.280310 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.282015 14739 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:18.282387 14739 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:18.282706 14739 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:18.279917 14925 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:18.283995 14953 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.284217 14925 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:18.284400 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.283859 13128 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 4: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:18.288775 14925 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.288008 14962 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:18.315325 13132 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:18.327541 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.274400 14855 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:18.288949 14973 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:18.274744 14958 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:18.331339 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.332338 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.333223 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.325274 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.277750 14974 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:18.276031 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.286178 14927 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:18.355195 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 73363.6us
I20260709 12:19:18.356760 14739 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:18.356021 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 75767.5us
I20260709 12:19:18.356585 13135 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:18.358860 13841 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.326169 14931 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.360026 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.360695 13280 raft_consensus.cc:2393] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 4: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:18.361730 14931 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.317272 14961 raft_consensus.cc:3055] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:18.367053 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.313416 14926 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.309011 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.330415 14943 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.372545 13137 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.373256 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:18.326023 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.330906 14855 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:18.345558 14974 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:18.375126 13841 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.334720 14973 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:18.378180 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.375362 13882 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
W20260709 12:19:18.380394 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 201636us
I20260709 12:19:18.379467 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.382751 14739 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.322981 14936 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.384862 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.386595 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.387661 13208 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.367693 14917 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.385114 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.384935 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.389521 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.385762 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.375651 14960 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:18.390918 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.399765 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.399767 13887 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:18.388645 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.367501 14961 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:18.391340 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.389938 13100 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.393373 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.405318 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.405596 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.406013 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.406458 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:18.407080 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.403548 14966 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.394090 14936 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.394512 13211 raft_consensus.cc:1240] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:18.396998 14884 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.397212 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.400597 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.400455 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.379364 14855 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.401544 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.402299 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.380237 14973 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:18.378959 14956 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:18.403650 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.404673 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.420300 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.379952 14978 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.408922 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.413328 14977 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.415844 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.416509 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:18.412930 13100 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:18.419057 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 52742.5us
I20260709 12:19:18.423497 13177 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.423772 13100 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.423854 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.425223 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.425592 13100 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:18.425650 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.426338 14838 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.426270 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.427578 14838 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:18.428258 14838 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:18.428308 13100 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:18.428529 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.428742 14838 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.429530 14919 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:18.429533 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.430014 14919 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:18.430397 14919 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:18.430709 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.431005 14962 consensus_queue.cc:1059] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:18.431823 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.432122 14931 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:18.432528 14931 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:18.427575 14917 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:18.432973 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.433290 14917 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:18.433765 14917 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:18.434402 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.435784 13279 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:18.437079 13102 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.438221 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.438935 14929 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:18.439751 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:18.439693 13100 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.441422 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:18.442409 14919 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.442898 13102 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.444110 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:18.446825 13129 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.446924 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.417920 14899 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:18.451957 14739 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:18.452373 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.452929 14739 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:18.453454 14739 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.454737 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.453752 13102 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.422295 14956 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:18.445757 14884 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:18.456982 13100 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f042aff5e3084d5e8bd6fcb5335160f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:18.457257 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.467970 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.469033 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.470013 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.470984 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.462144 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.472525 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.472729 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.473395 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.473436 14973 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:18.473847 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.474704 13209 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
W20260709 12:19:18.464929 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 49912.3us
I20260709 12:19:18.474365 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.462445 13102 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.454504 14899 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:18.481041 14971 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.485100 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:18.484251 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.484457 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.489095 14884 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:18.488006 14980 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:18.542677 14919 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.606280 14959 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.606361 14980 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:18.607280 14980 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.607751 14982 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:18.462843 14929 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.490542 13840 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:18.612095 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 121647us
I20260709 12:19:18.612952 13883 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:18.613473 13840 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.462675 14909 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.488092 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.618034 14971 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:18.618180 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 130142us
I20260709 12:19:18.487567 14981 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.547209 14925 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.462787 14956 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:18.457235 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.629566 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.630908 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:18.587227 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 102864us
I20260709 12:19:18.558930 14739 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.543560 14921 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:18.549453 14975 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.548266 14948 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.544538 13131 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.483397 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.542987 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.498095 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.549052 14838 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.498422 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.496533 14918 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.486796 14899 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.498428 14849 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:18.539732 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 76530us
I20260709 12:19:18.600692 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:19:18.670472 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 69886.7us
I20260709 12:19:18.672675 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.461041 14927 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:18.544694 14855 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.616302 14970 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.617041 14966 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.678354 13886 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:18.622900 13102 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.679195 14855 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:18.679517 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 56693.7us
I20260709 12:19:18.680258 14927 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.681342 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.682755 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.684523 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.685364 14927 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.622977 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:18.625494 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.627117 14925 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.635342 14973 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:19:18.635226 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.693444 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:18.696158 14971 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:18.696736 14971 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.697510 13204 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.698911 14971 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.699765 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:18.703181 13100 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.624178 14984 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:18.638290 14937 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.638315 14954 consensus_queue.cc:1059] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:18.644872 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.643550 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.646965 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.649768 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.652788 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.659561 13283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:19:18.665856 14838 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.660957 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.665830 14931 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.647701 14964 raft_consensus.cc:993] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:18.645509 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:18.645442 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:18.631532 14961 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.623857 14982 raft_consensus.cc:697] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:18.730857 14982 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.706840 14971 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:18.658455 13212 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.677631 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:18.733208 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 55656.9us
I20260709 12:19:18.733830 13884 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:18.734160 13103 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.678659 14981 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:18.715229 13203 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.686244 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.687160 13279 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:18.683274 13102 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.687495 13840 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:18.756719 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 69337.6us
I20260709 12:19:18.682704 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.688864 13211 raft_consensus.cc:2393] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 2: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:18.689266 14739 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.690887 13838 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.693405 14967 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:18.637490 14917 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.704550 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:18.711479 13283 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:18.714557 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:18.714864 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 65179.2us
I20260709 12:19:18.762480 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.761585 13283 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:18.732443 14958 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.765913 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:18.759048 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 68238.8us
W20260709 12:19:18.759555 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 301886us
I20260709 12:19:18.767866 13249 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.768498 13175 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.769668 13249 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.774930 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.774263 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.777755 14739 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:18.778606 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 85496.9us
I20260709 12:19:18.733249 14933 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.752558 14922 raft_consensus.cc:1081] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:19:18.751386 14884 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.820027 14986 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.820281 14918 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.783721 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:18.824442 14980 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.825659 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:18.826814 14980 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.826951 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:18.828413 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 47233.7us
W20260709 12:19:18.830704 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 147502us
I20260709 12:19:18.811506 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:18.831719 13102 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:18.821321 14920 consensus_meta.cc:287] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.003s
W20260709 12:19:18.832733 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 57897us
I20260709 12:19:18.833197 13208 raft_consensus.cc:1240] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
W20260709 12:19:18.833864 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 55244.9us
W20260709 12:19:18.835294 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54843.5us
I20260709 12:19:18.834622 13102 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.762104 14942 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:18.773521 14923 consensus_meta.cc:287] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.594s	user 0.014s	sys 0.001s
I20260709 12:19:18.778266 14967 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:18.836796 14975 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.838541 14799 consensus_queue.cc:1059] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:18.839699 13252 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.780970 14951 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.840571 14937 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.761567 14970 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:18.883862 13212 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.843216 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:18.827732 14974 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.712098 14984 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.885481 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.836988 14931 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.854252 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:18.855908 14987 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.832846 14958 consensus_queue.cc:1059] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:19:18.858067 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.779148 14954 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:18.912734 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.856410 14983 consensus_queue.cc:1059] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 12:19:18.914206 14983 raft_consensus.cc:3055] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:18.845098 14986 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:19:18.859548 14906 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.859674 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:18.860298 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.873473 14956 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.840303 14940 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:18.860042 14967 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:18.844317 14927 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.864403 13033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42064 (request call id 317) took 1205 ms. Trace:
I20260709 12:19:18.928540 13033 rpcz_store.cc:276] 0709 12:19:17.659341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.659592 (+   251us) service_pool.cc:224] Handling call
0709 12:19:18.864309 (+1204717us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 12:19:18.866027 14917 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.861123 14964 raft_consensus.cc:2955] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:18.870190 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.914601 14983 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:18.778388 14936 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:19:18.911054 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:18.889861 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:18.892319 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.781188 14932 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.886421 14957 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:18.919914 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 45231.2us
W20260709 12:19:18.924539 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 66524.7us
I20260709 12:19:18.942356 13102 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:18.930336 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 86660.4us
W20260709 12:19:18.928472 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.914978 14937 consensus_queue.cc:1059] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:19:18.932835 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 62752us
I20260709 12:19:18.842455 14920 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:18.930456 14926 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.955224 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:18.955830 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 66378.2us
I20260709 12:19:18.870415 13283 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.943828 13102 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.944159 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.946705 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:18.948410 13209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:19:18.960075 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:18.960804 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.961825 13102 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.959851 14969 consensus_queue.cc:1059] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:19:18.963352 13283 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:18.964972 13102 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.953606 13208 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:18.960837 13209 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:18.967126 13209 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.967403 13840 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.953670 14974 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.932135 14948 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.862026 14923 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:18.963378 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.963603 14985 consensus_queue.cc:1059] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:19:18.969167 14977 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.953490 14959 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:18.939402 14849 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.970283 13210 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:18.965402 13175 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.960049 14953 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.949743 14986 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.970664 14927 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.964883 14929 raft_consensus.cc:3055] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:18.976203 13128 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:18.969856 14923 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:18.977108 14962 raft_consensus.cc:3055] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:18.977458 14978 raft_consensus.cc:3055] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:18.979862 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.979041 13209 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:18.981913 13102 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:18.982757 14951 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:18.992228 13209 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:19:18.992359 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:18.985800 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:18.980131 14984 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:18.993136 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:18.987710 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 95501.3us
I20260709 12:19:18.965080 14987 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:19.002614 14955 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.989998 14962 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.001551 14923 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.004047 14962 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.005112 14962 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.001709 14957 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.001593 14972 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:19.001619 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:18.970108 14940 consensus_queue.cc:1059] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:19:18.979799 14960 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:19:18.991343 14978 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:18.988130 14948 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.007851 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.012688 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.013681 14986 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:18.986851 14929 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:19.013616 14992 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.007393 13175 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.022347 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:18.992447 14961 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:18.986441 14926 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:19:19.008407 14919 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.015653 14972 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:19.015539 14953 consensus_queue.cc:1059] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:19:19.031870 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.032683 13175 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.033900 13209 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:19.000352 14969 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:19:19.041023 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:19.029418 14951 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:19.040863 14991 consensus_queue.cc:1059] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:19:19.042928 14960 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.047140 13249 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.041301 14942 raft_consensus.cc:3055] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:19.049441 13175 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.052788 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:19.038908 14928 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:19.048058 14974 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.039776 14956 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:19.048595 14940 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.065034 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:19.099769 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 52741.4us
I20260709 12:19:19.100538 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.061194 14942 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:19.103298 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.104338 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.105646 13249 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.094208 14982 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.107326 13249 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.108969 13249 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.101117 14992 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.111886 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.101542 14925 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.102023 14932 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.103407 14920 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:19.058411 14929 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.106498 14933 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.118394 13209 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:19.119210 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:19.124922 13207 raft_consensus.cc:3055] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.119464 13206 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:19.122083 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:19.122169 13175 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.122814 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:19.109735 14940 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.123776 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:19.109552 14991 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:19.125137 13207 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:19.108352 14956 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:19.112779 14984 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:19.112614 14947 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:19.129441 14925 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.131791 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:19.132359 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:19.132999 13175 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.133365 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:19.136581 13136 raft_consensus.cc:2393] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:19.140774 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.141752 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.144511 14988 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.144387 13207 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.094718 14975 consensus_queue.cc:1059] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:19:19.061949 14978 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.148465 14923 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.148497 13207 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.130095 14992 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.151337 13175 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.128804 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:19.136571 14956 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.145556 14984 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.159544 14849 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.145274 14924 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.161226 14947 consensus_queue.cc:1059] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:19:19.160616 14981 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:19.164405 14932 raft_consensus.cc:3055] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.164889 14932 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.167912 13207 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:19.167052 14932 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.180320 14932 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.048177 14972 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.141201 14899 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.187239 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:19.187574 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 75733.9us
I20260709 12:19:19.188428 13249 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.192162 13249 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.199697 13249 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.199867 13887 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:19.201570 13249 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.200573 13252 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:19.198200 14940 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:19.204315 13249 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.206284 14947 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.213725 14995 ts_tablet_manager.cc:933] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:19:19.214654 14799 raft_consensus.cc:3055] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:19.215087 14799 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.201800 14992 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.203001 14933 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.220873 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.206712 14956 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:19.232173 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:19.232905 13286 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.226261 14937 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.259943 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:19.261231 13177 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.262789 13880 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:19.262861 13212 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:19.266117 14977 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:19.270316 14909 raft_consensus.cc:3055] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:19:19.268646 14971 consensus_meta.cc:287] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 12:19:19.271343 13137 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:19.233322 14940 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:19.241043 14947 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:19.284576 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:19.285008 14940 raft_consensus.cc:697] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.282302 14984 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.286008 14940 consensus_queue.cc:237] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.289851 13135 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:19.274803 14952 raft_consensus.cc:3055] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:19.296507 14995 tablet_copy_client.cc:323] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:19:19.275753 14909 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:19.299232 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 98730.5us
I20260709 12:19:19.293088 14971 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:19.306584 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:19.298012 14952 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.306404 14921 raft_consensus.cc:3055] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.311856 14921 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:19.311697 14952 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.312819 14921 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.312851 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:19.291400 14953 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:19:19.300024 14974 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.313794 14994 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:19.331931 14994 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:19.333120 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.317195 14928 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:19.308162 14899 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:19.320128 14969 raft_consensus.cc:3055] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:19.322224 13286 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:19.321276 13033 catalog_manager.cc:5697] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 2, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.337291 13177 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:19.322791 14957 raft_consensus.cc:3055] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.342118 13211 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:19.323335 14936 raft_consensus.cc:3055] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:19.342449 14957 raft_consensus.cc:740] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.342818 14936 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:19.325568 13279 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:19.326278 13175 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.343444 14957 consensus_queue.cc:260] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.344540 13175 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.344735 14957 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.345289 14981 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.345918 14981 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.346415 14936 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.322877 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:19.326345 14909 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.336051 14969 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:19.340114 14988 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:19.347960 14922 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.351027 14988 raft_consensus.cc:697] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:19.349603 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.349128 14909 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.352087 14988 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:19:19.355533 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.350148 14969 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.362365 13285 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:19.348168 14936 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.369365 14969 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.363333 14994 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.365010 14951 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:19.371709 14951 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.372557 14951 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.373706 14951 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:19.375204 14952 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:19.375659 13207 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:19.377775 13207 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:19.375890 14994 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:19.363309 14974 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:19:19.397774 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.368103 14967 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.392910 14964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60850 (request call id 15) took 2298 ms. Trace:
I20260709 12:19:19.402287 13204 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:19.393187 13205 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:19.389112 14987 consensus_queue.cc:1059] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:19:19.403950 14909 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.404690 14987 raft_consensus.cc:3055] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:19.393196 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet f042aff5e3084d5e8bd6fcb5335160f5 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:19:19.405227 14987 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:19.405483 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet f042aff5e3084d5e8bd6fcb5335160f5 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-f042aff5e3084d5e8bd6fcb5335160f5
I20260709 12:19:19.388163 14899 consensus_queue.cc:1059] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:19:19.407392 14919 raft_consensus.cc:3055] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.407860 14919 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:19.411151 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.413683 14919 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.415872 14919 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:19.422852 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.419045 14978 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.420104 14961 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.420413 14909 consensus_queue.cc:1059] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:19:19.424453 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 220199us
I20260709 12:19:19.426445 13249 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.433604 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.434700 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.435709 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.439697 13249 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:19.443363 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:19.444335 14954 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:19.383612 15003 consensus_queue.cc:1059] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:19:19.451733 14961 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:19.438163 14962 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.436530 14932 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:19.432425 14931 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.438007 15000 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:19.456347 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.443478 14967 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:19.483588 13887 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:19.406262 14987 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.456941 13102 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.487378 13879 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:19.487183 13132 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:19.452930 14992 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.485364 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:19.456212 14961 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:19.493851 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:19.499967 13136 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.482282 14909 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:19.498315 13204 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 3. Ops: []
I20260709 12:19:19.506137 13133 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:19.506973 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:19.507637 15008 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:19:19.510251 14909 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.489581 14849 consensus_queue.cc:1059] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:19:19.452320 14983 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.513928 14983 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.515208 14942 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.515921 14961 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.516695 14942 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.517225 14961 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.519336 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.522742 13210 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:19.522871 13175 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:19.523838 14974 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:19.523905 13204 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:19.493826 14884 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:19.530383 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:19.532035 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:19.531003 14906 consensus_queue.cc:1059] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:19:19.535570 14991 consensus_queue.cc:1059] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:19.536578 14991 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:19.537454 14991 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:19.537770 14991 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.539788 13212 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 2: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:19.522450 14909 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:19.486984 14799 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.531600 13880 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:19.401829 14964 rpcz_store.cc:276] 0709 12:19:17.090631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.091911 (+  1280us) service_pool.cc:224] Handling call
0709 12:19:17.115198 (+ 23287us) log.cc:844] Serialized 499 byte log entry
0709 12:19:19.387332 (+2272134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1505,"raft.run_cpu_time_us":31513,"raft.run_wall_time_us":198336,"thread_start_us":55759,"threads_started":1,"wal-append.queue_time_us":157635,"wal-append.run_cpu_time_us":1765,"wal-append.run_wall_time_us":1002939}
I20260709 12:19:19.559520 14922 raft_consensus.cc:3055] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:19.559937 14922 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:19.555197 13136 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:19.532492 14974 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.538607 14991 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.560747 14922 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.561604 14991 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.561883 14922 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:19.547188 14986 consensus_queue.cc:1059] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:19:19.560088 14975 consensus_queue.cc:1059] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:19.573882 14975 consensus_queue.cc:1243] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:19:19.569877 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:19.571372 13880 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:19.571849 14959 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:19.576231 14959 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.576422 13841 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:19:19.576721 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.577054 14959 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.578356 14959 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.572783 13204 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
W20260709 12:19:19.552443 15004 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:19:19.580979 14984 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:19:19.585732 14986 raft_consensus.cc:3055] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.586174 14986 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:19.600925 13203 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:19.579905 14970 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.586967 14986 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.623265 14929 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:19.632655 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:19.648037 15009 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:19:19.654678 13129 raft_consensus.cc:3055] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.655139 13129 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:19.637063 14986 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:19.658674 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.655954 13129 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:19.645884 14923 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:19.659946 13129 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.659596 14923 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:19.665674 13129 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:19.669399 15005 raft_consensus.cc:3055] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.669857 15005 raft_consensus.cc:740] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.670020 13284 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:19.670747 15005 consensus_queue.cc:260] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:19.671902 15005 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.718657 14923 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.720165 14923 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:19.721920 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:19.521693 14926 consensus_queue.cc:1175] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cbc6af7757ec459ab451e47724fdf44b" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:19.886140 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:19.888618 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:19.889572 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:19.890373 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.900794 13280 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 3. Ops: [1.2-1.2]
I20260709 12:19:19.917042 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.918910 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:19.931066 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.926360 14947 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 12:19:19.938817 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.939218 14947 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.939664 14947 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.941850 14799 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:19.908850 14961 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.944676 13249 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.947507 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 1514) took 1005 ms. Trace:
I20260709 12:19:19.921526 14952 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:19.949780 13249 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:19.940480 14947 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.924945 15010 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:19.947991 13285 rpcz_store.cc:276] 0709 12:19:18.941804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.943550 (+  1746us) service_pool.cc:224] Handling call
0709 12:19:19.947326 (+1003776us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400336654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:19.947449 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845207424}
I20260709 12:19:19.959817 14947 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.950649 14959 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:19.965142 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.952104 14992 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:19.922075 14951 consensus_queue.cc:1059] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:19:19.949702 14961 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.974530 14951 raft_consensus.cc:3055] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:19.974936 14951 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:19.975744 14951 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:19.975950 14961 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:19.976576 14951 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:19.981693 15012 log.cc:927] Time spent T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:19:19.928289 15003 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:19:19.955554 14940 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 12:19:20.068312 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:20.120229 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:20.122165 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:20.132297 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:20.144223 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.187885 14987 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:20.269220 14983 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:20.271946 14983 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.277153 14983 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.277360 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:20.278865 13130 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:20.284109 14923 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:20.285061 14923 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.335305 13033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42064 (request call id 318) took 1385 ms. Trace:
I20260709 12:19:20.338354 13034 catalog_manager.cc:5697] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:20.367323 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.344498 13033 rpcz_store.cc:276] 0709 12:19:18.950045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.950234 (+   189us) service_pool.cc:224] Handling call
0709 12:19:20.335041 (+1384807us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:19.500904 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:19.589196 (+ 88292us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:19.589230 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:19:19.589248 (+    18us) tablet.cc:662] Decoding operations
0709 12:19:19.657292 (+ 68044us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:19.663806 (+  6514us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:19.668734 (+  4928us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:19.673882 (+  5148us) tablet.cc:701] Row locks acquired
0709 12:19:19.673904 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:19:19.674066 (+   162us) write_op.cc:270] Start()
0709 12:19:19.674177 (+   111us) write_op.cc:276] Timestamp: P: 1783599559674020 usec, L: 0
0709 12:19:19.674198 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:19:19.711298 (+ 37100us) log.cc:844] Serialized 533 byte log entry
0709 12:19:20.019130 (+307832us) op_driver.cc:464] REPLICATION: finished
0709 12:19:20.076417 (+ 57287us) write_op.cc:301] APPLY: starting
0709 12:19:20.076529 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:20.076678 (+   149us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:20.076853 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:20.077180 (+   327us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:20.077359 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:19:20.077419 (+    60us) write_op.cc:312] APPLY: finished
0709 12:19:20.077654 (+   235us) log.cc:844] Serialized 23 byte log entry
0709 12:19:20.077837 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:20.077927 (+    90us) write_op.cc:454] Released schema lock
0709 12:19:20.077989 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:20.078375 (+   386us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:20.078408 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":277344,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":56982,"apply.run_cpu_time_us":1921,"apply.run_wall_time_us":1970,"num_ops":1,"prepare.queue_time_us":145766,"prepare.run_cpu_time_us":66110,"prepare.run_wall_time_us":462195,"raft.queue_time_us":1056,"raft.run_cpu_time_us":13141,"raft.run_wall_time_us":57312,"replication_time_us":344733,"thread_start_us":407595,"threads_started":4,"wal-append.queue_time_us":287296}]]}
I20260709 12:19:20.392817 13130 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:19:20.395920 13134 consensus_meta.cc:287] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.670s	user 0.012s	sys 0.012s
I20260709 12:19:20.396631 13134 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:20.398870 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:20.401255 13135 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:20.408087 13204 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.407203 13147 tablet_copy_source_session.cc:215] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:20.413424 13147 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:60854 (request call id 308) took 1049 ms. Trace:
I20260709 12:19:20.413832 13147 rpcz_store.cc:276] 0709 12:19:19.377791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.388410 (+ 10619us) service_pool.cc:224] Handling call
0709 12:19:20.406235 (+1017825us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540011c954. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e973f7 00007f70f9e2d036 00007f70f9e36a3e 00007f70f16fa27b 00007f70f9e369ba 00007f70f9e31acc 00007f70f9e2cc7b 00007f70f9e218d1 00007f70f8ed54b4 00007f70f8ed5442
0709 12:19:20.413266 (+  7031us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313696000}
W20260709 12:19:20.436712 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.445911 14989 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:20.449477 15013 raft_consensus.cc:3055] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.449936 15013 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:20.437577 14933 raft_consensus.cc:3055] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.451416 15013 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.455775 15013 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.463347 14942 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.464214 14942 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.468313 14942 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:20.469959 14933 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:20.471634 14933 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.474309 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.476533 14942 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:19:20.477157 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:20.474367 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.482437 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.483117 14995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f042aff5e3084d5e8bd6fcb5335160f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:20.483268 13285 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:20.485128 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:20.489861 13177 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:20.477003 14942 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.501518 13136 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:20.503055 13033 catalog_manager.cc:5697] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 3, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 3 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.474364 14933 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:20.512682 13134 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 1479) took 1392 ms (client timeout 1834 ms). Trace:
W20260709 12:19:20.513252 13134 rpcz_store.cc:269] 0709 12:19:19.120583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.122514 (+  1931us) service_pool.cc:224] Handling call
0709 12:19:20.512425 (+1389911us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54001383d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:20.512586 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377331584}
I20260709 12:19:20.501780 14961 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.516441 13840 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.516248 14961 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:20.517200 13203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.016s	sys 0.055s
W20260709 12:19:20.517839 13203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.017s	sys 0.056s
I20260709 12:19:20.500654 14982 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:20.520345 14982 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:20.508116 14942 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.523517 13286 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:20.522475 13838 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.523831 14982 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.537640 14923 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:20.542141 13282 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:20.544154 14919 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.544900 14919 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.548110 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.548214 13102 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:20.548828 13203 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:20.550282 14986 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:20.550596 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.550458 14978 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:20.551301 14978 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:20.551785 14978 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:20.552086 13136 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:20.554878 14983 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:20.555401 14983 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.555802 14983 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.550465 13103 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:20.561864 14971 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:20.562291 14971 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.562345 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42730 (request call id 210) took 1049 ms. Trace:
I20260709 12:19:20.562701 14971 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:20.564427 14961 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.565099 14961 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.565663 14961 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.562825 13284 rpcz_store.cc:276] 0709 12:19:19.513188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.517999 (+  4811us) service_pool.cc:224] Handling call
0709 12:19:20.561973 (+1043974us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400096ad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:20.562160 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314904320}
I20260709 12:19:20.570647 14921 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.572861 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.573848 13210 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:20.573619 14923 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:20.575966 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.576722 13204 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:20.577852 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.578161 14924 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:20.578615 13212 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
W20260709 12:19:20.567546 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.573263 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:20.582546 14969 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:20.582710 13129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 1484) took 1460 ms (client timeout 1773 ms). Trace:
I20260709 12:19:20.583077 14969 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:20.583117 13129 rpcz_store.cc:269] 0709 12:19:19.122349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.123521 (+  1172us) service_pool.cc:224] Handling call
0709 12:19:19.654548 (+531027us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b54000a8d20. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e04dc0 00007f70f4e90e18 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:20.582349 (+927801us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540011c954. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:20.582533 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1025185280}
I20260709 12:19:20.585073 13135 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:20.585769 14969 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.586499 14969 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:20.589108 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.589915 13203 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
W20260709 12:19:20.590392 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:20.590950 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.591933 13033 catalog_manager.cc:5697] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 3, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2), now has a pending config: VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3), VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1), VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2), NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 3 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:20.595722 14992 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:20.596446 14992 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.599040 14992 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:20.600098 15013 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:20.603250 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:20.604101 14994 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.604794 14994 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.604152 13129 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:20.607223 14994 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.614681 14994 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.607234 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.633332 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.640501 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.640264 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.600045 14961 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:20.632205 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 206671us
W20260709 12:19:20.648739 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 49731us
I20260709 12:19:20.652038 13203 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:20.654752 13204 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:20.643604 15013 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.658208 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.645412 14992 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:20.669119 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.638075 14978 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.662621 14957 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.645823 14994 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.662019 13103 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:20.655648 14921 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.669147 13285 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:20.668639 15013 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.689694 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:20.691642 14992 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.692373 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.693078 13286 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:20.693943 14992 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:20.695675 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.696210 15028 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:20.696455 13285 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:20.696696 15028 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.696930 14987 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:20.697141 15028 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.697578 14987 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.698020 14987 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.698710 14983 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.700645 13175 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:20.704658 13840 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:19:20.712670 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 50791.8us
I20260709 12:19:20.702570 14933 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.680581 14942 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:20.723179 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 89984.2us
W20260709 12:19:20.730232 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 91277.4us
I20260709 12:19:20.731364 13841 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.735739 15024 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:20.736276 14917 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.736227 15035 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:20.738456 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 58203.9us
I20260709 12:19:20.727365 15031 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:20.740315 14994 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.741595 14978 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.753404 15031 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:20.743726 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:20.753906 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:20.754153 13878 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:20.754575 13129 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:20.743963 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:20.755352 13881 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:20.755355 14917 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.757390 14983 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:20.758255 14917 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.716028 14921 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.750721 15035 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.711522 14957 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.762595 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:20.762878 14919 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.756068 13135 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.764334 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.764652 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.765326 13279 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:20.753916 15031 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.766847 13102 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:20.767741 14998 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:20.768368 14998 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.768769 14998 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.774235 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:20.774784 14942 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:20.775053 13133 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:20.760393 14921 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.759769 15035 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:20.777038 14957 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:20.780211 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.780961 13204 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:20.768056 14973 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:19:20.781775 15022 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.782363 15022 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.746388 15013 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:20.741770 14971 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.738967 14933 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.786644 14933 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:20.787243 13249 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.750226 15024 raft_consensus.cc:697] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:20.742411 14961 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.787420 14971 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.788206 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.789052 13212 raft_consensus.cc:2393] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:20.788154 14961 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.788574 15024 consensus_queue.cc:237] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.790838 14961 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.791908 15022 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:20.748711 13841 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.795444 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.796155 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:20.796707 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48208.6us
I20260709 12:19:20.796810 13210 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:20.796264 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.797818 13205 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:20.799597 14942 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:20.798717 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.800323 14994 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.800046 14942 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.800657 13210 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:20.800859 14994 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.794481 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.803292 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:20.803532 14994 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.803859 13204 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.803925 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.800048 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:20.804436 15031 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.804965 13205 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:19:20.805650 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 101154us
I20260709 12:19:20.806679 14921 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.807142 14921 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.808812 14957 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:20.809321 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:20.810158 13211 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 2: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:20.810479 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:20.811025 13210 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.811124 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.812006 13212 raft_consensus.cc:2393] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:19:20.813084 13175 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f042aff5e3084d5e8bd6fcb5335160f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:20.813251 15013 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:20.813601 15013 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:20.813961 15013 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:20.814280 13175 consensus_peers.cc:597] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5031b82872c430cbd03772ba96480ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:20.819761 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.820410 13286 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:20.811810 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.821317 13205 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:20.812530 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:20.822306 13211 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:20.801322 14942 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.826220 15013 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.827785 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:20.828975 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:20.829612 13135 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.830142 13249 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.831235 13102 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:20.829555 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:20.831912 13133 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.832435 14919 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:20.832839 14919 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.833168 14919 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:20.833734 13204 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:20.809458 14921 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.834122 14923 raft_consensus.cc:2955] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:20.841709 14933 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:20.844736 14933 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:20.845135 14933 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:20.835057 13841 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.842073 13252 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:20.842626 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:20.843690 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:20.852200 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.852933 13279 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:20.855160 13210 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:20.855307 13211 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:20.850386 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.857308 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:20.862839 13841 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.864104 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:20.872272 13841 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.873510 13103 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:20.857918 14961 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:20.876276 13130 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:20.874617 15033 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:20.759383 14987 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.864777 14957 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:20.893824 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.879760 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:20.872314 14983 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:20.862346 13282 raft_consensus.cc:2955] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:20.907156 14998 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.897969 13284 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:20.881999 14961 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.915941 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:20.920632 13280 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:20.922349 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:20.922955 14981 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.923151 13137 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:20.923689 14981 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.926455 15005 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:20.924397 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:20.927069 15014 log.cc:927] Time spent T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:19:20.898521 15031 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:20.896908 14957 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.927199 14991 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:20.920692 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:20.932097 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 59901.7us
I20260709 12:19:20.934094 13133 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:20.906962 14983 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.899362 15033 raft_consensus.cc:697] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:20.896931 14995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45944 (request call id 634) took 1843 ms. Trace:
I20260709 12:19:20.941311 13838 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:20.919874 14961 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:20.943604 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 67408.9us
I20260709 12:19:20.934785 14978 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:20.969089 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:20.944613 14957 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:20.934989 15005 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.978891 13203 raft_consensus.cc:2393] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:20.980330 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:20.980650 13879 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:20.970022 14973 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:20.972687 14983 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:20.986510 15020 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:20.987018 15021 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:20.990687 14936 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:20.971297 14919 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:20.980931 15005 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:20.984020 15013 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:20.968883 15028 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:20.993032 15020 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.974901 14995 rpcz_store.cc:276] 0709 12:19:19.019911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.020819 (+   908us) service_pool.cc:224] Handling call
0709 12:19:19.214141 (+193322us) ts_tablet_manager.cc:934] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
0709 12:19:20.481293 (+1267152us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:20.758039 (+276746us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:20.758164 (+   125us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:20.778369 (+ 20205us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:20.778732 (+   363us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:20.854506 (+ 75774us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:20.863491 (+  8985us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":14235,"tablet-copy.queue_time_us":81297,"thread_start_us":99939,"threads_started":2}
I20260709 12:19:21.011977 15020 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:21.021294 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.021797 14987 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.002908 14921 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.027415 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.029919 14995 tablet_copy_client.cc:806] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:21.040091 14971 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:21.040685 14995 tablet_copy_client.cc:670] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:21.007141 14994 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:21.041790 14994 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.042339 14994 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:21.011814 14986 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.045572 14986 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.021342 14964 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:21.047533 15045 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:20.998565 15033 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.036919 13284 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:19:21.048226 15045 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.050539 15045 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:21.041216 14971 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.052271 14919 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:21.052464 15038 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.051s	user 0.001s	sys 0.001s
I20260709 12:19:21.053042 14971 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.047722 14986 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.016072 14973 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.053956 14921 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.055691 14973 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.056882 14921 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:21.058488 15040 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:19:21.061957 14991 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:21.062616 14991 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:21.065470 13284 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:21.067535 13277 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:21.012279 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:21.072341 13135 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:21.047981 14964 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.016892 14936 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:21.088177 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.039633 15054 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.082299 13286 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:21.083019 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:21.095005 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.095633 13284 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:21.097020 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:21.007476 15021 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.092284 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:21.098901 13102 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.082770 13283 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:21.094637 15028 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:21.106274 13277 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:21.107411 13135 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:21.110154 13279 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:19:21.108155 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:21.111184 13129 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:21.111868 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:21.116042 14936 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.116266 15035 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.117765 15021 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.112895 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.119673 13879 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:21.102504 14921 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:21.125154 13102 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.132810 13284 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:21.110415 14969 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.135730 13100 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:21.136889 13102 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.108443 14994 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.138867 14964 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.139602 14994 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.140995 14969 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.142076 14981 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:21.145445 15041 log.cc:927] Time spent T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.157s	user 0.000s	sys 0.002s
I20260709 12:19:21.146596 15005 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.148136 14919 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:21.148711 14919 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:21.149554 14919 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.124589 15035 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.154762 15053 ts_tablet_manager.cc:933] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:21.154682 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:21.155766 14995 tablet_copy_client.cc:538] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:21.156009 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:21.155699 14971 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:21.172257 13882 raft_consensus.cc:2393] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 2: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:21.172420 14971 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.172789 14971 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:21.160161 14942 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.137104 14921 raft_consensus.cc:697] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:21.171120 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:21.127345 15033 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:21.162074 13840 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:21.165494 14926 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:21.178926 14926 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.179374 14926 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:21.180023 15035 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:21.180573 15035 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:21.166363 14998 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.171891 13128 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:21.171663 13129 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:21.186410 13840 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:21.122313 14933 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.189466 14921 consensus_queue.cc:237] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.103039 15054 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.187418 13284 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:21.176010 15033 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:21.222453 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.181532 15035 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.227258 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.227901 13278 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:21.228562 15020 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.223188 13284 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:21.224057 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:21.225138 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:21.225435 15055 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.225630 15057 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:21.242830 15020 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.220077 14933 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.232182 13280 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:21.247601 13886 raft_consensus.cc:2368] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:21.216162 15005 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:21.215824 15054 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.254801 13840 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:21.201339 15033 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:21.250564 15055 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.196444 14961 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.264838 13878 raft_consensus.cc:2368] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:21.265825 14961 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.266007 15053 tablet_copy_client.cc:323] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:19:21.253362 13284 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:21.255527 15046 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.259845 14957 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.268893 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:21.270030 14961 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:21.270563 14961 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:21.270954 14957 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.260844 15042 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:21.268512 14983 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.271767 15042 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.272230 15042 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:21.271600 14961 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.273084 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.266280 13278 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:21.274061 13880 raft_consensus.cc:2393] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:21.279138 14942 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.268790 15046 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.286841 15046 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:21.257752 15057 raft_consensus.cc:697] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:21.288041 15046 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:21.288533 15057 consensus_queue.cc:237] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.289826 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.251547 14936 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.275573 13284 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:21.277172 13249 leader_election.cc:400] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:21.295326 13249 leader_election.cc:403] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:19:21.298018 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:21.298978 14936 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.301262 14936 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.299232 14995 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:19:21.290481 13280 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:21.292690 14926 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.305914 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:21.308790 13279 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:21.320433 14971 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.323015 14971 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.329512 14969 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.288609 15046 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.342593 14926 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.345248 15042 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.337805 14983 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:21.432403 13908 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff060 after lost signal to thread 11919
I20260709 12:19:21.435413 15042 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.436847 15057 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.441051 15057 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:21.441139 13908 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff740 after lost signal to thread 13069
I20260709 12:19:21.444653 15057 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:21.445266 15046 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:21.445953 15058 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 12:19:21.447085 13908 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff800 after lost signal to thread 13083
I20260709 12:19:21.446339 14991 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.450634 15033 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.452394 15057 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:21.453547 13908 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8c00 after lost signal to thread 13161
I20260709 12:19:21.453945 15057 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.456238 15057 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:21.456799 13908 debug-util.cc:398] Leaking SignalData structure 0x7b0800323280 after lost signal to thread 13236
I20260709 12:19:21.453279 14991 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:21.462613 13908 debug-util.cc:398] Leaking SignalData structure 0x7b0800349e00 after lost signal to thread 13310
W20260709 12:19:21.462973 13908 debug-util.cc:398] Leaking SignalData structure 0x7b0800356080 after lost signal to thread 13311
I20260709 12:19:21.463614 15033 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.501096 14995 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:21.502287 15057 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.502326 14995 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:19:21.502879 15057 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.503800 14995 ts_tablet_manager.cc:1403] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.205s	user 0.025s	sys 0.005s
I20260709 12:19:21.505280 15057 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:21.504755 13908 debug-util.cc:398] Leaking SignalData structure 0x7b080033f820 after lost signal to thread 13911
I20260709 12:19:21.508726 14995 raft_consensus.cc:359] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:21.509450 15055 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:21.509675 14995 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:19:21.510474 14995 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:21.513497 14995 ts_tablet_manager.cc:1434] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:19:21.515910 14991 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:21.516532 14991 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.517439 13249 leader_election.cc:400] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:21.517372 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:21.518661 14991 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:21.519255 14991 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:21.517961 13249 leader_election.cc:403] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:19:21.519783 14991 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.521759 14991 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:21.524748 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.518718 13880 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:21.526954 14921 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:21.527395 14921 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:21.527849 14921 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:21.529635 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.531656 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.535526 14921 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.538337 14921 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.539412 13282 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:21.541694 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.542644 14921 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:21.543454 14921 raft_consensus.cc:697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:21.544694 14921 consensus_queue.cc:237] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.550372 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.551627 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.552277 13279 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:21.559801 13279 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:21.561228 13102 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.568061 13282 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:21.571692 14971 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:21.572266 14971 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:21.572384 14919 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.572674 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:21.573319 13134 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:21.573026 14919 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.573211 14971 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.575405 14919 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.576447 14969 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.576913 14969 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.578934 14969 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.580557 13134 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:21.582001 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.584254 13136 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:21.582232 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.585937 14926 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:21.586405 14926 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:21.587330 14926 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.588783 13128 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:21.591746 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:21.592525 13282 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:21.597846 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.599207 14969 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:21.599802 14969 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.600339 14969 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:21.606480 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:21.607616 14933 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:21.608063 14933 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:21.608480 14933 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:21.609102 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.610132 13129 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:21.612619 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:21.612758 13249 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.613284 13278 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:21.613852 15046 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:21.614368 15046 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.614789 15046 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:21.615899 14933 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.622484 14933 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:21.625957 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:21.627386 13880 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:21.626077 13034 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42070 (request call id 323) took 1613 ms. Trace:
I20260709 12:19:21.629777 15013 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:21.630570 15013 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.629552 13034 rpcz_store.cc:276] 0709 12:19:20.012993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.145882 (+132889us) service_pool.cc:224] Handling call
0709 12:19:21.626017 (+1480135us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:20.694258 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:20.694849 (+   591us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:20.694905 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:19:20.694925 (+    20us) tablet.cc:662] Decoding operations
0709 12:19:20.695334 (+   409us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:20.695417 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:20.695661 (+   244us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:20.695949 (+   288us) tablet.cc:701] Row locks acquired
0709 12:19:20.696005 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:19:20.696154 (+   149us) write_op.cc:270] Start()
0709 12:19:20.696293 (+   139us) write_op.cc:276] Timestamp: P: 1783599560696100 usec, L: 0
0709 12:19:20.696334 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:19:20.696971 (+   637us) log.cc:844] Serialized 538 byte log entry
0709 12:19:20.893822 (+196851us) op_driver.cc:464] REPLICATION: finished
0709 12:19:21.081942 (+188120us) write_op.cc:301] APPLY: starting
0709 12:19:21.090169 (+  8227us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:21.097892 (+  7723us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:21.122727 (+ 24835us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:21.123091 (+   364us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:21.123388 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:19:21.123472 (+    84us) write_op.cc:312] APPLY: finished
0709 12:19:21.147599 (+ 24127us) log.cc:844] Serialized 23 byte log entry
0709 12:19:21.147783 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:21.147859 (+    76us) write_op.cc:454] Released schema lock
0709 12:19:21.147898 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:21.148216 (+   318us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:21.148243 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":185545,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":107867,"apply.run_cpu_time_us":2950,"apply.run_wall_time_us":119878,"num_ops":1,"prepare.queue_time_us":329865,"prepare.run_cpu_time_us":2958,"prepare.run_wall_time_us":10765,"replication_time_us":187593,"thread_start_us":52922,"threads_started":1}]]}
I20260709 12:19:21.642360 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:21.643370 13887 raft_consensus.cc:2368] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4.
I20260709 12:19:21.643292 15013 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:21.650734 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:21.655117 15013 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:21.655972 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.656392 15013 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.657068 14991 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:21.663272 13278 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:21.665040 13102 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.637607 15046 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.667513 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.703372 14921 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:21.957647 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.958199 14921 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:21.959097 14921 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:21.874837 15073 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.880851 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.962782 13137 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:21.962637 15073 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.931741 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.932909 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.933709 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:21.964632 13132 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:21.934152 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-f042aff5e3084d5e8bd6fcb5335160f5 received from {username='slave'} at 127.0.0.1:60854
I20260709 12:19:21.968101 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-f042aff5e3084d5e8bd6fcb5335160f5 on tablet f042aff5e3084d5e8bd6fcb5335160f5 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:21.940749 15074 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:21.969376 15074 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.951961 13278 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:21.973816 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.974710 13131 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:21.931509 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.976356 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:21.978864 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:21.980408 15079 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:21.980784 15079 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:21.983878 15079 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:21.983718 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.984820 13131 raft_consensus.cc:2368] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4.
I20260709 12:19:21.986402 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.987190 13131 raft_consensus.cc:2393] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:21.988304 13132 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:21.989878 13278 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:21.990237 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:21.990345 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:21.990934 13130 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:21.983117 15077 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:21.991956 15077 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:21.992203 14921 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:21.994302 15077 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.002820 15079 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.012414 13130 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:22.018302 14933 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.018927 14933 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.020365 15013 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:22.020941 14933 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:22.024410 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:22.029239 15055 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.029793 15055 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.031141 14933 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.031788 14933 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.033979 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:22.034521 13887 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:22.035004 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:22.035607 15071 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.035774 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:22.036300 13283 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:22.036106 15071 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.037492 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:22.037818 13840 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.038053 13277 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:22.038622 13840 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.038890 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:22.039578 13286 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:22.042052 13279 raft_consensus.cc:2393] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:22.043882 14961 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:22.044575 14961 raft_consensus.cc:697] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:22.045392 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:22.046139 13135 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:22.045747 14961 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.041905 15042 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.048938 15042 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.049355 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:21.662181 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:22.050719 13880 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:22.051018 15042 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.051319 14933 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:22.052837 14933 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.053309 14933 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.054957 13279 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:22.056078 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:22.056358 15046 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:22.057328 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:22.058135 13133 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:22.058595 14933 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:22.063522 15073 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.064280 15073 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.064743 15073 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.067553 15073 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.048768 15055 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:22.070613 14917 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:22.075013 14917 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.075925 13283 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:22.077755 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:22.078548 14928 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.079416 15073 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.079269 14928 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.079970 15073 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.081988 14928 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.083137 15073 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.077803 14917 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.075142 13135 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:22.088027 13249 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:22.088478 13035 catalog_manager.cc:5697] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 2, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added, no longer has a pending config: VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3), VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1), VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2), NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 3 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:22.090567 13031 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51922 (request call id 204) took 1143 ms. Trace:
I20260709 12:19:22.091809 13033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42064 (request call id 319) took 1675 ms. Trace:
I20260709 12:19:22.090967 13031 rpcz_store.cc:276] 0709 12:19:20.946726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.977677 (+ 30951us) service_pool.cc:224] Handling call
0709 12:19:21.603903 (+626226us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b54003633d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df7090 00007f70f4e95f3a 00007f70fac4be9c 00007f70fad4a04e 00007f70f920b2a4 00007f70f920b232 00007f70f920b161 00007f70f920b0dc 00007f70f920a392 00007f70f31c848c 00007f70f31c78c6
0709 12:19:22.090402 (+486499us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":482592,"reported_tablets":1,"spinlock_wait_cycles":49048960}
I20260709 12:19:22.096527 15073 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:22.062995 15019 raft_consensus.cc:2955] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:22.097393 15073 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:22.098335 15073 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.103816 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:22.104508 13886 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
W20260709 12:19:22.107227 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 68672.3us
I20260709 12:19:22.108951 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.109776 15042 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:22.120028 15042 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.120504 15042 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:22.122287 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:22.122985 13878 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:22.124821 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:22.125484 13880 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
W20260709 12:19:22.128083 14969 consensus_meta.cc:287] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.527s	user 0.016s	sys 0.000s
I20260709 12:19:22.128486 14969 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.137312 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:22.137961 13878 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:19:22.111368 15071 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:22.118744 14971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.029s	sys 0.049s
W20260709 12:19:22.142827 14971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.030s	sys 0.050s
W20260709 12:19:22.147737 14978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.142s	user 0.012s	sys 0.017s
W20260709 12:19:22.148161 14978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.012s	sys 0.017s
I20260709 12:19:22.160559 14969 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.160742 14978 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:22.161878 14978 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.162909 14981 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.164276 13100 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.165381 14849 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.165457 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.165773 14971 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:22.166010 14849 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.149868 15072 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.166605 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:22.167594 15077 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:22.167023 15072 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:22.167980 15077 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.168192 14849 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.168399 15077 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.170480 15072 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:22.170480 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:22.150385 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.163412 14981 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.173036 15035 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:22.159412 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:22.173483 15035 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.160018 13129 raft_consensus.cc:2368] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:22.173916 15035 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.174150 14981 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.177695 13249 leader_election.cc:400] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:22.178108 13249 leader_election.cc:403] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:19:22.178705 15081 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:22.166353 14971 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.179226 14971 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.179175 15081 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.181246 15074 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.181536 15081 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.148972 14983 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:22.183939 14983 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.184414 14983 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:22.185775 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:22.186743 13129 raft_consensus.cc:2368] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3.
I20260709 12:19:22.188071 13249 leader_election.cc:400] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3.
I20260709 12:19:22.188431 13249 leader_election.cc:403] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:22.173736 13282 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.189051 15081 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:19:22.119225 13280 consensus_meta.cc:287] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.812s	user 0.011s	sys 0.002s
I20260709 12:19:22.195395 13282 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:22.201750 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:22.202663 14964 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:22.203210 14964 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:22.195711 15071 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:19:22.204293 14964 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:22.205173 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 1.19804e+06us
I20260709 12:19:22.172847 13840 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.209041 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:22.209650 13283 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:22.210031 15071 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:22.210534 15071 raft_consensus.cc:697] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:22.210601 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:22.211185 13279 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:22.212848 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.213542 13204 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:22.213717 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:22.213825 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:22.214332 13285 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:22.214547 13129 raft_consensus.cc:2368] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5.
I20260709 12:19:22.215145 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.215382 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:22.215724 13204 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.215790 13249 leader_election.cc:400] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5.
I20260709 12:19:22.216182 13249 leader_election.cc:403] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:19:22.216817 13281 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:22.218309 13286 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:22.219692 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.220242 13203 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:22.223989 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:22.224252 13100 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.224602 13285 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:22.225040 14986 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:22.225473 14986 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.225859 14986 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:22.225912 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:22.226895 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.227737 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.227952 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.228111 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.228590 13208 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:22.228734 13205 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:19:22.226524 13286 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:22.231884 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.232759 13212 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:22.220166 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:22.233412 13278 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:22.233760 14986 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.228477 13210 raft_consensus.cc:2393] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:22.235703 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.236217 13210 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.237954 13887 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:22.238947 15071 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.239691 15025 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.240193 15025 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.242194 15025 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.243386 13212 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:22.243731 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.242235 13279 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:22.203028 15074 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:22.244474 15072 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5.
I20260709 12:19:22.244513 13207 raft_consensus.cc:2393] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:22.246196 14982 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:22.246424 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.246775 14982 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.247705 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.249070 13211 raft_consensus.cc:2368] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3.
W20260709 12:19:22.198199 14991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.006s
I20260709 12:19:22.249430 15079 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:22.249770 14991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.000s	sys 0.007s
I20260709 12:19:22.249930 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.250008 15025 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:22.250663 13208 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:19:22.250778 14988 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:22.195500 15081 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3.
I20260709 12:19:22.251703 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.251873 15022 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:22.248869 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.252418 15022 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.253007 13100 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:22.253305 13205 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:22.253743 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.253921 14987 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:22.250805 15025 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.254422 14987 raft_consensus.cc:697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:22.255146 14976 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:22.251307 14988 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.255585 14987 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:22.196949 13284 consensus_meta.cc:287] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.902s	user 0.012s	sys 0.009s
I20260709 12:19:22.256809 13284 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:22.257225 15005 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:22.257905 14988 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.250120 14991 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:22.258565 15031 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:22.259413 14991 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.259802 13840 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.260066 15031 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:22.261790 15031 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:22.262169 15031 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.248868 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.262563 15031 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:22.263088 13207 raft_consensus.cc:2368] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5.
I20260709 12:19:22.254441 15022 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.269699 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.272042 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.272904 15031 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.273267 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.273653 13177 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:22.274088 13208 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:22.270896 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.275345 13209 raft_consensus.cc:2368] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5.
I20260709 12:19:22.248908 14982 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.276290 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.276357 14976 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:22.276984 14976 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.277316 14976 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:22.277402 14964 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.278105 13222 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet b5031b82872c430cbd03772ba96480ff from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:19:22.276450 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.306798 13208 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.279260 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.280050 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.307914 13209 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:22.269073 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.307368 13282 raft_consensus.cc:2955] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:22.308907 13212 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:22.282685 13204 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:22.256186 15025 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.200096 13280 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:22.286366 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.310217 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.287498 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:22.288901 13210 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:22.289297 13177 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:22.290273 13203 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:22.245869 14971 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.292897 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:22.092181 13033 rpcz_store.cc:276] 0709 12:19:20.417069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.417220 (+   151us) service_pool.cc:224] Handling call
0709 12:19:22.091742 (+1674522us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:20.733612 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:20.754392 (+ 20780us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:20.754423 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:19:20.754438 (+    15us) tablet.cc:662] Decoding operations
0709 12:19:20.754958 (+   520us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:20.755016 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:20.755050 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:19:20.755320 (+   270us) tablet.cc:701] Row locks acquired
0709 12:19:20.755335 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:19:20.755510 (+   175us) write_op.cc:270] Start()
0709 12:19:20.755644 (+   134us) write_op.cc:276] Timestamp: P: 1783599560755456 usec, L: 0
0709 12:19:20.755661 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:19:20.756267 (+   606us) log.cc:844] Serialized 1166 byte log entry
0709 12:19:20.988837 (+232570us) op_driver.cc:464] REPLICATION: finished
0709 12:19:21.072332 (+ 83495us) write_op.cc:301] APPLY: starting
0709 12:19:21.072432 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:21.072564 (+   132us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:21.102531 (+ 29967us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:21.137830 (+ 35299us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:21.138001 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:19:21.138045 (+    44us) write_op.cc:312] APPLY: finished
0709 12:19:21.138311 (+   266us) log.cc:844] Serialized 29 byte log entry
0709 12:19:21.138510 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:21.138590 (+    80us) write_op.cc:454] Released schema lock
0709 12:19:21.138647 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:21.139090 (+   443us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:21.139117 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":193078,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":51207,"apply.run_cpu_time_us":2853,"apply.run_wall_time_us":66726,"num_ops":2,"prepare.queue_time_us":99502,"prepare.run_cpu_time_us":2754,"prepare.run_wall_time_us":27139,"replication_time_us":233039,"thread_start_us":28179,"threads_started":1}]]}
I20260709 12:19:22.310856 13211 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.310519 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42730 (request call id 232) took 1021 ms. Trace:
I20260709 12:19:22.317330 13280 rpcz_store.cc:276] 0709 12:19:21.289369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.289525 (+   156us) service_pool.cc:224] Handling call
0709 12:19:22.310457 (+1020932us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:22.344048 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 54823.9us
W20260709 12:19:22.364926 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 72159us
I20260709 12:19:22.365839 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:22.368121 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.368747 13204 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.310328 14957 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:22.434082 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:22.435070 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 69316.1us
I20260709 12:19:22.436303 14988 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:22.440294 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 70602.3us
I20260709 12:19:22.436626 13212 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:22.318212 14961 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:22.449326 13840 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.364238 15072 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.370728 15025 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:22.454144 13175 leader_election.cc:400] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4.
I20260709 12:19:22.454634 13175 leader_election.cc:403] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:22.443051 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:22.325073 14969 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.446244 13210 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 1.
I20260709 12:19:22.442945 13204 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:22.367908 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.456869 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.457350 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.457353 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.460414 13886 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:22.461488 13211 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:22.363548 13222 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet b5031b82872c430cbd03772ba96480ff from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-b5031b82872c430cbd03772ba96480ff
I20260709 12:19:22.467022 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:22.373523 15087 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:22.467728 13879 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:22.462771 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.325349 15035 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.447144 15005 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.326985 14964 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.368335 15042 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.454149 15025 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.449903 15081 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.463286 15071 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.495275 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:22.495709 15080 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.473392 15087 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.495810 15071 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.496495 15087 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.496433 15080 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.496935 15031 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.468147 13177 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:22.488531 13211 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:22.483085 13203 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:22.489805 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.458763 15072 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.494673 15081 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:22.439862 14921 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.451447 14986 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.437436 15077 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.484915 14988 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:22.539915 13887 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 4: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:22.473839 15055 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:22.537240 13252 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:19:22.556348 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 88416.6us
I20260709 12:19:22.484182 14973 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4.
I20260709 12:19:22.512952 13208 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:22.560515 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:22.551914 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 102672us
I20260709 12:19:22.474164 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:22.539405 13206 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:22.557106 13177 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:22.501196 15025 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:22.563776 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:22.536303 14926 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.583421 13279 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:22.574236 15074 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:22.585457 13177 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:22.586982 15033 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.587774 14967 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:22.587626 15033 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.588403 14967 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:22.589013 14967 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:22.590260 15033 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.499531 15079 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.537619 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:22.472868 14969 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:22.577139 13252 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:22.597321 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:22.601667 13252 leader_election.cc:400] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3.
I20260709 12:19:22.602140 13252 leader_election.cc:403] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:22.609772 14926 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.600860 14989 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:19:22.612746 15093 log.cc:927] Time spent T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:19:22.613314 15097 log.cc:927] Time spent T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:19:22.574615 15024 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:22.559475 14921 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.619097 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:22.559177 14988 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:22.621147 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 161988us
I20260709 12:19:22.621377 13135 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:22.622093 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.654753 14921 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.611008 15074 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:22.609496 13882 raft_consensus.cc:2368] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3.
I20260709 12:19:22.594576 13881 raft_consensus.cc:2368] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3.
I20260709 12:19:22.590399 14961 raft_consensus.cc:697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:22.628675 13252 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:22.488579 15005 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.639976 13285 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:22.645661 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:22.647008 13279 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:22.652575 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.638969 13878 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:22.857630 15074 raft_consensus.cc:697] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:22.654819 14989 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:22.848793 11921 debug-util.cc:398] Leaking SignalData structure 0x7b080000ff80 after lost signal to thread 13177
I20260709 12:19:22.658239 14988 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:22.637043 14933 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.733533 13204 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:22.858762 15074 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:22.859557 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 128240us
I20260709 12:19:22.728142 13209 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:22.637197 15079 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.638818 14991 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3.
I20260709 12:19:22.860370 15104 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:22.646376 15102 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:22.861245 13286 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:22.862000 13203 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:22.855686 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 200055us
I20260709 12:19:22.916805 13838 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.724896 14964 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.919826 14973 consensus_queue.cc:1059] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:22.646421 15024 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.921702 15024 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.924958 15035 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.656669 13208 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:22.898859 13204 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:22.729826 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:22.925971 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:22.926836 13284 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:22.732745 13211 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:22.886404 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:22.855341 15081 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:22.663509 13307 debug-util.cc:398] Leaking SignalData structure 0x7b080018a440 after lost signal to thread 11919
I20260709 12:19:22.928822 15081 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:22.929006 15042 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.929229 15081 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:22.929510 13307 debug-util.cc:398] Leaking SignalData structure 0x7b0800194ae0 after lost signal to thread 13069
I20260709 12:19:22.929656 15081 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:22.929955 13307 debug-util.cc:398] Leaking SignalData structure 0x7b0800194ba0 after lost signal to thread 13083
W20260709 12:19:22.931103 13307 debug-util.cc:398] Leaking SignalData structure 0x7b0800365cc0 after lost signal to thread 13161
W20260709 12:19:22.931406 13307 debug-util.cc:398] Leaking SignalData structure 0x7b080036e960 after lost signal to thread 13162
W20260709 12:19:22.932497 13307 debug-util.cc:398] Leaking SignalData structure 0x7b080016cb40 after lost signal to thread 13236
W20260709 12:19:22.932809 13307 debug-util.cc:398] Leaking SignalData structure 0x7b08003380a0 after lost signal to thread 13237
W20260709 12:19:22.933876 13307 debug-util.cc:398] Leaking SignalData structure 0x7b080021b300 after lost signal to thread 13310
I20260709 12:19:22.932047 15024 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:22.935071 13307 debug-util.cc:398] Leaking SignalData structure 0x7b0800211780 after lost signal to thread 13911
I20260709 12:19:22.721071 13133 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:22.828691 15073 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:22.937667 14986 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.938159 14986 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.939568 15073 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.942399 14986 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.944936 13204 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:22.945895 13204 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:22.946252 15024 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.947988 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:22.856868 14926 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:22.928102 13279 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:22.921236 14973 raft_consensus.cc:3055] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:19:22.935225 15096 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 12:19:22.678186 14969 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:22.980726 15080 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:22.970630 14983 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.786s	user 0.011s	sys 0.000s
I20260709 12:19:22.981861 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.915187 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:22.981624 14983 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:22.959231 13203 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:22.987263 13204 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:19:22.991140 13204 pending_rounds.cc:85] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 2
W20260709 12:19:22.991858 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 75133.8us
I20260709 12:19:22.997401 13286 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:22.997968 13838 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:22.993700 13175 leader_election.cc:400] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4.
I20260709 12:19:22.894469 14989 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:23.000017 13286 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:23.002413 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:22.973817 14973 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:23.002549 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 439956us
I20260709 12:19:22.998073 13204 pending_rounds.cc:107] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:19:23.009188 13204 raft_consensus.cc:2889] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:23.022168 13286 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:19:22.991719 15102 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:22.966902 15104 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.036079 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.037731 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.038725 15104 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:23.039387 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.040952 13035 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42062 (request call id 292) took 2538 ms. Trace:
I20260709 12:19:23.041069 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:22.894236 14961 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:23.044258 13101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.016s	sys 0.016s
I20260709 12:19:23.028474 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:23.029386 15079 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:23.029174 14973 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.029742 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:23.030380 15103 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:23.030758 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.033836 14971 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.005009 14978 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:23.022748 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:23.044708 13101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.016s	sys 0.016s
I20260709 12:19:23.059263 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:23.059912 13281 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.056080 13880 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:19:23.071064 14976 consensus_meta.cc:287] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.793s	user 0.006s	sys 0.007s
I20260709 12:19:23.071657 14976 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.073585 15077 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.074141 14976 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.041357 13035 rpcz_store.cc:276] 0709 12:19:20.502476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.504998 (+  2522us) service_pool.cc:224] Handling call
0709 12:19:23.040854 (+2535856us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:22.104728 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:22.105325 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:22.105361 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:19:22.105381 (+    20us) tablet.cc:662] Decoding operations
0709 12:19:22.105728 (+   347us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:22.105805 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:22.105834 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:22.106020 (+   186us) tablet.cc:701] Row locks acquired
0709 12:19:22.106039 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:19:22.106172 (+   133us) write_op.cc:270] Start()
0709 12:19:22.106277 (+   105us) write_op.cc:276] Timestamp: P: 1783599562106127 usec, L: 0
0709 12:19:22.106299 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:19:22.106936 (+   637us) log.cc:844] Serialized 591 byte log entry
0709 12:19:22.150369 (+ 43433us) op_driver.cc:464] REPLICATION: finished
0709 12:19:22.639263 (+488894us) write_op.cc:301] APPLY: starting
0709 12:19:22.644031 (+  4768us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:22.655517 (+ 11486us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:22.659171 (+  3654us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:22.659462 (+   291us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:22.659678 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:19:22.659744 (+    66us) write_op.cc:312] APPLY: finished
0709 12:19:22.671308 (+ 11564us) log.cc:844] Serialized 23 byte log entry
0709 12:19:22.671509 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:22.671587 (+    78us) write_op.cc:454] Released schema lock
0709 12:19:22.671627 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:22.672077 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:22.672117 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":651981,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":424941,"apply.run_cpu_time_us":2420,"apply.run_wall_time_us":70925,"num_ops":1,"prepare.queue_time_us":12351,"prepare.run_cpu_time_us":2459,"prepare.run_wall_time_us":2459,"replication_time_us":41626,"thread_start_us":302586,"threads_started":2}]]}
I20260709 12:19:23.079830 14973 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.080000 15033 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:23.080533 15033 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:23.082590 15033 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:23.057679 14978 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:23.039304 15104 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:23.086174 13882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 665) took 1052 ms. Trace:
I20260709 12:19:23.086287 14983 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:23.088063 13209 raft_consensus.cc:1240] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
W20260709 12:19:23.088877 13103 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.001s	sys 0.037s
I20260709 12:19:23.099634 13211 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:19:23.099864 13103 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.002s	sys 0.037s
I20260709 12:19:23.100273 13281 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:23.048440 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:23.101464 13286 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:23.126847 13286 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:23.083871 15042 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:23.145123 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.147768 13130 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:23.098385 14978 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:23.151651 13279 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:23.159401 13206 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:23.098685 15104 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:23.166990 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.149587 15077 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.178395 13034 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42070 (request call id 324) took 1223 ms. Trace:
I20260709 12:19:23.160212 14933 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:23.183566 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:23.167690 15025 consensus_meta.cc:287] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.000s
I20260709 12:19:23.159646 14919 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:23.152149 15042 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:23.194653 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.193001 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.165499 15104 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.159159 14969 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:23.210186 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.211505 13284 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:23.199586 13034 rpcz_store.cc:276] 0709 12:19:21.955092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.955270 (+   178us) service_pool.cc:224] Handling call
0709 12:19:23.178315 (+1223045us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317993,"reported_tablets":4}
I20260709 12:19:23.186476 13033 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.167142 15071 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:23.213152 13033 catalog_manager.cc:5697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.215533 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:23.216267 13206 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:23.218499 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.227144 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.098670 13882 rpcz_store.cc:276] 0709 12:19:22.033324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.166315 (+132991us) service_pool.cc:224] Handling call
0709 12:19:23.085979 (+919664us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54007ae4d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:23.086109 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868916992}
I20260709 12:19:23.227104 13033 catalog_manager.cc:5697] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 2, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 2 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.209612 15042 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.236361 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.199838 15109 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:23.258312 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.191694 15081 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.238114 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.198347 15077 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.202278 15025 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:23.286999 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.160526 15102 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.233667 13133 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:23.225852 14998 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:23.234503 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 248756us
I20260709 12:19:23.243283 13033 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 2 to 3, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 3 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.255599 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.224542 14969 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:23.285409 15110 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:19:23.226012 14988 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.275558 13131 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:23.286623 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:23.288508 13282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.047s	sys 0.094s
I20260709 12:19:23.288707 13211 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:23.217856 14919 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:19:23.304639 13282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.047s	sys 0.094s
I20260709 12:19:23.304787 13207 raft_consensus.cc:2368] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3.
I20260709 12:19:23.292927 13033 catalog_manager.cc:5697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.305644 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1556) took 1097 ms. Trace:
I20260709 12:19:23.306077 13282 rpcz_store.cc:276] 0709 12:19:22.207923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.306480 (+ 98557us) service_pool.cc:224] Handling call
0709 12:19:22.306811 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.307220 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:22.369395 (+ 62175us) log.cc:844] Serialized 14 byte log entry
0709 12:19:23.305206 (+935811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:23.305276 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:23.305349 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.305436 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.305570 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":935312,"threads_started":1}
W20260709 12:19:23.299554 15087 consensus_meta.cc:287] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.802s	user 0.011s	sys 0.000s
W20260709 12:19:23.299072 15055 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.021s	sys 0.021s
W20260709 12:19:23.314421 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 312098us
W20260709 12:19:23.324542 15055 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.021s	sys 0.021s
I20260709 12:19:23.324769 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:23.316668 13209 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:23.317247 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.325831 13882 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:23.317369 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:23.325114 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:23.323629 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:23.327585 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:23.323915 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:23.324915 15055 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:23.326539 14967 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.737s	user 0.013s	sys 0.000s
I20260709 12:19:23.329262 14995 tablet_replica.cc:333] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
W20260709 12:19:23.312857 13278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.003s	sys 0.028s
I20260709 12:19:23.310408 13033 catalog_manager.cc:5697] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 4 to 6, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 6 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.410060 13033 catalog_manager.cc:5697] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 3, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 3 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.390345 13210 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
W20260709 12:19:23.390472 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 65450.2us
W20260709 12:19:23.312685 15022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.028s	sys 0.027s
I20260709 12:19:23.402444 13840 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:23.402486 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:23.421429 13206 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:23.416014 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:23.421739 13884 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:19:23.429173 13249 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:23.298668 14998 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:23.267043 15109 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.431774 13841 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:23.426436 14964 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.449941 13249 leader_election.cc:400] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3.
I20260709 12:19:23.452622 13249 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:23.421224 15022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.029s	sys 0.027s
I20260709 12:19:23.329377 14967 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.430173 15108 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:23.430305 15071 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:23.385037 15087 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.391553 15035 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:23.454656 15079 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:19:23.473071 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 207683us
I20260709 12:19:23.430073 14971 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:19:23.491128 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:23.464306 15019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36398 (request call id 13) took 3852 ms. Trace:
W20260709 12:19:23.489419 15074 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.018s
I20260709 12:19:23.466653 14991 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:23.501241 13282 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:23.502501 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:23.506372 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:23.456627 14964 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.508864 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:23.510226 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:23.430522 15055 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:23.505321 15074 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.006s	sys 0.018s
I20260709 12:19:23.498765 15031 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:23.496357 15079 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:23.535380 13283 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:23.507567 14991 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:23.509371 15071 raft_consensus.cc:697] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:23.548087 13279 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:23.492048 15115 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:19:23.502748 14926 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:19:23.549752 15120 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:19:23.568322 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 522) took 1126 ms. Trace:
I20260709 12:19:23.568861 13880 rpcz_store.cc:276] 0709 12:19:22.442152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.445328 (+  3176us) service_pool.cc:224] Handling call
0709 12:19:23.568006 (+1122678us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b5400570b54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:23.568209 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004232448}
I20260709 12:19:23.572731 15074 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.539348 15079 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.573381 15074 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.575306 15104 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.576691 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:23.552158 15122 consensus_queue.cc:1059] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:19:23.552477 15114 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:19:23.553048 14988 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:23.553380 15116 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:19:23.553447 15126 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:19:23.554728 15112 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:19:23.617494 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.617733 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.618346 13137 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:19:23.555179 15111 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:19:23.617751 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:23.613950 13131 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:23.549502 15025 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:23.499521 15019 rpcz_store.cc:276] 0709 12:19:19.581721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.582436 (+   715us) service_pool.cc:224] Handling call
0709 12:19:19.632770 (+ 50334us) log.cc:844] Serialized 499 byte log entry
0709 12:19:23.428543 (+3795773us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":885304,"threads_started":1,"wal-append.queue_time_us":367028,"wal-append.run_cpu_time_us":2627,"wal-append.run_wall_time_us":1027299}
W20260709 12:19:23.622720 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 52449.4us
I20260709 12:19:23.542635 15042 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.625886 15118 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:23.628702 14976 raft_consensus.cc:3055] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:23.629330 14976 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:23.628753 15071 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.630340 14976 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:23.631059 13205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:23.560292 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.541743 15081 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.545126 14991 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.581677 14978 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.584535 15127 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 12:19:23.602386 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.585489 15077 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:23.606473 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 165435us
I20260709 12:19:23.609398 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:23.610014 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.536374 14987 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:19:23.615286 13132 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:23.616382 15126 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:23.678809 15126 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.679263 15073 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.680166 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:23.681504 13280 raft_consensus.cc:2368] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3.
I20260709 12:19:23.658980 13135 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:23.654322 15104 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:23.678170 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.681457 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:23.653291 13130 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:23.681953 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:23.690801 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:23.632303 15087 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.653803 14919 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:23.691354 13286 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.652004 13878 raft_consensus.cc:1240] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:23.700011 13886 raft_consensus.cc:2368] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4.
W20260709 12:19:23.700951 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 47797.5us
I20260709 12:19:23.688910 13282 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:23.706264 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:23.656356 14926 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:23.707414 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.709678 13203 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:23.709760 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.709021 13887 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:23.708103 13204 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:23.711334 13177 leader_election.cc:400] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3.
I20260709 12:19:23.711796 13177 leader_election.cc:403] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:19:23.713959 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:23.711114 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:23.716286 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:23.721596 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.705305 13128 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:23.722733 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:23.723119 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:23.723634 15127 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:23.706990 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:23.717232 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:23.694422 15031 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:23.712091 15081 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:23.694437 15077 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:19:23.740525 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.741784 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:23.735710 15137 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.718850 15120 raft_consensus.cc:3055] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:23.744282 13887 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:19:23.739707 13103 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.539s (SENT) [suppressed 4 similar messages]
I20260709 12:19:23.725070 15122 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:23.711719 14919 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:19:23.731210 15074 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.733537 14964 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.754844 13286 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:23.759704 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:23.724684 15108 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:19:23.755913 15122 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.724825 15035 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:19:23.714946 14926 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.771056 13177 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:23.743980 15118 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:23.743497 14921 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:23.775944 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 64914.8us
I20260709 12:19:23.745241 15120 raft_consensus.cc:740] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:23.759598 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 247) took 1460 ms. Trace:
I20260709 12:19:23.781471 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1573) took 1178 ms. Trace:
I20260709 12:19:23.782491 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.760248 15073 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:23.791597 13284 rpcz_store.cc:276] 0709 12:19:22.603048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.964367 (+361319us) service_pool.cc:224] Handling call
0709 12:19:22.964763 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:23.211869 (+247106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.781264 (+569395us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540023d054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:23.781412 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566647040}
I20260709 12:19:23.743866 15031 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.788941 13102 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:23.756635 15106 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:23.788203 13175 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:23.747505 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:23.761752 15121 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:23.745323 15081 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:23.784690 14991 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:23.795957 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 56312.7us
I20260709 12:19:23.796108 15118 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:23.756351 15139 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:19:23.797294 15120 consensus_queue.cc:260] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.800575 13286 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:23.796080 13102 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:23.791239 13278 rpcz_store.cc:276] 0709 12:19:22.284750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.289492 (+  4742us) service_pool.cc:224] Handling call
0709 12:19:22.372293 (+ 82801us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:22.489109 (+116816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.492195 (+  3086us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:22.609347 (+117152us) log.cc:844] Serialized 26 byte log entry
0709 12:19:23.444979 (+835632us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:23.455087 (+ 10108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.459792 (+  4705us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.733248 (+273456us) raft_consensus.cc:1685] finished
0709 12:19:23.733271 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.745471 (+ 12200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21214,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4549,"thread_start_us":668485,"threads_started":1,"wal-append.queue_time_us":811544}
I20260709 12:19:23.793531 14988 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:23.799044 15127 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:23.795676 15113 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:19:23.807240 15127 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:23.807807 15120 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.798200 14926 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.809255 13102 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:23.798389 15031 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:23.810835 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:23.801532 15121 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.800067 15106 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.827154 15106 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:23.827728 14988 raft_consensus.cc:697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:23.828737 14988 consensus_queue.cc:237] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:23.811301 15075 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.813787 14967 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.814265 14986 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:23.814819 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:23.833501 15072 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:23.834111 15072 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:23.834460 15072 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:23.814965 15077 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:23.816401 14969 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:23.816835 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:23.817806 15005 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.818976 14964 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:23.820577 13102 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:23.820981 15081 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:23.820901 15114 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.821317 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.821836 15024 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:19:23.822248 14933 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.800598 15073 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:23.856789 13286 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:23.823913 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:23.824376 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:23.801924 13882 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:19:23.808713 15074 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.831151 13283 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:23.892849 13284 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:23.832306 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:23.893206 15145 log.cc:927] Time spent T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:19:23.835848 13840 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:23.893795 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:23.838012 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:23.840055 13204 raft_consensus.cc:2368] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4.
I20260709 12:19:23.834825 15072 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:23.894025 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 58222.3us
I20260709 12:19:23.875051 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:23.891743 13128 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:23.823166 13103 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:23.899155 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 74874.6us
I20260709 12:19:23.897466 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:23.899724 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 76641.2us
I20260709 12:19:23.878686 14919 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:23.839548 14986 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:23.837577 14978 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:23.912431 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.895886 15074 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:23.913410 13100 leader_election.cc:400] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3.
W20260709 12:19:23.889613 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 69109.3us
I20260709 12:19:23.916899 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:23.888515 14991 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:23.920120 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:23.851776 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:23.912276 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:23.918308 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.851645 14957 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 12:19:23.840935 14917 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:19:23.871951 15122 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:24.117765 15109 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:24.132738 13204 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 1.
I20260709 12:19:24.134316 15042 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:24.134582 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:24.135231 13204 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:24.136219 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:24.137462 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:24.138492 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:24.138713 13278 raft_consensus.cc:2393] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:19:24.141994 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 233884us
W20260709 12:19:24.142381 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 225604us
I20260709 12:19:24.142728 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:23.841377 15075 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:24.148487 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:23.942335 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 44915.1us
I20260709 12:19:23.957594 15137 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3.
I20260709 12:19:23.899516 15106 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:24.147892 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:23.980103 15136 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:24.155329 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:24.143257 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:24.157809 13100 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:24.157346 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:24.163409 13210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2344) took 1430 ms (client timeout 1580 ms). Trace:
I20260709 12:19:23.971935 15035 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:23.906356 14987 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:24.025853 13841 leader_election.cc:400] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4.
I20260709 12:19:24.169595 13841 leader_election.cc:403] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:19:24.127076 15019 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.956411 15135 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.170869 13102 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:24.157845 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 320084us
I20260709 12:19:24.164023 13840 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:24.167641 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:24.148805 14989 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:24.166419 13103 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:24.175259 13884 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:24.045584 15121 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:23.899983 14933 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:24.173930 13249 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:23.924167 14967 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:24.114423 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:24.166559 13210 rpcz_store.cc:269] 0709 12:19:22.726652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.732974 (+  6322us) service_pool.cc:224] Handling call
0709 12:19:24.156662 (+1423688us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54002d4e54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:24.156756 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925577088}
W20260709 12:19:24.176844 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 197567us
I20260709 12:19:23.912269 15141 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.249s
I20260709 12:19:24.157004 15073 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:24.180202 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:24.184641 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:24.144034 14986 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:24.190371 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:24.185375 14969 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:19:24.191744 14933 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:24.193480 15074 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:24.178712 14998 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:24.185765 15005 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:24.194634 15005 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:24.195001 15005 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:24.165562 15025 consensus_queue.cc:1059] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:19:24.196573 15025 raft_consensus.cc:3055] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:24.196919 15025 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:24.198146 13222 tablet_copy_source_session.cc:215] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:24.197788 15025 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:24.198910 15025 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:24.199931 15126 consensus_meta.cc:287] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.003s
I20260709 12:19:24.200690 13203 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:24.186086 13840 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:24.202242 13102 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:24.178884 15077 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:24.176163 14987 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.184689 14978 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:24.231590 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 45626.5us
W20260709 12:19:24.233634 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 49028.9us
I20260709 12:19:24.179859 15137 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:24.232398 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:24.237294 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 94141.4us
I20260709 12:19:24.178934 15106 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:23.981879 15079 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:24.199275 13222 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:36412 (request call id 305) took 1921 ms. Trace:
I20260709 12:19:24.234933 13100 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:24.163870 15111 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:19:24.244524 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:24.230979 14998 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:24.186268 15035 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:24.174654 15033 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:24.186056 15114 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:24.200325 15126 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:24.194231 14967 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:24.243901 14987 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:24.245695 15122 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:24.319137 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:24.247188 13175 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:24.201102 14991 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:24.203299 14917 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.165944 15109 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:19:24.244827 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:24.234407 14926 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:24.239905 15074 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:24.181252 15019 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:24.300431 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 65566.1us
I20260709 12:19:24.178218 15082 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:19:24.201718 15135 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:24.314128 13281 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:19:24.384310 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 139843us
I20260709 12:19:24.311455 13285 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 1. Current term is 2. Ops: []
W20260709 12:19:24.424883 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 177820us
W20260709 12:19:24.418735 13207 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2335) took 1973 ms (client timeout 1539 ms). Trace:
I20260709 12:19:24.426220 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:24.426873 13840 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:24.352233 13282 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:24.427371 13129 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:24.299571 15147 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:24.438500 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:24.425805 13207 rpcz_store.cc:269] 0709 12:19:22.445708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.445825 (+   117us) service_pool.cc:224] Handling call
0709 12:19:24.417834 (+1972009us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54002d5854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:24.418651 (+   817us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938333568}
I20260709 12:19:24.445932 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:24.438265 13129 raft_consensus.cc:2955] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:24.303756 15114 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:24.310554 15077 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:19:24.492527 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 46681.2us
I20260709 12:19:24.470505 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:24.468856 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:24.319887 15042 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:19:24.480728 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.377261 14986 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:24.488726 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:24.377542 14957 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:24.424244 14926 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:24.435997 14961 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:24.497020 13137 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:24.429945 15024 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:24.428104 15074 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:24.447347 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:24.349710 15136 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.449003 13204 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:24.478854 13282 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:24.491812 15118 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.426580 14991 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:24.317500 14967 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:24.489301 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 607258us
I20260709 12:19:24.366144 15055 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.440253 15147 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:24.470752 15151 log.cc:927] Time spent T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.173s	user 0.000s	sys 0.009s
I20260709 12:19:24.537931 13132 raft_consensus.cc:2368] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4.
I20260709 12:19:24.539345 15155 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:24.501963 13286 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 4: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:24.529274 14926 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:24.500420 15042 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:24.543650 14933 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.543555 15136 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:24.507732 15075 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:24.435027 14917 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:24.546806 15147 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:24.436494 15121 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:19:24.251037 13222 rpcz_store.cc:276] 0709 12:19:22.277689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.277839 (+   150us) service_pool.cc:224] Handling call
0709 12:19:23.981215 (+1703376us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x7b5400102d20. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e04dc0 00007f70f4e974a5 00007f70f4e973ee 00007f70f9e2d036 00007f70f9e36a3e 00007f70f16fa27b 00007f70f9e369ba 00007f70f9e31acc 00007f70f9e2cc7b 00007f70f9e218d1
0709 12:19:24.197794 (+216579us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54000726d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e973f7 00007f70f9e2d036 00007f70f9e36a3e 00007f70f16fa27b 00007f70f9e369ba 00007f70f9e31acc 00007f70f9e2cc7b 00007f70f9e218d1 00007f70f8ed54b4 00007f70f8ed5442
0709 12:19:24.199191 (+  1397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817049600}
I20260709 12:19:24.499094 15077 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:24.548372 14991 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:24.540920 15074 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:24.550274 15055 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:24.551713 13252 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.654s	user 0.028s	sys 0.035s
I20260709 12:19:24.447810 15033 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.495013 15114 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:24.480727 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:24.565730 14969 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:24.545845 15005 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:24.500326 14986 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:24.487533 15106 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:24.566259 13279 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:19:24.568115 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:24.770963 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 271236us
I20260709 12:19:24.584631 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:24.531286 15150 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.650698 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:24.714401 13280 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:19:24.634800 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:25.201058 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:24.668576 13204 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:19:25.194141 13252 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.296s	user 0.034s	sys 0.055s
I20260709 12:19:25.193967 13130 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:24.732313 13177 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:25.206344 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 289762us
W20260709 12:19:25.437142 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 704922us
I20260709 12:19:25.437486 13175 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:25.437678 15087 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:25.438294 15087 raft_consensus.cc:697] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:25.439019 13175 leader_election.cc:400] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4.
W20260709 12:19:25.092957 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.204787 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1597) took 1048 ms. Trace:
W20260709 12:19:25.186481 13283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.021s	sys 0.009s
I20260709 12:19:24.562930 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:25.195643 14969 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:24.528316 14957 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:25.486654 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.478581 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2382) took 1045 ms. Trace:
W20260709 12:19:25.505318 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 2.87645e+06us
I20260709 12:19:25.319924 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:25.213626 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:25.261032 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 325) took 1460 ms. Trace:
W20260709 12:19:25.451257 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 166956us
I20260709 12:19:25.508163 13884 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.210914 13212 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:25.439358 13175 leader_election.cc:403] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:19:25.270268 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 64084us
W20260709 12:19:25.271241 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 75256.9us
I20260709 12:19:25.261446 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:25.505019 13283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.021s	sys 0.015s
I20260709 12:19:25.513154 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:25.514919 13252 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:25.504144 13285 rpcz_store.cc:276] 0709 12:19:24.156831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.157031 (+   200us) service_pool.cc:224] Handling call
0709 12:19:24.157295 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.425227 (+267932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.180696 (+755469us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400332054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:25.204736 (+ 24040us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353848192}
I20260709 12:19:25.514218 13284 rpcz_store.cc:276] 0709 12:19:24.433603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.621524 (+187921us) service_pool.cc:224] Handling call
0709 12:19:24.650283 (+ 28759us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:24.733055 (+ 82772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.733099 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:24.742025 (+  8926us) log.cc:844] Serialized 26 byte log entry
0709 12:19:25.195164 (+453139us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:25.195204 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.195273 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:25.478264 (+282991us) raft_consensus.cc:1685] finished
0709 12:19:25.478294 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.478494 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47686,"raft.queue_time_us":199057,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":7803,"thread_start_us":443001,"threads_started":1,"wal-append.queue_time_us":724334}
I20260709 12:19:25.508216 13204 rpcz_store.cc:276] 0709 12:19:23.744988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.667678 (+922690us) service_pool.cc:224] Handling call
0709 12:19:24.668266 (+   588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:25.204760 (+536494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.204968 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:24.689548 15148 log.cc:927] Time spent T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.273s	user 0.003s	sys 0.001s
I20260709 12:19:25.460790 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 321) took 1717 ms. Trace:
I20260709 12:19:25.519660 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:24.561866 15155 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:24.970018 14978 consensus_meta.cc:287] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.000s
I20260709 12:19:24.827188 15111 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:24.664690 15019 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:25.537441 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 225578us
W20260709 12:19:25.565291 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 125367us
I20260709 12:19:25.193097 15157 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:25.540823 14998 consensus_queue.cc:1059] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:25.543321 15075 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:19:24.966379 15072 consensus_meta.cc:287] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.054s	user 0.004s	sys 0.005s
I20260709 12:19:24.566926 15042 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.556872 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2391) took 1113 ms. Trace:
I20260709 12:19:25.590359 13284 rpcz_store.cc:276] 0709 12:19:24.445550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.555948 (+1110398us) service_pool.cc:224] Handling call
0709 12:19:25.556314 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.556530 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:25.556554 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:25.556600 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:25.556633 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.556690 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.556805 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:25.216138 14987 consensus_meta.cc:287] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.779s	user 0.008s	sys 0.004s
W20260709 12:19:25.321359 14926 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.737s	user 0.002s	sys 0.008s
I20260709 12:19:24.736224 15141 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:25.451041 14967 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.004s	sys 0.007s
I20260709 12:19:24.864935 14919 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:25.344457 15122 consensus_meta.cc:287] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.911s	user 0.011s	sys 0.000s
I20260709 12:19:25.526599 13285 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:25.688838 15122 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:24.872195 15136 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:25.566824 13103 leader_election.cc:336] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.539s (SENT)
I20260709 12:19:25.690352 13284 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:19:25.690476 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 123687us
I20260709 12:19:25.692164 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 265) took 1189 ms. Trace:
W20260709 12:19:25.537288 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 106444us
I20260709 12:19:25.692508 13284 rpcz_store.cc:276] 0709 12:19:24.503047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.591665 (+1088618us) service_pool.cc:224] Handling call
0709 12:19:25.690001 (+ 98336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.690759 (+   758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.691972 (+  1213us) spinlock_profiling.cc:243] Waited 98 ms on lock 0x7b5400408dd0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:25.692107 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225362816}
I20260709 12:19:25.693045 14983 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:25.693608 14983 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.694077 13284 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:25.200268 15077 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.479923 15025 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.566512 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:25.713318 13882 raft_consensus.cc:2368] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3.
I20260709 12:19:25.713965 13882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 461) took 1156 ms. Trace:
I20260709 12:19:24.922595 14973 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:25.319861 13278 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:25.570173 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 55362.8us
I20260709 12:19:25.284662 15121 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.715963 15121 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.716928 15053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5031b82872c430cbd03772ba96480ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:25.378890 15005 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:25.440342 15166 consensus_queue.cc:1059] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 12:19:24.689194 15135 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:24.620326 15126 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:25.210696 15033 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.572582 14969 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:25.439606 14988 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:25.573364 15178 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:25.284297 15167 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.339601 15169 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.260823 13133 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:25.573575 15181 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:25.521685 13130 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:25.304591 15073 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:25.322448 14917 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:25.525413 13881 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:25.524510 15158 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:24.760010 15079 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:24.559178 15118 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:25.587738 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:25.588367 15165 log.cc:927] Time spent T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.392s	user 0.003s	sys 0.007s
I20260709 12:19:24.585821 14933 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.527148 13207 rpcz_store.cc:276] 0709 12:19:23.743802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.495131 (+751329us) service_pool.cc:224] Handling call
0709 12:19:24.528819 (+ 33688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:24.541652 (+ 12833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.541691 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:24.554651 (+ 12960us) log.cc:844] Serialized 26 byte log entry
0709 12:19:24.822263 (+267612us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:24.822342 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.822446 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:25.460428 (+637982us) raft_consensus.cc:1685] finished
0709 12:19:25.460464 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.460693 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12392,"raft.queue_time_us":20028,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":210389,"threads_started":1,"wal-append.queue_time_us":801269}
I20260709 12:19:25.563272 15155 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:25.567992 14978 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4.
I20260709 12:19:25.427495 15114 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.435971 15147 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.583668 15111 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:25.439229 15087 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.709108 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:25.270117 15150 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:25.670446 14987 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.682992 15140 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:25.715219 14973 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:25.687625 14919 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:25.672254 15074 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.577317 15157 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:25.585006 15072 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:25.681588 14926 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:25.681921 15141 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.832495 13884 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:26.086191 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:25.703742 15082 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:26.087863 15082 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:26.067319 15042 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.737982 15055 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:25.714403 13882 rpcz_store.cc:276] 0709 12:19:24.557701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.561203 (+  3502us) service_pool.cc:224] Handling call
0709 12:19:25.713883 (+1152680us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.091325 15167 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:25.670146 15182 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:26.095196 15167 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.047200 15033 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.096211 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1595) took 1942 ms. Trace:
I20260709 12:19:26.097339 15111 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:26.096691 13278 rpcz_store.cc:276] 0709 12:19:24.153488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.158224 (+  4736us) service_pool.cc:224] Handling call
0709 12:19:24.183380 (+ 25156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.715242 (+1531862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.095933 (+380691us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002288d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:26.096135 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2596884224}
I20260709 12:19:26.099140 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1601) took 1371 ms. Trace:
I20260709 12:19:26.127504 13278 rpcz_store.cc:276] 0709 12:19:24.727967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.098358 (+1370391us) service_pool.cc:224] Handling call
0709 12:19:26.098587 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.098775 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.098802 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.098850 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:26.098905 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.098965 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.099084 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:26.113272 15146 log.cc:927] Time spent T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Append to log took a long time: real 1.873s	user 0.005s	sys 0.018s
I20260709 12:19:26.132148 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1602) took 1403 ms. Trace:
I20260709 12:19:26.132653 13278 rpcz_store.cc:276] 0709 12:19:24.728556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.131159 (+1402603us) service_pool.cc:224] Handling call
0709 12:19:26.131547 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.131769 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.131797 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.131841 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:26.131896 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.131959 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.132086 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.135043 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1603) took 1399 ms. Trace:
I20260709 12:19:26.137130 13278 rpcz_store.cc:276] 0709 12:19:24.735371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.134132 (+1398761us) service_pool.cc:224] Handling call
0709 12:19:26.134463 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.134680 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.134712 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.134765 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:26.134811 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.134877 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.134987 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:25.736864 15019 consensus_queue.cc:1059] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.364s
I20260709 12:19:26.101950 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1598) took 1940 ms. Trace:
I20260709 12:19:26.102948 13879 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:26.103415 15118 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:26.103895 15178 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:26.139022 14976 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:26.139882 15118 raft_consensus.cc:3055] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:26.140429 15118 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:26.140455 13879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 681) took 2426 ms (client timeout 2062 ms). Trace:
I20260709 12:19:26.140820 15178 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:26.104945 15154 log.cc:927] Time spent T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.976s	user 0.003s	sys 0.011s
W20260709 12:19:26.140991 13879 rpcz_store.cc:269] 0709 12:19:23.713618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.468484 (+754866us) service_pool.cc:224] Handling call
0709 12:19:26.140255 (+1671771us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54006194d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:26.140380 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3683931392}
I20260709 12:19:26.141353 15118 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:26.142210 13886 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:26.138625 13283 rpcz_store.cc:276] 0709 12:19:24.161539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.162414 (+   875us) service_pool.cc:224] Handling call
0709 12:19:24.567354 (+404940us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b5800183f98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e66fc0 00007f70f9e51929 00007f70f9e513d2 00007f70f33c8bd4
0709 12:19:24.567571 (+   217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:24.567927 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.567958 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:24.568427 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:19:25.512932 (+944505us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:25.512988 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.513093 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:25.587669 (+ 74576us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:26.101751 (+514082us) raft_consensus.cc:1685] finished
0709 12:19:26.101774 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.101894 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16743,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":46391,"spinlock_wait_cycles":18896896,"thread_start_us":944078,"threads_started":1,"wal-append.queue_time_us":627037}
I20260709 12:19:26.105057 15072 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:26.106169 13133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1043) took 1679 ms (client timeout 1615 ms). Trace:
I20260709 12:19:26.105628 14978 consensus_queue.cc:1059] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:26.105654 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:26.146143 13133 rpcz_store.cc:269] 0709 12:19:24.426484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.439791 (+ 13307us) service_pool.cc:224] Handling call
0709 12:19:26.106064 (+1666273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.146914 14987 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.061328 14983 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:26.147351 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:26.149101 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:26.149688 14983 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:26.150082 14983 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:26.150507 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:26.150852 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:25.846329 15174 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.317s	user 0.000s	sys 0.003s
I20260709 12:19:26.151175 14983 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:26.152422 13136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1045) took 1658 ms. Trace:
I20260709 12:19:26.152563 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:26.152797 13136 rpcz_store.cc:276] 0709 12:19:24.493948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.494116 (+   168us) service_pool.cc:224] Handling call
0709 12:19:24.494447 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:24.781942 (+287495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.781993 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:25.179602 (+397609us) log.cc:844] Serialized 26 byte log entry
0709 12:19:25.489106 (+309504us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:25.489157 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.489247 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:26.152205 (+662958us) raft_consensus.cc:1685] finished
0709 12:19:26.152225 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.152341 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10571,"raft.queue_time_us":70832,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":18705,"thread_start_us":584776,"threads_started":2,"wal-append.queue_time_us":349134}
I20260709 12:19:26.154102 13134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1556) took 1653 ms. Trace:
I20260709 12:19:26.108100 13286 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:26.147363 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:26.155594 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2392) took 1257 ms. Trace:
I20260709 12:19:26.155506 13133 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:26.156001 13136 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:26.103467 15169 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:26.090619 15082 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:25.922003 15172 log.cc:927] Time spent T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:19:26.157279 13133 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:26.162312 15141 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.086084 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:26.109833 14933 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.111299 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2347) took 3383 ms. Trace:
I20260709 12:19:26.165624 13212 rpcz_store.cc:276] 0709 12:19:22.727684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.054392 (+326708us) service_pool.cc:224] Handling call
0709 12:19:24.417984 (+1363592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.509207 (+1091223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.739254 (+230047us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54002d5854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:26.111069 (+371815us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002d5850. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:26.111205 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4958138496}
I20260709 12:19:26.166553 14933 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:26.167064 14933 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:26.167524 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2369) took 2325 ms. Trace:
I20260709 12:19:26.167881 13212 rpcz_store.cc:276] 0709 12:19:23.842018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.166723 (+2324705us) service_pool.cc:224] Handling call
0709 12:19:26.167001 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.167196 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.167223 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.167264 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:26.167302 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.167351 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.167470 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.169401 14933 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:26.170113 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2370) took 2326 ms. Trace:
W20260709 12:19:26.124526 13203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36412 (request call id 320) took 2384 ms (client timeout 3061 ms). Trace:
I20260709 12:19:26.170639 13212 rpcz_store.cc:276] 0709 12:19:23.843368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.168731 (+2325363us) service_pool.cc:224] Handling call
0709 12:19:26.169452 (+   721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.169626 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.169651 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.169691 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:26.169907 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.169965 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.170065 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.128154 14995 raft_consensus.cc:2243] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEARNER]: Raft consensus shutting down.
I20260709 12:19:26.172111 14995 raft_consensus.cc:2272] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEARNER]: Raft consensus is shut down!
I20260709 12:19:26.175287 14995 ts_tablet_manager.cc:1916] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:26.176813 13205 raft_consensus.cc:606] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:26.177270 13205 raft_consensus.cc:614] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:26.179577 15180 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.179991 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36352 (request call id 17) took 2599 ms. Trace:
I20260709 12:19:26.099761 15073 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:26.142270 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2362) took 2434 ms. Trace:
I20260709 12:19:26.145706 13283 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:26.153946 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:26.181743 13137 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:26.068262 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 352345us
W20260709 12:19:26.006397 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.183148 13252 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:26.046777 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 267) took 1487 ms. Trace:
I20260709 12:19:26.184859 13252 leader_election.cc:400] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5.
I20260709 12:19:26.067094 14957 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.067679 15121 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:26.154527 13134 rpcz_store.cc:276] 0709 12:19:24.501066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.727391 (+226325us) service_pool.cc:224] Handling call
0709 12:19:25.180315 (+452924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.152740 (+972425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.152768 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.152808 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:26.152852 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.153887 (+  1035us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b5400061b54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:26.153933 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.154048 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235923200}
I20260709 12:19:26.156021 13286 rpcz_store.cc:276] 0709 12:19:24.898690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.194636 (+295946us) service_pool.cc:224] Handling call
0709 12:19:26.155418 (+960782us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54002dafd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:26.155538 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369543936}
I20260709 12:19:26.159246 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1044) took 1732 ms. Trace:
I20260709 12:19:26.159591 15169 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.337864 14926 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:26.157297 13136 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:25.724313 15025 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:26.339746 13136 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:26.341517 15025 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.341837 13136 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:26.180761 13205 rpcz_store.cc:276] 0709 12:19:23.580757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.607707 (+ 26950us) service_pool.cc:224] Handling call
0709 12:19:26.179734 (+2572027us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b54000730d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e87853 00007f70f9e5560a 00007f70f33db7d4 00007f70f33db762 00007f70f33db691 00007f70f33db60c 00007f70f33da8c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:26.179908 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5852619136}
I20260709 12:19:26.181339 13209 rpcz_store.cc:276] 0709 12:19:23.707749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.708614 (+   865us) service_pool.cc:224] Handling call
0709 12:19:23.709040 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:23.724802 (+ 15762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:23.724837 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:24.239891 (+515054us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b2c0000e5c8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:19:24.248886 (+  8995us) log.cc:844] Serialized 26 byte log entry
0709 12:19:25.180550 (+931664us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:25.535751 (+355201us) log.cc:844] Serialized 14 byte log entry
0709 12:19:25.552714 (+ 16963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.552823 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:26.104324 (+551501us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:26.142046 (+ 37722us) raft_consensus.cc:1685] finished
0709 12:19:26.142066 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.142206 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41363,"prepare.queue_time_us":307720,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":138704,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":23404,"spinlock_wait_cycles":24953984,"thread_start_us":745197,"threads_started":3,"wal-append.queue_time_us":517181}
I20260709 12:19:26.337141 15155 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:26.343799 13135 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:26.344031 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2376) took 2362 ms. Trace:
I20260709 12:19:26.344934 15155 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.345667 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2377) took 2229 ms. Trace:
I20260709 12:19:26.346275 13209 rpcz_store.cc:276] 0709 12:19:24.116420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.343253 (+2226833us) service_pool.cc:224] Handling call
0709 12:19:26.345101 (+  1848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.345294 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.345320 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.345358 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:26.345397 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.345459 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.345585 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.337610 13128 rpcz_store.cc:276] 0709 12:19:24.426818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.429538 (+  2720us) service_pool.cc:224] Handling call
0709 12:19:24.492590 (+ 63052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:24.691176 (+198586us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b18003d9780. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:19:24.902402 (+211226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.921924 (+ 19522us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:25.306563 (+384639us) log.cc:844] Serialized 26 byte log entry
0709 12:19:25.667328 (+360765us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:25.676015 (+  8687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:25.695755 (+ 19740us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:26.158890 (+463135us) raft_consensus.cc:1685] finished
0709 12:19:26.158917 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.159181 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25441,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"spinlock_wait_cycles":6470912,"thread_start_us":532099,"threads_started":2,"wal-append.queue_time_us":372018}
I20260709 12:19:25.754539 14991 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:26.160427 13881 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:26.111199 15150 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:26.121714 14986 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:26.408237 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 460) took 1850 ms. Trace:
I20260709 12:19:26.117688 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1558) took 1616 ms. Trace:
W20260709 12:19:26.170835 13203 rpcz_store.cc:269] 0709 12:19:23.740552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.741561 (+  1009us) service_pool.cc:224] Handling call
0709 12:19:26.124290 (+2382729us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54001c3754. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:26.124426 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975665408}
I20260709 12:19:26.126922 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:26.184765 13284 rpcz_store.cc:276] 0709 12:19:24.559652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.693459 (+1133807us) service_pool.cc:224] Handling call
0709 12:19:25.693775 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.694425 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.046683 (+352258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.188084 13252 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:26.090600 15042 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:26.230077 13279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.059s	sys 0.101s
I20260709 12:19:26.180085 15180 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:26.229259 15182 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4.
W20260709 12:19:26.331019 13249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.002s	sys 0.009s
W20260709 12:19:26.328955 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 261087us
W20260709 12:19:26.269173 13177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.044s	sys 0.107s
I20260709 12:19:26.351504 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2378) took 2194 ms. Trace:
I20260709 12:19:26.235977 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1605) took 1484 ms. Trace:
I20260709 12:19:26.354812 13137 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
W20260709 12:19:26.275597 13175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.000s	sys 0.002s
W20260709 12:19:26.322505 13887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.003s	sys 0.004s
I20260709 12:19:25.720885 15122 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:25.727074 13878 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:26.402398 13285 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:19:26.385773 15161 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:26.294301 14967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.002s	sys 0.001s
I20260709 12:19:26.078293 15077 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:26.325802 15031 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.000s	sys 0.007s
I20260709 12:19:26.429661 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 331) took 1932 ms. Trace:
W20260709 12:19:26.478762 13279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.064s	sys 0.103s
I20260709 12:19:26.408809 13881 rpcz_store.cc:276] 0709 12:19:24.557396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.562620 (+  5224us) service_pool.cc:224] Handling call
0709 12:19:26.399862 (+1837242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:26.478782 13249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.009s	sys 0.009s
I20260709 12:19:26.410153 13129 raft_consensus.cc:2393] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:19:26.488535 13250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.004s	sys 0.011s
W20260709 12:19:26.493450 13250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.004s	sys 0.011s
W20260709 12:19:26.493340 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 926946us
I20260709 12:19:26.489367 13203 rpcz_store.cc:276] 0709 12:19:24.497551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.428664 (+1931113us) service_pool.cc:224] Handling call
0709 12:19:26.429025 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.429254 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.429287 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.429342 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:26.429393 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.429465 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.429585 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.499991 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:25.766162 15126 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:26.477965 13209 rpcz_store.cc:276] 0709 12:19:24.154799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.347958 (+2193159us) service_pool.cc:224] Handling call
0709 12:19:26.348571 (+   613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.348796 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.348833 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.348890 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:26.348952 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.349023 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.349145 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.491165 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:19:26.481860 13175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.002s	sys 0.006s
I20260709 12:19:26.476089 14986 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:26.477855 13283 rpcz_store.cc:276] 0709 12:19:24.752030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.145233 (+1393203us) service_pool.cc:224] Handling call
0709 12:19:26.145533 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.235626 (+ 90093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.235897 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:26.480794 14967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.003s	sys 0.004s
W20260709 12:19:26.484287 13887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.004s	sys 0.004s
I20260709 12:19:26.484702 15114 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.229516 14987 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:26.408262 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2393) took 1506 ms. Trace:
I20260709 12:19:26.344547 13205 rpcz_store.cc:276] 0709 12:19:23.981747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.343026 (+2361279us) service_pool.cc:224] Handling call
0709 12:19:26.343383 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.343613 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.343645 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.343714 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:26.343754 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.343824 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.343942 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.435766 13133 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:26.229010 14933 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:26.409404 13132 rpcz_store.cc:276] 0709 12:19:24.502677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.273291 (+770614us) service_pool.cc:224] Handling call
0709 12:19:25.341269 (+ 67978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.116545 (+775276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.116588 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.116646 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:26.116700 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.117385 (+   685us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54001f31d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:26.117436 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.117581 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1782307712}
W20260709 12:19:26.478255 13177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.052s	sys 0.109s
W20260709 12:19:26.544667 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 980228us
W20260709 12:19:26.509292 13206 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.005s	sys 0.011s
W20260709 12:19:26.545694 13206 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.005s	sys 0.012s
W20260709 12:19:26.505625 13838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.002s	sys 0.009s
W20260709 12:19:26.546815 13838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.003s	sys 0.010s
I20260709 12:19:26.547555 13286 rpcz_store.cc:276] 0709 12:19:24.902121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.390560 (+1488439us) service_pool.cc:224] Handling call
0709 12:19:26.407699 (+ 17139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.407897 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.407934 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.407976 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:26.408020 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.408081 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.408207 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:26.470329 13100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.009s	sys 0.004s
I20260709 12:19:26.336710 15160 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:26.487510 13176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.000s	sys 0.015s
W20260709 12:19:26.553483 13176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.000s	sys 0.015s
I20260709 12:19:26.253985 15140 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:26.501400 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:26.426915 14964 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:26.489028 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2395) took 1285 ms. Trace:
W20260709 12:19:26.504565 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 937834us
I20260709 12:19:26.514366 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:26.527352 13209 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:26.487799 15161 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:26.531791 13211 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:26.536123 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:26.655280 13283 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:26.072980 15135 raft_consensus.cc:3055] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:26.514037 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1548) took 2076 ms. Trace:
W20260709 12:19:26.542251 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 48034.9us
I20260709 12:19:26.542742 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 266) took 1988 ms. Trace:
I20260709 12:19:26.657261 13285 rpcz_store.cc:276] 0709 12:19:24.554776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.689215 (+1134439us) service_pool.cc:224] Handling call
0709 12:19:25.689577 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.483550 (+793973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.542386 (+ 58836us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54001ad1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:26.542655 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638702848}
W20260709 12:19:26.549914 13100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.009s	sys 0.005s
I20260709 12:19:26.432371 15197 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.560225 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2388) took 2125 ms. Trace:
I20260709 12:19:26.676605 13277 rpcz_store.cc:276] 0709 12:19:24.435181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.273545 (+838364us) service_pool.cc:224] Handling call
0709 12:19:26.230509 (+956964us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b5800183f98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e66fc0 00007f70f9e51929 00007f70f9e513d2 00007f70f33c8bd4
0709 12:19:26.230762 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.400552 (+169790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.400598 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.400655 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:26.400703 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.559963 (+159260us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54000965d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:26.560021 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.560162 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400125056}
I20260709 12:19:26.562660 13203 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
W20260709 12:19:26.479739 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 291756us
I20260709 12:19:26.564777 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:26.513228 15126 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:26.568224 13205 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:26.488162 15192 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:26.570636 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2394) took 1649 ms. Trace:
I20260709 12:19:26.608507 15182 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.672597 15135 raft_consensus.cc:740] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:26.571520 15198 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 12:19:26.574431 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 83355.5us
W20260709 12:19:26.491351 15031 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.000s	sys 0.010s
I20260709 12:19:26.575022 13177 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:26.533402 15106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.004s	sys 0.009s
I20260709 12:19:26.487056 15122 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:26.646786 13282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.029s	sys 0.075s
W20260709 12:19:26.743049 13282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.030s	sys 0.076s
W20260709 12:19:26.612762 13204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.052s
I20260709 12:19:26.595722 13284 rpcz_store.cc:276] 0709 12:19:25.203368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.487345 (+1283977us) service_pool.cc:224] Handling call
0709 12:19:26.488206 (+   861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.488516 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.488567 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.488634 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:26.488716 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.488829 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.488966 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.654101 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 332) took 2156 ms. Trace:
I20260709 12:19:26.783870 13209 rpcz_store.cc:276] 0709 12:19:24.498007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.526444 (+2028437us) service_pool.cc:224] Handling call
0709 12:19:26.526905 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.653733 (+126828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.654018 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.785769 13209 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:26.655896 13135 rpcz_store.cc:276] 0709 12:19:24.437794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.438786 (+   992us) service_pool.cc:224] Handling call
0709 12:19:24.439045 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.344290 (+1905245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.513734 (+169444us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b540011c954. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:26.513950 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4380023680}
I20260709 12:19:26.680486 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:26.681852 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:26.786898 13285 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:26.698155 14964 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:26.703603 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 189278us
I20260709 12:19:26.707085 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:26.714766 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 116974us
I20260709 12:19:26.705476 13278 rpcz_store.cc:276] 0709 12:19:24.921605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.427901 (+1506296us) service_pool.cc:224] Handling call
0709 12:19:26.531741 (+103840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.552920 (+ 21179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.570237 (+ 17317us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.570312 (+    75us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:26.570373 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.570439 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.570575 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:26.728413 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.768229 14967 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:26.767490 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 192528us
I20260709 12:19:26.705219 15190 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.652135 14991 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:26.697467 15193 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:26.563062 14987 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:26.571926 15160 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:26.852284 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 334) took 1155 ms. Trace:
W20260709 12:19:27.033519 15185 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:19:26.859655 14973 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:26.705318 15186 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.231546 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2389) took 2796 ms. Trace:
I20260709 12:19:27.231312 15186 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:27.232015 14987 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:27.232730 14987 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.231935 13279 rpcz_store.cc:276] 0709 12:19:24.435512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.261841 (+826329us) service_pool.cc:224] Handling call
0709 12:19:25.440379 (+178538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:25.441205 (+   826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:25.441232 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:25.441799 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:19:26.489821 (+1048022us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:26.489874 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.489959 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.231304 (+741345us) raft_consensus.cc:1685] finished
0709 12:19:27.231324 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.231474 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"thread_start_us":971830,"threads_started":1,"wal-append.queue_time_us":999418}
I20260709 12:19:27.233175 14987 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:27.233767 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:27.234405 13279 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:27.235265 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:27.033308 15210 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.353s	user 0.000s	sys 0.000s
W20260709 12:19:27.206750 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.235951 13279 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:27.236865 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2368) took 3398 ms. Trace:
I20260709 12:19:27.236862 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:26.730363 15155 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:27.238207 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:27.237443 13210 rpcz_store.cc:276] 0709 12:19:23.838815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.163368 (+2324553us) service_pool.cc:224] Handling call
0709 12:19:26.163692 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.164060 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.164090 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.164586 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:19:26.323200 (+158614us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:26.323284 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.323482 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.236652 (+913170us) raft_consensus.cc:1685] finished
0709 12:19:27.236670 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.236788 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18020,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":117131,"thread_start_us":158014,"threads_started":1,"wal-append.queue_time_us":377984}
I20260709 12:19:26.854476 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 333) took 2236 ms. Trace:
I20260709 12:19:27.239238 13205 rpcz_store.cc:276] 0709 12:19:24.555768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.567552 (+2011784us) service_pool.cc:224] Handling call
0709 12:19:26.567905 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.699802 (+131897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.792370 (+ 92568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:27.030213 15161 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:26.876744 15074 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:27.240463 13285 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: []
W20260709 12:19:27.240665 13204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.027s	sys 0.104s
I20260709 12:19:27.241138 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 269) took 1972 ms. Trace:
I20260709 12:19:26.787390 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:27.241500 13285 rpcz_store.cc:276] 0709 12:19:25.268768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.240046 (+1971278us) service_pool.cc:224] Handling call
0709 12:19:27.240306 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.240907 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.241087 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:27.242326 13284 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 4: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:19:27.242393 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 582518us
I20260709 12:19:27.243076 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 270) took 1974 ms. Trace:
W20260709 12:19:26.801774 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 393776us
I20260709 12:19:27.243566 14967 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.787030 13286 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:27.244297 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:27.244630 15190 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:27.245467 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 272) took 1922 ms. Trace:
I20260709 12:19:27.245353 15198 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:27.245949 13210 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:27.245898 13286 rpcz_store.cc:276] 0709 12:19:25.322883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.244695 (+1921812us) service_pool.cc:224] Handling call
0709 12:19:27.244975 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.245166 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:27.245190 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:27.245231 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:27.245273 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.245321 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.245420 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:27.246933 15190 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:26.781816 13208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.025s	sys 0.050s
I20260709 12:19:26.704464 15197 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:27.025650 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 695) took 1332 ms. Trace:
I20260709 12:19:27.031594 15122 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:27.214430 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:27.238456 15155 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:27.130486 14919 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:26.732211 15106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.004s	sys 0.009s
W20260709 12:19:27.098136 14998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.468s	user 0.000s	sys 0.029s
I20260709 12:19:27.246791 15198 consensus_queue.cc:1059] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:27.235496 14964 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.729269 15182 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:27.239650 13211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2363) took 3531 ms (client timeout 1695 ms). Trace:
I20260709 12:19:26.909394 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46516 (request call id 96) took 1295 ms. Trace:
I20260709 12:19:27.226919 15157 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:27.223316 15073 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:26.917737 15212 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:27.036224 15203 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 12:19:27.213977 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.006603 15135 consensus_queue.cc:260] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:27.229923 15193 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:27.244159 14967 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:27.212638 13252 leader_election.cc:400] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5.
W20260709 12:19:27.181994 13281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.023s	sys 0.091s
W20260709 12:19:27.247766 13208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.030s	sys 0.056s
W20260709 12:19:27.269243 13281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.024s	sys 0.092s
I20260709 12:19:27.247408 13286 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:27.249225 15155 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:27.271184 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1606) took 1831 ms. Trace:
I20260709 12:19:27.229558 13209 rpcz_store.cc:276] 0709 12:19:25.696947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.784870 (+1087923us) service_pool.cc:224] Handling call
0709 12:19:26.785305 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.786208 (+   903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.852201 (+ 65993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:27.249009 15122 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:27.252364 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:27.253925 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:27.254472 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:27.252583 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:27.273394 13132 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:27.273706 13129 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
W20260709 12:19:27.252219 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.260279 13886 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:27.260632 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:27.238226 13175 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:27.291486 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 52824.6us
I20260709 12:19:27.251979 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:27.254411 13211 rpcz_store.cc:269] 0709 12:19:23.708177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.709443 (+  1266us) service_pool.cc:224] Handling call
0709 12:19:27.239464 (+3530021us) spinlock_profiling.cc:243] Waited 2.82 s on lock 0x7b54000730d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:27.239577 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6487727360}
I20260709 12:19:27.254150 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:27.267915 13280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.174s	user 0.049s	sys 0.125s
W20260709 12:19:27.334025 13280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.051s	sys 0.125s
W20260709 12:19:27.275270 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.271657 13286 rpcz_store.cc:276] 0709 12:19:25.439882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.246969 (+1807087us) service_pool.cc:224] Handling call
0709 12:19:27.247242 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.270870 (+ 23628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.271128 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:27.261442 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:27.255607 13283 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:27.272418 13285 rpcz_store.cc:276] 0709 12:19:25.269084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.242325 (+1973241us) service_pool.cc:224] Handling call
0709 12:19:27.242582 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.242764 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:27.242788 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:27.242829 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:27.242870 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.242921 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.243019 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:27.233574 15186 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:27.262307 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49866.2us
I20260709 12:19:27.464118 13252 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:27.267699 15077 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:27.248211 13880 rpcz_store.cc:276] 0709 12:19:25.692706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.711481 (+ 18775us) service_pool.cc:224] Handling call
0709 12:19:25.711868 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:25.712206 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:25.712250 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.083866 (+371616us) log.cc:844] Serialized 26 byte log entry
0709 12:19:26.329387 (+245521us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:26.329448 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.329568 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.025307 (+695739us) raft_consensus.cc:1685] finished
0709 12:19:27.025342 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.025523 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":245009,"threads_started":1,"wal-append.queue_time_us":939139}
I20260709 12:19:27.258896 15135 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.431565 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1609) took 1990 ms. Trace:
I20260709 12:19:27.430253 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:27.257771 14978 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:27.284653 14973 consensus_queue.cc:1059] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.182s
I20260709 12:19:27.254841 15182 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:27.250327 14998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.665s	user 0.000s	sys 0.036s
I20260709 12:19:27.255273 13203 rpcz_store.cc:276] 0709 12:19:25.574069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.684812 (+1110743us) service_pool.cc:224] Handling call
0709 12:19:26.862065 (+177253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:27.229800 15118 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:27.503788 13132 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
W20260709 12:19:27.488930 15196 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 12:19:27.256743 15212 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:27.335757 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 74481.7us
I20260709 12:19:27.253259 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:27.258191 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2365) took 3422 ms. Trace:
I20260709 12:19:27.459331 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:27.460213 13103 leader_election.cc:336] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.695s (SENT)
I20260709 12:19:27.250836 15198 raft_consensus.cc:3055] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:27.503371 15161 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.235240 14987 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:27.469151 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1611) took 2027 ms. Trace:
I20260709 12:19:27.457926 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1610) took 2016 ms. Trace:
I20260709 12:19:27.255388 14964 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:27.249985 15160 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:27.462983 13177 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:27.479640 15155 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:27.482702 13129 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 4: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:27.483575 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1612) took 2042 ms. Trace:
I20260709 12:19:27.241235 15178 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.225s
I20260709 12:19:27.457823 15194 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:27.258725 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:27.496227 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:27.569736 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 73621us
W20260709 12:19:27.334877 13887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.011s	sys 0.037s
W20260709 12:19:27.571642 13887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.020s	sys 0.047s
W20260709 12:19:27.500424 15187 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.848s	user 0.008s	sys 0.002s
I20260709 12:19:27.432338 15193 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:27.249387 15197 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:27.482250 15186 consensus_queue.cc:1059] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:19:27.513370 13207 rpcz_store.cc:276] 0709 12:19:23.835982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.098245 (+2262263us) service_pool.cc:224] Handling call
0709 12:19:26.098587 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.099202 (+   615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.099229 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.099723 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:19:26.323941 (+224218us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:26.324056 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.324187 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.257781 (+933594us) raft_consensus.cc:1685] finished
0709 12:19:27.257808 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.257954 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":223749,"threads_started":1,"wal-append.queue_time_us":550351}
I20260709 12:19:27.522737 13103 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:27.514523 13841 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:27.594152 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 80440.3us
I20260709 12:19:27.527004 13285 rpcz_store.cc:276] 0709 12:19:25.441347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.463781 (+2022434us) service_pool.cc:224] Handling call
0709 12:19:27.468615 (+  4834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.468812 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:27.468840 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:27.468885 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:27.468930 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.468986 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.469090 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:27.532181 13286 rpcz_store.cc:276] 0709 12:19:25.441040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.336883 (+1895843us) service_pool.cc:224] Handling call
0709 12:19:27.457273 (+120390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.457506 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:27.457543 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:27.457589 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:27.457643 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.457716 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.457864 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:27.512495 15106 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:27.536378 13206 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.008s	sys 0.015s
W20260709 12:19:27.596679 13206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.008s	sys 0.015s
I20260709 12:19:27.498672 14978 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:27.522965 15198 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:27.482074 13278 rpcz_store.cc:276] 0709 12:19:25.440785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.250222 (+1809437us) service_pool.cc:224] Handling call
0709 12:19:27.250564 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.431117 (+180553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:27.431151 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:27.431203 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:27.431242 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.431326 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.431494 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83809,"raft.queue_time_us":180278,"spinlock_wait_cycles":70871808}
I20260709 12:19:27.526011 15205 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.525662 15077 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:27.545863 13283 rpcz_store.cc:276] 0709 12:19:25.441601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.482499 (+2040898us) service_pool.cc:224] Handling call
0709 12:19:27.482853 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.483085 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:27.483122 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:27.483177 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:27.483233 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.483304 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.483507 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:27.556658 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 93739.6us
I20260709 12:19:27.556823 15190 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:27.613955 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2386) took 3165 ms. Trace:
I20260709 12:19:27.562361 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:27.568125 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 326908us
I20260709 12:19:27.575207 13249 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:27.536017 15161 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:27.511879 15179 raft_consensus.cc:3055] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:27.569342 14991 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:27.597826 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 137656us
W20260709 12:19:27.604693 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 366497us
W20260709 12:19:27.606273 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.625480 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:27.627815 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:27.545069 14964 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:27.619514 15190 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.560021 14987 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:27.614568 13282 rpcz_store.cc:276] 0709 12:19:24.434657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.665884 (+231227us) service_pool.cc:224] Handling call
0709 12:19:24.666270 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.118709 (+1452439us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b180019c6c0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f4a354bc 00007f70f1d8348b 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9d455 00007f70f4e85060 00007f70f4e85bfb 00007f70f4e9064b
0709 12:19:26.118877 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.118911 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.119455 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:19:27.208213 (+1088758us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:27.208251 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.208313 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.593556 (+385243us) raft_consensus.cc:1685] finished
0709 12:19:27.593579 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.599639 (+  6060us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119280,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":62662,"spinlock_wait_cycles":124394240,"thread_start_us":816716,"threads_started":2,"wal-append.queue_time_us":1379419}
W20260709 12:19:27.619248 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 155245us
I20260709 12:19:27.630470 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:27.657406 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:27.658071 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:27.658874 13136 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
W20260709 12:19:27.608486 15031 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.016s	sys 0.013s
I20260709 12:19:27.648823 13175 leader_election.cc:400] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4.
I20260709 12:19:27.649431 13177 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:27.612253 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 367992us
I20260709 12:19:27.650152 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:27.652870 15207 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:19:27.663355 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:27.661320 13252 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:27.608889 15106 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:27.621707 15179 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:27.717427 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:27.698909 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 123304us
W20260709 12:19:27.697988 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 120045us
I20260709 12:19:27.718199 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:27.697939 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 49269.9us
I20260709 12:19:27.621666 15077 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:27.719332 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:27.718225 13282 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
W20260709 12:19:27.713651 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 52428.1us
I20260709 12:19:27.660457 15190 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:27.721628 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.718670 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:27.716414 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:27.662051 15204 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 12:19:27.720402 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:27.698753 15031 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.020s	sys 0.014s
I20260709 12:19:27.650595 15221 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:27.622509 15205 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:27.661794 14991 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:19:27.736979 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 141809us
I20260709 12:19:27.671653 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:27.659447 15186 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 12:19:27.650390 13022 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer a99436c294734e5cbc3657b2517cefca from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:27.661011 15178 consensus_queue.cc:1059] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:19:27.672744 15198 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:27.725373 15087 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:27.792732 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:28.168797 15087 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:27.700968 15219 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:27.867856 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:27.771148 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 57564.2us
I20260709 12:19:27.866499 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:27.865841 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:27.866144 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:27.830394 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2390) took 3392 ms. Trace:
W20260709 12:19:28.171375 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 452109us
W20260709 12:19:28.055743 15118 consensus_meta.cc:287] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
W20260709 12:19:27.776369 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 60018.5us
I20260709 12:19:28.173187 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 271) took 2888 ms. Trace:
W20260709 12:19:27.839819 15214 log.cc:927] Time spent T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
W20260709 12:19:28.050310 14986 consensus_meta.cc:287] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.537s	user 0.013s	sys 0.000s
I20260709 12:19:28.194195 13284 rpcz_store.cc:276] 0709 12:19:25.284451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.243224 (+1958773us) service_pool.cc:224] Handling call
0709 12:19:27.249646 (+  6422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:27.402279 (+152633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:27.436793 (+ 34514us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:27.437413 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 12:19:27.711528 (+274115us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:27.718528 (+  7000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.718596 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:28.050602 (+332006us) raft_consensus.cc:1685] finished
0709 12:19:28.050623 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.173104 (+122481us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84028,"raft.queue_time_us":84667,"raft.run_cpu_time_us":10301,"raft.run_wall_time_us":95338,"thread_start_us":201757,"threads_started":1,"wal-append.queue_time_us":549512}
I20260709 12:19:27.888177 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2364) took 4052 ms. Trace:
I20260709 12:19:28.195878 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:27.964881 15236 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:19:27.980858 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.067112 15244 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:28.019410 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 300760us
W20260709 12:19:27.815070 14967 consensus_meta.cc:287] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.004s
I20260709 12:19:28.213419 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.214087 13203 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:27.992940 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2383) took 3559 ms. Trace:
I20260709 12:19:28.217199 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:28.189747 13280 rpcz_store.cc:276] 0709 12:19:24.437828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.262095 (+824267us) service_pool.cc:224] Handling call
0709 12:19:25.732276 (+470181us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5800183f98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e66fc0 00007f70f9e51929 00007f70f9e513d2 00007f70f33c8bd4
0709 12:19:25.732520 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.092675 (+360155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.092704 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.093133 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:19:27.334601 (+1241468us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:27.334638 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.829910 (+495272us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54002756d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:27.829985 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.830048 (+    63us) raft_consensus.cc:1685] finished
0709 12:19:27.830088 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.830304 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3202,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":852904576,"thread_start_us":1241116,"threads_started":1,"wal-append.queue_time_us":1382762}
W20260709 12:19:27.843019 15217 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:19:27.842374 15216 log.cc:927] Time spent T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 12:19:27.797108 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 73692.1us
I20260709 12:19:27.933547 15238 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:27.830478 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:28.169554 14983 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:27.936051 14978 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:27.966099 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 459) took 3409 ms. Trace:
I20260709 12:19:28.032078 15077 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:27.840758 15212 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:27.936051 15161 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:27.737386 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:28.212066 13284 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:28.221741 15239 raft_consensus.cc:3055] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:27.875363 15180 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:27.934927 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:27.852895 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:28.254825 15238 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:27.841528 15155 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:28.060781 15053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45928 (request call id 441) took 7124 ms. Trace:
I20260709 12:19:27.856611 15074 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:28.218451 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:28.062695 15234 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:28.219538 13207 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:27.977559 15229 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:28.307000 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2398) took 1799 ms. Trace:
I20260709 12:19:28.163208 14995 ts_tablet_manager.cc:1929] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 12:19:28.169411 15221 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.936753 14964 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:27.851874 14987 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:27.862749 15225 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:28.051450 15106 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:27.940560 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 268) took 2672 ms. Trace:
I20260709 12:19:28.257148 13878 rpcz_store.cc:276] 0709 12:19:24.557089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.561047 (+  3958us) service_pool.cc:224] Handling call
0709 12:19:24.627760 (+ 66713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.497968 (+1870208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.942746 (+1444778us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54005f0fd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:27.965975 (+ 23229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454213888}
I20260709 12:19:28.215369 13281 rpcz_store.cc:276] 0709 12:19:24.433825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.686774 (+252949us) service_pool.cc:224] Handling call
0709 12:19:24.687183 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.107909 (+1420726us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b180035d820. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f4a354bc 00007f70f1d8348b 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9d455 00007f70f4e85060 00007f70f4e85bfb 00007f70f4e9064b
0709 12:19:26.108054 (+   145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.108079 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.108569 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:19:27.269896 (+1161327us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:27.269955 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.270051 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.967092 (+697041us) raft_consensus.cc:1685] finished
0709 12:19:27.967121 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.992861 (+ 25740us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5933,"raft.queue_time_us":172245,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":42138,"spinlock_wait_cycles":25516288,"thread_start_us":1318815,"threads_started":2,"wal-append.queue_time_us":1394218}
I20260709 12:19:27.799683 15223 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.196106 13208 rpcz_store.cc:276] 0709 12:19:23.835697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.596869 (+1761172us) service_pool.cc:224] Handling call
0709 12:19:25.597386 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.100945 (+503559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.100973 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.101421 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:19:27.269805 (+1168384us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:27.269870 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.480607 (+210737us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54002f08d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:27.480668 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.856722 (+376054us) raft_consensus.cc:1685] finished
0709 12:19:27.856740 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.888080 (+ 31340us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":291,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":1157292288,"thread_start_us":1167803,"threads_started":1,"wal-append.queue_time_us":1461226}
I20260709 12:19:28.186249 15087 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:28.223325 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.223568 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:28.008106 15242 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:28.224795 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.228955 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:28.184270 13022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 552051us
W20260709 12:19:27.890962 15200 log.cc:927] Time spent T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
W20260709 12:19:28.216497 15206 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.010s	sys 0.002s
I20260709 12:19:28.242457 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:27.832334 15031 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.388s
I20260709 12:19:28.019174 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 352) took 2457 ms. Trace:
I20260709 12:19:27.940188 15075 raft_consensus.cc:3055] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:28.258066 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:28.218909 15236 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:27.939010 15147 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:28.219376 15135 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:28.267619 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 56606.9us
I20260709 12:19:28.271632 13131 raft_consensus.cc:2410] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:28.271986 15118 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.275704 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2401) took 1762 ms. Trace:
I20260709 12:19:28.340723 15228 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:28.286120 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:28.286110 13882 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:19:28.255954 15226 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.263612 15198 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:28.299198 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2374) took 4374 ms. Trace:
W20260709 12:19:28.280049 15190 consensus_meta.cc:287] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.002s
W20260709 12:19:28.301316 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 130344us
I20260709 12:19:28.378224 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.377460 13212 rpcz_store.cc:276] 0709 12:19:23.924470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.175961 (+2251491us) service_pool.cc:224] Handling call
0709 12:19:26.176311 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.182117 (+  5806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.182162 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.350217 (+168055us) log.cc:844] Serialized 26 byte log entry
0709 12:19:27.207069 (+856852us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:27.207110 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.207179 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.240961 (+ 33782us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b4800002dd8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f9db6aa1 00007f70f9dadb37 00007f70f9dad9ca 00007f70f9ea526f 00007f70f9ea4f37 00007f70f9eb955c 00007f70f9eb9508 00007f70f9eb9488 00007f70f9eb9443 00007f70f9eb86ec 00007f70f8de2a96
0709 12:19:28.294040 (+1053079us) raft_consensus.cc:1685] finished
0709 12:19:28.294078 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.299111 (+  5033us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54577,"raft.run_cpu_time_us":15786,"raft.run_wall_time_us":1009839,"spinlock_wait_cycles":249599232,"thread_start_us":185274,"threads_started":1,"wal-append.queue_time_us":1058599}
I20260709 12:19:28.379951 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.221585 14967 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.308130 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 326) took 4520 ms. Trace:
I20260709 12:19:28.327023 15223 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.359864 15238 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:28.388083 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.388680 13212 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:28.389567 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.280053 15239 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:28.320093 13279 rpcz_store.cc:276] 0709 12:19:25.268378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.239163 (+1970785us) service_pool.cc:224] Handling call
0709 12:19:27.255338 (+ 16175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:27.431391 (+176053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:27.432846 (+  1455us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:27.433419 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:19:27.664345 (+230926us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:27.664404 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.664494 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.940335 (+275841us) raft_consensus.cc:1685] finished
0709 12:19:27.940358 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.940500 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175569,"raft.queue_time_us":175889,"spinlock_wait_cycles":60018432,"thread_start_us":163409,"threads_started":1,"wal-append.queue_time_us":403028}
I20260709 12:19:28.390971 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:27.773874 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1608) took 2333 ms. Trace:
I20260709 12:19:28.286031 15243 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:28.307413 13285 rpcz_store.cc:276] 0709 12:19:26.508073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.877417 (+1369344us) service_pool.cc:224] Handling call
0709 12:19:27.877767 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.877991 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:28.195792 (+317801us) log.cc:844] Serialized 14 byte log entry
0709 12:19:28.306621 (+110829us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:28.306679 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:28.306744 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.306821 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.306939 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16002,"prepare.queue_time_us":60526,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"thread_start_us":411801,"threads_started":2}
I20260709 12:19:28.326012 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:28.284548 15193 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:19:28.326828 15225 raft_consensus.cc:697] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:28.314596 13278 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:28.329751 13203 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:28.331704 13137 raft_consensus.cc:2393] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:28.331895 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 692) took 2640 ms. Trace:
I20260709 12:19:28.222515 15244 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.326989 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:28.310503 15126 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:28.337954 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:28.321122 14995 log.cc:1199] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-3-root/wals/f042aff5e3084d5e8bd6fcb5335160f5
I20260709 12:19:28.315066 14991 raft_consensus.cc:697] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:28.321224 15221 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:28.348097 15255 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:28.416378 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:28.416858 15255 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.419004 15255 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:28.339680 15206 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.010s	sys 0.002s
I20260709 12:19:28.302925 15234 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:28.306703 15229 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:28.350340 15236 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:28.361708 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 327) took 4531 ms. Trace:
I20260709 12:19:28.427536 13204 rpcz_store.cc:276] 0709 12:19:23.830511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.593244 (+1762733us) service_pool.cc:224] Handling call
0709 12:19:25.699070 (+105826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:25.738944 (+ 39874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:25.738982 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:25.764271 (+ 25289us) log.cc:844] Serialized 26 byte log entry
0709 12:19:27.241179 (+1476908us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:27.241218 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.241282 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.478368 (+237086us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b180032bf60. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:19:28.349845 (+871477us) raft_consensus.cc:1685] finished
0709 12:19:28.349865 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.361631 (+ 11766us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27425,"raft.queue_time_us":240838,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":127,"spinlock_wait_cycles":337292672,"thread_start_us":1156383,"threads_started":1,"wal-append.queue_time_us":1748870}
I20260709 12:19:28.366226 13284 rpcz_store.cc:276] 0709 12:19:26.513395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.211447 (+1698052us) service_pool.cc:224] Handling call
0709 12:19:28.211755 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:28.275317 (+ 63562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.275626 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:28.225239 15186 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:28.335144 15242 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.295876 15053 rpcz_store.cc:276] 0709 12:19:20.936157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.944785 (+  8628us) service_pool.cc:224] Handling call
0709 12:19:21.173340 (+228555us) ts_tablet_manager.cc:934] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
0709 12:19:25.703873 (+4530533us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:27.472147 (+1768274us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:27.496002 (+ 23855us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:27.943056 (+447054us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:28.014727 (+ 71671us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:28.060566 (+ 45839us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:28.060666 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":30342,"tablet-copy.queue_time_us":172121,"thread_start_us":140314,"threads_started":2}
I20260709 12:19:28.328078 14987 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:28.331928 15106 consensus_queue.cc:1059] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:19:28.341689 15075 raft_consensus.cc:740] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:28.371912 14998 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.309968 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:27.879293 15179 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:28.382544 13206 rpcz_store.cc:276] 0709 12:19:23.787315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.555927 (+1768612us) service_pool.cc:224] Handling call
0709 12:19:25.571327 (+ 15400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.546081 (+974754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.546118 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.564276 (+ 18158us) log.cc:844] Serialized 26 byte log entry
0709 12:19:27.597134 (+1032858us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:27.597191 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.597287 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:28.307916 (+710629us) raft_consensus.cc:1685] finished
0709 12:19:28.307936 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.308069 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4264,"raft.queue_time_us":248251,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":43248,"thread_start_us":1850399,"threads_started":2,"wal-append.queue_time_us":962955}
I20260709 12:19:28.443564 13280 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:28.385192 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:28.385499 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:28.367667 15135 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.455588 14998 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.456418 14991 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.457132 15135 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:28.387293 14967 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:28.313218 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.394567 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.460541 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.395107 13281 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:28.460855 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1613) took 1913 ms. Trace:
I20260709 12:19:28.403848 15238 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:19:28.396507 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.464097 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.425128 15234 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:28.341470 13133 rpcz_store.cc:276] 0709 12:19:25.556767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.167918 (+611151us) service_pool.cc:224] Handling call
0709 12:19:26.168277 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.554988 (+386711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.002494 (+1447506us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400062054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:28.014355 (+ 11861us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532442496}
I20260709 12:19:28.468451 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.468699 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.402930 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:28.468878 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.469668 13204 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:28.400683 13887 rpcz_store.cc:276] 0709 12:19:25.691819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.710235 (+ 18416us) service_pool.cc:224] Handling call
0709 12:19:25.710641 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.506385 (+795744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.506413 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.539336 (+ 32923us) log.cc:844] Serialized 26 byte log entry
0709 12:19:27.572326 (+1032990us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:27.572383 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.572472 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:28.331672 (+759200us) raft_consensus.cc:1685] finished
0709 12:19:28.331690 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.331832 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10110,"raft.queue_time_us":380328,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":1705555,"threads_started":2,"wal-append.queue_time_us":1024274}
I20260709 12:19:28.405611 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.398007 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.406236 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:28.473040 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 279) took 1631 ms. Trace:
I20260709 12:19:28.387560 15226 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.372439 15118 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.412174 15225 consensus_queue.cc:237] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:28.419909 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:28.402583 15247 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:19:28.390061 15228 raft_consensus.cc:697] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:28.485637 15075 consensus_queue.cc:260] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:28.486192 15228 consensus_queue.cc:237] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:28.487177 15075 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:28.403689 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:28.382262 15190 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.504982 15190 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:28.410971 13205 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:28.510460 15242 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:28.427021 15229 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:28.448446 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.447926 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 224470us
I20260709 12:19:28.447889 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 277) took 1769 ms. Trace:
I20260709 12:19:28.518265 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:28.518211 13280 rpcz_store.cc:276] 0709 12:19:26.678356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.444291 (+1765935us) service_pool.cc:224] Handling call
0709 12:19:28.447366 (+  3075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:28.447575 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.447601 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:28.447640 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:28.447679 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.447734 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.447837 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:28.451624 13882 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
I20260709 12:19:28.451869 15019 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:28.399912 15243 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:28.453429 13880 raft_consensus.cc:2393] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:28.461825 13281 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:28.533285 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 278) took 1796 ms. Trace:
I20260709 12:19:28.533619 13281 rpcz_store.cc:276] 0709 12:19:26.736732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.461417 (+1724685us) service_pool.cc:224] Handling call
0709 12:19:28.461663 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:28.533052 (+ 71389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.533235 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:28.391839 13277 rpcz_store.cc:276] 0709 12:19:25.440515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.249819 (+1809304us) service_pool.cc:224] Handling call
0709 12:19:27.250102 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.250305 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:27.607857 (+357552us) log.cc:844] Serialized 14 byte log entry
0709 12:19:27.773384 (+165527us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:27.773465 (+    81us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:27.773544 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.773645 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.773807 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21705,"prepare.queue_time_us":580947,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":5678,"raft.queue_time_us":433896,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":14946,"thread_start_us":522149,"threads_started":3,"wal-append.queue_time_us":440757}
I20260709 12:19:28.461349 13284 rpcz_store.cc:276] 0709 12:19:26.547734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.429365 (+1881631us) service_pool.cc:224] Handling call
0709 12:19:28.460217 (+ 30852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:28.460447 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.460479 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:28.460535 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:28.460591 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.460672 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.460790 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:28.398613 15260 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:19:28.467197 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.508634 14995 ts_tablet_manager.cc:933] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:28.406216 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:28.439983 15223 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:28.465777 15053 tablet_copy_client.cc:806] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:28.499668 13878 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:28.519168 13134 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:28.469317 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:28.452621 15205 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:28.444021 15186 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:28.531400 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:28.536010 13207 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:28.473435 13279 rpcz_store.cc:276] 0709 12:19:26.841882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.472123 (+1630241us) service_pool.cc:224] Handling call
0709 12:19:28.472388 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:28.472704 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.472730 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:28.472790 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:28.472828 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.472890 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.472990 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92}
I20260709 12:19:28.553542 13281 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:29.213001 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1058) took 1582 ms. Trace:
W20260709 12:19:28.556782 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 339671us
I20260709 12:19:29.133776 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:29.133185 15075 consensus_meta.cc:287] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.645s	user 0.016s	sys 0.000s
I20260709 12:19:29.257915 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:29.259090 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:28.740231 15241 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:29.004302 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 478641us
W20260709 12:19:29.061872 13102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.041s	sys 0.114s
W20260709 12:19:29.260511 13102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.041s	sys 0.119s
I20260709 12:19:29.260011 15241 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:28.901818 15224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.012s	sys 0.030s
W20260709 12:19:29.004200 13282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.005s	sys 0.011s
W20260709 12:19:29.262419 13282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.008s	sys 0.020s
I20260709 12:19:29.263368 15227 raft_consensus.cc:3055] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:28.535362 14998 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:28.688913 15263 raft_consensus.cc:3055] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:29.265527 15263 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:29.062067 15206 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.012s	sys 0.009s
W20260709 12:19:29.267038 15206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.016s	sys 0.009s
I20260709 12:19:29.268106 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1622) took 1043 ms. Trace:
I20260709 12:19:29.268693 13249 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:28.763072 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.256023 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 46782us
I20260709 12:19:29.269950 13207 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:19:29.271585 13132 rpcz_store.cc:276] 0709 12:19:27.630354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.731883 (+101529us) service_pool.cc:224] Handling call
0709 12:19:28.168734 (+436851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:28.464795 (+296061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.464822 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:28.464867 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:28.464904 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.212673 (+747769us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400137ed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:29.212738 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.212919 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680377600}
I20260709 12:19:29.264133 15227 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:29.263496 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2397) took 2755 ms. Trace:
I20260709 12:19:29.275106 13282 rpcz_store.cc:276] 0709 12:19:26.507789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.720708 (+1212919us) service_pool.cc:224] Handling call
0709 12:19:28.418632 (+697924us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5800183f98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e66fc0 00007f70f9e51929 00007f70f9e513d2 00007f70f33c8bd4
0709 12:19:28.418868 (+   236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:28.419167 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.419204 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:28.419817 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 12:19:29.262874 (+843057us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:29.262937 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.263046 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.263109 (+    63us) raft_consensus.cc:1685] finished
0709 12:19:29.263127 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.263399 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31339392,"thread_start_us":842576,"threads_started":1,"wal-append.queue_time_us":837342}
I20260709 12:19:29.260018 13135 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:28.567739 13129 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:19:29.282286 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 1.09208e+06us
I20260709 12:19:29.268497 13281 rpcz_store.cc:276] 0709 12:19:28.224838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.534352 (+309514us) service_pool.cc:224] Handling call
0709 12:19:28.534610 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:29.267800 (+733190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.268041 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:28.888935 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.038162 13838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.045s	user 0.002s	sys 0.014s
W20260709 12:19:29.293515 13838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.002s	sys 0.014s
W20260709 12:19:29.294014 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 1.36612e+06us
W20260709 12:19:29.037911 13884 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.012s	sys 0.004s
W20260709 12:19:29.295610 13884 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.013s	sys 0.004s
I20260709 12:19:28.528451 15019 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:29.266736 15263 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:29.224095 15198 consensus_meta.cc:287] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.842s	user 0.011s	sys 0.000s
W20260709 12:19:29.253787 15182 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.004s	sys 0.022s
I20260709 12:19:29.254421 15244 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:29.256793 15179 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:29.261897 15224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.017s	sys 0.030s
I20260709 12:19:29.322824 13211 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:29.208361 14926 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:28.692133 15118 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:29.318907 15019 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:28.558974 15243 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:29.318598 15053 tablet_copy_client.cc:670] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
W20260709 12:19:29.342731 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 74118us
W20260709 12:19:29.354893 13249 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.570s (SENT) [suppressed 16 similar messages]
I20260709 12:19:29.317662 14967 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.317813 14983 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:29.332015 15182 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.005s	sys 0.022s
I20260709 12:19:29.348642 15118 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:29.068501 15122 consensus_queue.cc:1059] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.267s
I20260709 12:19:29.318697 13278 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:29.321897 14987 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:29.333774 15263 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:29.381086 15157 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:28.536039 15239 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:29.345440 14926 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:29.383708 15155 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:29.388206 15005 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:29.442955 14926 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:29.375999 15033 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:19:29.392760 14973 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:29.378012 14967 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:29.458119 15194 raft_consensus.cc:3055] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:29.381924 14983 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:29.401793 15157 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:29.403785 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 1624) took 1163 ms. Trace:
I20260709 12:19:29.422533 15226 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:29.387414 15118 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:29.467589 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.380896 15227 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:29.423835 15087 consensus_meta.cc:287] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 1.089s	user 0.012s	sys 0.000s
I20260709 12:19:29.476040 15239 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:29.467733 15194 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:29.464087 15264 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:29.479785 15157 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:29.489408 15228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.022s	sys 0.070s
W20260709 12:19:29.477366 13131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1052) took 2209 ms (client timeout 2154 ms). Trace:
W20260709 12:19:29.561722 15228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.022s	sys 0.075s
I20260709 12:19:29.453737 15155 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:29.463819 15005 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:29.465708 15244 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:19:29.475459 14973 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:29.490962 15271 raft_consensus.cc:3055] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:19:29.566165 13131 rpcz_store.cc:269] 0709 12:19:27.252863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.252988 (+   125us) service_pool.cc:224] Handling call
0709 12:19:29.417965 (+2164977us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b540010d6d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:29.462400 (+ 44435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622258560}
I20260709 12:19:29.572477 15155 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:29.576237 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 293421us
I20260709 12:19:29.576743 15264 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:29.612880 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:29.614316 15264 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:29.580523 15226 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:29.593891 15186 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:29.591952 14973 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:29.593822 15140 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:29.615262 15226 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:29.590052 15019 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:29.617549 13209 raft_consensus.cc:2393] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:29.582697 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 281) took 1886 ms. Trace:
I20260709 12:19:29.618112 13280 rpcz_store.cc:276] 0709 12:19:27.695894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.554001 (+858107us) service_pool.cc:224] Handling call
0709 12:19:28.554428 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:28.560955 (+  6527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.561000 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:28.629781 (+ 68781us) log.cc:844] Serialized 26 byte log entry
0709 12:19:29.269309 (+639528us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:29.269345 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.269409 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.582403 (+312994us) raft_consensus.cc:1685] finished
0709 12:19:29.582422 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.582625 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":588576,"raft.queue_time_us":70449,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":104589,"thread_start_us":440544,"threads_started":1,"wal-append.queue_time_us":819786}
W20260709 12:19:29.583048 15273 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:19:29.585937 14978 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:29.626996 13211 raft_consensus.cc:2410] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:29.483243 13278 rpcz_store.cc:276] 0709 12:19:28.235788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.415705 (+179917us) service_pool.cc:224] Handling call
0709 12:19:29.399448 (+983743us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:29.621743 13103 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:29.622195 13177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.370s	user 0.046s	sys 0.111s
W20260709 12:19:29.589112 15252 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.901s	user 0.012s	sys 0.000s
W20260709 12:19:29.655511 13177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.420s	user 0.047s	sys 0.111s
I20260709 12:19:29.659394 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:29.620076 15237 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.023s	sys 0.033s
W20260709 12:19:29.626741 13205 consensus_meta.cc:287] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 1.117s	user 0.011s	sys 0.010s
I20260709 12:19:29.661722 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:29.618314 15019 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:29.633059 15106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.020s	sys 0.088s
I20260709 12:19:29.661176 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:29.687183 13281 raft_consensus.cc:2410] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:29.678195 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:29.661377 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:29.679543 13840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.126s	user 0.023s	sys 0.040s
W20260709 12:19:29.680238 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.593284 15271 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:29.628084 15227 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:29.553243 15087 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:29.684742 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:29.694990 13285 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:19:29.679181 15237 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.023s	sys 0.033s
I20260709 12:19:29.689421 13177 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:29.694147 13840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.023s	sys 0.041s
W20260709 12:19:29.696696 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 1.14295e+06us
W20260709 12:19:29.686302 15106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.214s	user 0.020s	sys 0.088s
I20260709 12:19:29.631974 15265 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:29.682688 15205 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:19:29.698869 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.462535 15190 consensus_queue.cc:1175] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "af3f42f0797349058724e0cb2e637d24" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:29.685580 13205 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:29.709103 13207 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:29.685643 14967 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:29.711252 13208 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
W20260709 12:19:29.712154 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 357270us
I20260709 12:19:29.713084 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:29.711221 13210 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
W20260709 12:19:29.701078 14995 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.033s	sys 0.030s
I20260709 12:19:29.700527 13177 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:29.689292 15266 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:29.728061 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:29.656417 14978 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:29.718786 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:29.711944 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:29.723033 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.699582 15019 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:29.634447 15194 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:29.731072 15186 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:29.740000 15194 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:29.740285 15186 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:29.742385 15186 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:29.742764 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:29.705327 15205 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:29.743643 15205 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:29.730918 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:29.731769 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:29.747785 15118 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:29.711488 14987 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:29.730650 15155 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:29.759196 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:29.759855 13210 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
W20260709 12:19:29.736858 15229 consensus_meta.cc:287] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.225s	user 0.007s	sys 0.003s
I20260709 12:19:29.736989 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:29.737560 15265 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:29.737658 14983 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:29.722019 14967 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:29.735854 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:29.722728 14995 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.034s	sys 0.030s
I20260709 12:19:29.756219 13840 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:29.719615 13205 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2385) took 1418 ms (client timeout 1533 ms). Trace:
I20260709 12:19:29.747210 13878 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:29.728117 15225 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:29.715979 15238 consensus_queue.cc:1059] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:19:29.773904 14973 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:29.807849 14973 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.808302 14973 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:29.809690 15221 consensus_meta.cc:287] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 1.394s	user 0.010s	sys 0.009s
I20260709 12:19:29.810144 15221 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:29.804335 14995 tablet_copy_client.cc:323] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:19:29.779915 14983 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:29.812824 15241 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:29.811288 13881 raft_consensus.cc:2368] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
W20260709 12:19:29.813925 15219 consensus_meta.cc:287] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.620s	user 0.010s	sys 0.010s
I20260709 12:19:29.814117 15005 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:29.814357 15219 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:29.815026 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:29.781373 15197 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:29.817478 15157 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:29.818614 14973 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:29.761763 15186 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:29.819820 15186 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:29.797762 13838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.017s	sys 0.009s
W20260709 12:19:29.822126 13838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.018s	sys 0.009s
W20260709 12:19:29.823920 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 528857us
I20260709 12:19:29.756721 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:29.760150 15260 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:29.786605 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.827477 13102 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:29.824855 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 87935.2us
I20260709 12:19:29.833463 13203 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:29.844624 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:29.835155 15221 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:29.758327 14987 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:29.771122 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:29.875149 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:29.863932 13277 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:19:29.879308 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54676.2us
I20260709 12:19:29.867211 13102 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:29.773017 14967 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.876303 13282 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:29.883175 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:29.894918 13130 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:29.756935 15019 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:29.821619 13878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 705) took 1400 ms (client timeout 1773 ms). Trace:
I20260709 12:19:29.756606 15266 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:29.882287 13102 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:29.871209 15219 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:29.874877 14987 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:29.908623 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.774044 13205 rpcz_store.cc:269] 0709 12:19:28.301829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.302615 (+   786us) service_pool.cc:224] Handling call
0709 12:19:29.714701 (+1412086us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:29.899780 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:29.904989 13221 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet f042aff5e3084d5e8bd6fcb5335160f5 from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:19:29.773599 15229 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:29.824131 15225 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:29.892446 15077 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:29.924256 13129 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:29.916581 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:29.925786 13102 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:29.874188 15033 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:29.901551 14967 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:29.930279 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:29.930130 13838 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:29.869560 15260 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:29.944348 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:29.901077 13882 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:29.826656 15155 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:29.953835 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:29.967131 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 209533us
I20260709 12:19:29.922909 15140 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:29.928925 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:29.945314 15236 consensus_meta.cc:287] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.497s	user 0.022s	sys 0.006s
I20260709 12:19:29.972206 13177 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:29.923622 13880 raft_consensus.cc:2410] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:19:29.925513 15228 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:29.899546 15241 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:19:30.009944 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 84269.4us
I20260709 12:19:29.915462 15261 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:30.012773 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 82709.1us
I20260709 12:19:30.013267 13130 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
W20260709 12:19:29.941300 14991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.001s	sys 0.010s
I20260709 12:19:30.013401 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:30.014091 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 88658.4us
I20260709 12:19:29.916625 15219 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.924146 15157 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:29.909873 13878 rpcz_store.cc:269] 0709 12:19:28.381544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.382506 (+   962us) service_pool.cc:224] Handling call
0709 12:19:29.781592 (+1399086us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:30.021503 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 49408.6us
I20260709 12:19:30.127453 13132 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:30.016980 15277 consensus_queue.cc:1059] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:19:30.132546 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2395) took 1745 ms. Trace:
I20260709 12:19:30.091476 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:30.071108 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.034876 15118 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:30.037091 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:30.126005 13033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51922 (request call id 205) took 7086 ms. Trace:
W20260709 12:19:30.128495 13209 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2400) took 1677 ms (client timeout 1660 ms). Trace:
I20260709 12:19:30.135370 13838 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:30.135905 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1566) took 1600 ms. Trace:
I20260709 12:19:30.129122 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:29.967069 15281 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:19:30.139827 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:30.137679 13208 rpcz_store.cc:276] 0709 12:19:28.386662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.406888 (+ 20226us) service_pool.cc:224] Handling call
0709 12:19:28.407223 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:29.711907 (+1304684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.132299 (+420392us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002a30d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:30.132486 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2998544640}
I20260709 12:19:30.138054 13206 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:30.142298 13132 rpcz_store.cc:276] 0709 12:19:28.535987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.126950 (+1590963us) service_pool.cc:224] Handling call
0709 12:19:30.127264 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.135649 (+  8385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.135846 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:30.018101 14978 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:30.141538 13209 rpcz_store.cc:269] 0709 12:19:28.450566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.460315 (+  9749us) service_pool.cc:224] Handling call
0709 12:19:30.128212 (+1667897us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002d4954. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:30.128405 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2659002752}
I20260709 12:19:30.035076 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 370) took 2133 ms. Trace:
I20260709 12:19:30.137785 13129 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:30.015259 15269 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:30.021754 15257 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.025755 15198 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:30.139967 13278 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:19:30.035032 15280 log.cc:927] Time spent T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 12:19:30.020623 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 300813us
I20260709 12:19:30.140892 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:30.018376 15033 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:30.074903 15264 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:30.036818 15087 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:30.155521 13132 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:30.141778 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:30.188499 13103 connection.cc:256] RPC call timeout handler was delayed by -1.5591914149999866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 12:19:30.010779 15286 consensus_queue.cc:1059] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.175s
I20260709 12:19:30.141098 15118 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.118297 15186 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.118741 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:30.232517 13175 connection.cc:256] RPC call timeout handler was delayed by -2.3458888110001226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
I20260709 12:19:30.175745 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:30.013605 13221 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet f042aff5e3084d5e8bd6fcb5335160f5 from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-f042aff5e3084d5e8bd6fcb5335160f5
I20260709 12:19:30.012524 15179 consensus_queue.cc:1059] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.138s
I20260709 12:19:30.136770 15219 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:30.179585 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:30.299787 13129 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:30.014959 15031 consensus_queue.cc:1059] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
W20260709 12:19:30.073390 14991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.004s	sys 0.017s
I20260709 12:19:30.141364 13033 rpcz_store.cc:276] 0709 12:19:23.039810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.039996 (+   186us) service_pool.cc:224] Handling call
0709 12:19:30.125874 (+7085878us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:23.553801 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:23.554478 (+   677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:23.554523 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:19:23.554542 (+    19us) tablet.cc:662] Decoding operations
0709 12:19:23.555396 (+   854us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:23.555480 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:23.555509 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:19:23.745813 (+190304us) tablet.cc:701] Row locks acquired
0709 12:19:23.748023 (+  2210us) write_op.cc:260] PREPARE: finished
0709 12:19:23.766861 (+ 18838us) write_op.cc:270] Start()
0709 12:19:23.776035 (+  9174us) write_op.cc:276] Timestamp: P: 1783599563766788 usec, L: 0
0709 12:19:23.777058 (+  1023us) op_driver.cc:348] REPLICATION: starting
0709 12:19:23.834400 (+ 57342us) log.cc:844] Serialized 2814 byte log entry
0709 12:19:26.111875 (+2277475us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:27.140830 (+1028955us) op_driver.cc:464] REPLICATION: finished
0709 12:19:27.830566 (+689736us) write_op.cc:301] APPLY: starting
0709 12:19:27.840453 (+  9887us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:27.888655 (+ 48202us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:27.891504 (+  2849us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:27.973324 (+ 81820us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:28.188207 (+214883us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:19:28.193435 (+  5228us) write_op.cc:312] APPLY: finished
0709 12:19:28.269425 (+ 75990us) log.cc:844] Serialized 59 byte log entry
0709 12:19:29.333326 (+1063901us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:29.342281 (+  8955us) write_op.cc:454] Released schema lock
0709 12:19:29.342344 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:29.385606 (+ 43262us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:29.390202 (+  4596us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":134006,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":555860,"apply.run_cpu_time_us":63423,"apply.run_wall_time_us":1634386,"num_ops":7,"prepare.queue_time_us":119449,"prepare.run_cpu_time_us":30742,"prepare.run_wall_time_us":604596,"raft.queue_time_us":1004900,"raft.run_cpu_time_us":24633,"raft.run_wall_time_us":478812,"replication_time_us":3363542,"spinlock_wait_cycles":7375104,"thread_start_us":2246139,"threads_started":5,"wal-append.queue_time_us":1620125,"wal-append.run_cpu_time_us":66900,"wal-append.run_wall_time_us":3363881}]]}
W20260709 12:19:30.148608 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 111624us
I20260709 12:19:30.304054 13102 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:30.183697 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:30.164377 13130 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
W20260709 12:19:30.178364 13100 connection.cc:256] RPC call timeout handler was delayed by -1.1344844390000617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
W20260709 12:19:30.307113 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.158114 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:30.191771 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:30.308511 13135 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:30.192378 13103 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:30.193145 13132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ef464caba794ab4955c661c56df278f"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:30.309517 13132 raft_consensus.cc:606] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:19:30.146814 13208 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:30.150067 14919 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:30.028167 15236 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.092900 15303 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:19:30.236560 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 76888.3us
I20260709 12:19:30.159111 15269 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.035365 15228 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.071480 15106 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:30.239764 13175 connection.cc:256] RPC call timeout handler was delayed by -1.8400888110002143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25s for a response
I20260709 12:19:30.172000 15157 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:30.237967 15118 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:30.242461 15285 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:19:30.242879 15274 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 12:19:30.243188 15301 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.244832 15226 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:30.248101 15239 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.707s	user 0.005s	sys 0.005s
I20260709 12:19:30.425515 15186 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.426146 15186 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:30.190038 15237 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:30.427815 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1560) took 1911 ms. Trace:
I20260709 12:19:30.427956 15301 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.251911 15019 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:30.180632 15033 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:30.429559 15033 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:30.430457 15301 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.254653 13285 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:19:30.254683 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:30.233799 15234 consensus_meta.cc:287] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 1.757s	user 0.013s	sys 0.000s
I20260709 12:19:30.231972 14973 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.433774 13206 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
W20260709 12:19:30.256891 15283 log.cc:927] Time spent T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 12:19:30.260948 15155 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:30.091332 15261 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.232483 15264 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:30.264226 15291 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:19:30.180943 15257 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:30.231580 15227 consensus_meta.cc:287] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.004s
I20260709 12:19:30.272221 15229 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.274148 15225 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:30.276371 15263 consensus_meta.cc:287] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.877s	user 0.009s	sys 0.000s
I20260709 12:19:30.277230 15266 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.251011 14987 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:30.282915 15260 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:30.284394 15289 log.cc:927] Time spent T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
W20260709 12:19:30.288468 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 112835us
W20260709 12:19:30.268368 15205 consensus_meta.cc:287] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.003s
W20260709 12:19:30.280704 15194 consensus_meta.cc:287] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.000s
I20260709 12:19:30.303762 15244 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:30.334865 14998 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:30.382635 13284 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:30.384377 15157 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.385236 14919 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:30.418202 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:30.555857 13281 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:30.418678 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:30.418969 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:30.433807 15234 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.442727 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:30.559948 13277 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:30.452443 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:30.352087 15288 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:19:30.529667 13887 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:30.380481 15106 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.371847 15269 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.573020 15106 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:30.573973 15309 log.cc:927] Time spent T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:19:30.557051 13280 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.575737 15122 raft_consensus.cc:3055] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:30.576261 15122 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:30.558189 13840 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:30.557049 13283 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:30.577601 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:30.577270 15122 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.578208 13283 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:30.578799 15122 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:30.563330 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:30.579705 13281 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:30.531883 15311 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:30.580572 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:30.580425 15311 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:30.581110 13281 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.582508 15005 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:30.563505 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:30.565621 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 280) took 3133 ms. Trace:
I20260709 12:19:30.583591 13286 rpcz_store.cc:276] 0709 12:19:27.432214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.496196 (+1063982us) service_pool.cc:224] Handling call
0709 12:19:28.496557 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:28.507683 (+ 11126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.507723 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:28.526486 (+ 18763us) log.cc:844] Serialized 26 byte log entry
0709 12:19:29.700213 (+1173727us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:29.700276 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.700373 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:30.565414 (+865041us) raft_consensus.cc:1685] finished
0709 12:19:30.565441 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.565565 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15499,"raft.queue_time_us":26701,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":10138,"thread_start_us":403889,"threads_started":1,"wal-append.queue_time_us":1361232}
I20260709 12:19:30.568156 14919 raft_consensus.cc:697] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:30.601328 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:30.579211 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:30.376035 15303 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:30.584857 13881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 535) took 2792 ms (client timeout 2072 ms). Trace:
I20260709 12:19:30.600208 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:30.601332 14919 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.604454 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:30.610184 13286 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:30.611240 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:30.611900 13286 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.603025 13283 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:19:30.604310 15244 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:30.614686 13283 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:30.615625 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:30.617949 13277 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:19:30.583098 15005 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:30.606128 15228 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.553253 15205 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.617544 15244 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.608803 15261 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.617049 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 710) took 2212 ms. Trace:
I20260709 12:19:30.675191 13884 rpcz_store.cc:276] 0709 12:19:28.404248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.404408 (+   160us) service_pool.cc:224] Handling call
0709 12:19:28.404810 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:29.296174 (+891364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:29.296219 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:29.320484 (+ 24265us) log.cc:844] Serialized 26 byte log entry
0709 12:19:29.884800 (+564316us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:29.884848 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.884935 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:30.616827 (+731892us) raft_consensus.cc:1685] finished
0709 12:19:30.616853 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.616984 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16073,"raft.queue_time_us":66950,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":1181043,"threads_started":2,"wal-append.queue_time_us":625281}
I20260709 12:19:30.616762 15033 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:30.678423 15244 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.692260 15005 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:30.692631 15157 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.697136 15264 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.712646 15205 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.713058 15303 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.616792 15314 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:30.718641 15314 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:30.719142 15314 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:30.715631 15311 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:30.716531 15257 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:30.717497 15234 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:30.730563 15314 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.733404 15314 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:30.737114 15269 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.330096 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:30.156920 13128 rpcz_store.cc:276] 0709 12:19:27.901776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.272192 (+370416us) service_pool.cc:224] Handling call
0709 12:19:29.422097 (+1149905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:29.434247 (+ 12150us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:29.434296 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:29.434374 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:29.434423 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.440929 (+  6506us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.034860 (+593931us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540010d6d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:30.035013 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10731,"raft.queue_time_us":11954,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10297,"spinlock_wait_cycles":2635047808}
W20260709 12:19:30.780138 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 587590us
I20260709 12:19:30.782547 13103 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:30.786363 13131 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:30.787938 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 457745us
I20260709 12:19:30.428236 13133 rpcz_store.cc:276] 0709 12:19:28.516286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.526013 (+  9727us) service_pool.cc:224] Handling call
0709 12:19:28.760893 (+234880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:29.258031 (+497138us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:19:29.258062 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:29.258161 (+    99us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:29.258205 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.427570 (+1169365us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b540027e554. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:30.427618 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.427751 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7023,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":1098888064}
I20260709 12:19:30.370064 13136 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 1. Current term is 2. Ops: []
W20260709 12:19:30.792083 13137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.007s
W20260709 12:19:30.792527 13137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.006s	sys 0.007s
W20260709 12:19:30.329876 13210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.020s	sys 0.035s
W20260709 12:19:30.808432 13210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.020s	sys 0.036s
W20260709 12:19:30.414067 13211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2383) took 2158 ms (client timeout 2111 ms). Trace:
I20260709 12:19:30.414175 13204 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:30.283505 13205 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:30.810526 13211 rpcz_store.cc:269] 0709 12:19:28.255977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.257703 (+  1726us) service_pool.cc:224] Handling call
0709 12:19:30.413783 (+2156080us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54002f17d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:30.413977 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2255607040}
I20260709 12:19:30.812842 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:30.813562 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.814110 13211 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
W20260709 12:19:30.281498 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.328269 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:30.815701 13212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.007s	sys 0.004s
W20260709 12:19:30.816311 13212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.007s	sys 0.004s
I20260709 12:19:30.816488 13208 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
W20260709 12:19:30.816851 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.444857 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:30.818094 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.818768 13206 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:30.818940 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:30.820160 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:30.638054 13280 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:30.618579 13838 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:19:30.833935 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 215203us
W20260709 12:19:30.338708 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.836530 15198 raft_consensus.cc:3055] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:30.837253 15198 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:30.609889 13881 rpcz_store.cc:269] 0709 12:19:27.792123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.792342 (+   219us) service_pool.cc:224] Handling call
0709 12:19:30.584581 (+2792239us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b540015f4d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:30.584731 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3775646592}
I20260709 12:19:30.667793 14987 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:30.840442 15075 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.841195 15269 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:30.841379 15075 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:30.842367 15269 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:30.842612 14978 raft_consensus.cc:3055] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:30.843096 14978 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:30.845086 14978 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.845664 15205 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:30.846715 14978 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:30.734706 15219 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.823977 14919 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:30.824854 13206 raft_consensus.cc:2368] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
W20260709 12:19:30.820205 13203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2394) took 2433 ms (client timeout 2222 ms). Trace:
I20260709 12:19:30.860421 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2413) took 1037 ms. Trace:
I20260709 12:19:30.743093 15244 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.876076 15288 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:30.878731 15244 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:30.878913 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:30.879958 13280 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.881253 15323 raft_consensus.cc:3055] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:30.881829 15323 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:30.879859 15227 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.884137 15265 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:30.884392 15227 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.885149 15265 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:30.885711 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:30.889760 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:30.875463 13285 rpcz_store.cc:276] 0709 12:19:29.822858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.823945 (+  1087us) service_pool.cc:224] Handling call
0709 12:19:30.254392 (+430447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:30.433211 (+178819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.859928 (+426717us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54000974d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:30.860196 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872616192}
I20260709 12:19:30.890672 13279 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:30.890121 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 717) took 1160 ms. Trace:
I20260709 12:19:30.848773 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:30.871598 15198 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:30.871850 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 283) took 2411 ms. Trace:
I20260709 12:19:31.021085 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:31.054973 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 103258us
I20260709 12:19:30.887367 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:30.974094 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 349) took 1204 ms. Trace:
W20260709 12:19:31.062244 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 261472us
I20260709 12:19:31.062438 13280 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:30.871762 15326 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:30.858621 14967 consensus_meta.cc:287] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.891s	user 0.011s	sys 0.000s
I20260709 12:19:30.849223 13221 tablet_copy_source_session.cc:215] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:31.055660 13887 rpcz_store.cc:276] 0709 12:19:29.729875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.730022 (+   147us) service_pool.cc:224] Handling call
0709 12:19:29.814853 (+ 84831us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:30.889587 (+1074734us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b540036a6d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:30.889814 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687944832}
I20260709 12:19:30.891108 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:31.056202 13284 rpcz_store.cc:276] 0709 12:19:28.459894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.535211 (+ 75317us) service_pool.cc:224] Handling call
0709 12:19:28.535523 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.554965 (+2019442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.821054 (+266089us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54002dafd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:30.871606 (+ 50552us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4247313664}
I20260709 12:19:30.853061 15284 raft_consensus.cc:3055] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:19:30.873111 13203 rpcz_store.cc:269] 0709 12:19:28.386428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.405322 (+ 18894us) service_pool.cc:224] Handling call
0709 12:19:30.819820 (+2414498us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540032cdd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:30.819967 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3133652864}
I20260709 12:19:30.959697 15227 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:30.966831 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:31.060104 15265 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:30.884435 15033 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:30.847329 15205 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.224s
I20260709 12:19:30.853672 15118 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.091485 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:31.093288 15118 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:31.055168 15303 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:31.088506 13177 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.078194 15284 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:30.883273 15323 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:31.116827 13209 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.005s	sys 0.033s
I20260709 12:19:31.116691 15275 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:31.119359 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.096544 15075 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:31.111572 13278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.005s	sys 0.009s
W20260709 12:19:31.126349 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 69061.4us
W20260709 12:19:31.126668 13278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.006s	sys 0.009s
I20260709 12:19:31.126890 15227 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:31.127595 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.127959 13205 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:31.124943 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:31.130882 13209 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.006s	sys 0.033s
I20260709 12:19:31.059954 13210 rpcz_store.cc:276] 0709 12:19:29.761048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.761187 (+   139us) service_pool.cc:224] Handling call
0709 12:19:29.766609 (+  5422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:29.820952 (+ 54343us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:29.821245 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 12:19:30.809414 (+988169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:30.809511 (+    97us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:30.809627 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.830814 (+ 21187us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b540002dad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:30.830876 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.965661 (+134785us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32766,"prepare.queue_time_us":2744,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":5294,"raft.queue_time_us":19871,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":289,"spinlock_wait_cycles":124473088,"thread_start_us":987456,"threads_started":1,"wal-append.queue_time_us":604148}
I20260709 12:19:31.122705 15303 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.112998 15265 raft_consensus.cc:3055] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:31.144186 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.164491 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.116736 15219 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:31.150719 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 50370.3us
I20260709 12:19:31.165904 13208 raft_consensus.cc:2410] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:31.166014 13279 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:31.144186 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:31.136601 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 272692us
W20260709 12:19:31.128762 13205 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36412 (request call id 357) took 1222 ms (client timeout 1533 ms). Trace:
I20260709 12:19:31.167536 13280 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:31.169766 13211 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:31.146545 15322 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:31.167711 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 385408us
I20260709 12:19:31.146535 14967 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.171711 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:31.172106 13281 consensus_meta.cc:287] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.590s	user 0.016s	sys 0.002s
I20260709 12:19:31.127992 15227 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:31.144626 14973 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:31.140964 15288 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:31.186995 15264 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:19:31.190613 13286 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.003s
I20260709 12:19:31.182945 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.194622 13285 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:31.164108 15265 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:19:31.198725 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 54756us
I20260709 12:19:31.204444 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 353) took 1325 ms. Trace:
I20260709 12:19:31.205104 13209 rpcz_store.cc:276] 0709 12:19:29.879331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.151089 (+271758us) service_pool.cc:224] Handling call
0709 12:19:30.151521 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:30.180945 (+ 29424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:30.180991 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:30.231681 (+ 50690us) log.cc:844] Serialized 26 byte log entry
0709 12:19:30.438668 (+206987us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:31.179966 (+741298us) log.cc:844] Serialized 14 byte log entry
0709 12:19:31.203862 (+ 23896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.204053 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:31.204127 (+    74us) raft_consensus.cc:1685] finished
0709 12:19:31.204139 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:31.204353 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20397,"prepare.queue_time_us":308265,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":86303,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":14489,"thread_start_us":799004,"threads_started":2,"wal-append.queue_time_us":346705}
I20260709 12:19:31.206713 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:31.208914 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.209271 13207 raft_consensus.cc:2393] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:31.200529 13281 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:31.211134 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.202728 15118 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:31.211743 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36412 (request call id 354) took 1308 ms. Trace:
I20260709 12:19:31.211910 15118 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:31.212006 13211 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:31.212899 15323 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:31.213289 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.214111 13211 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:31.214875 13286 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:31.215030 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.194954 15227 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:31.218422 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.130326 15326 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:31.174685 13205 rpcz_store.cc:269] 0709 12:19:29.906708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.964694 (+ 57986us) service_pool.cc:224] Handling call
0709 12:19:31.128631 (+1163937us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:31.222767 13209 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:31.196046 14973 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:31.212229 13207 rpcz_store.cc:276] 0709 12:19:29.903848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.070926 (+167078us) service_pool.cc:224] Handling call
0709 12:19:31.211456 (+1140530us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400072bd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:31.211680 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2317716352}
I20260709 12:19:31.227443 13177 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.233911 13221 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:36412 (request call id 355) took 1329 ms. Trace:
I20260709 12:19:31.234480 13221 rpcz_store.cc:276] 0709 12:19:29.904440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.904687 (+   247us) service_pool.cc:224] Handling call
0709 12:19:31.233741 (+1329054us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9560}
W20260709 12:19:31.235648 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.234200 15265 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:31.237313 13100 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:31.238587 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.212463 15118 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:31.241027 15265 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:31.242967 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.221200 13208 raft_consensus.cc:2376] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2. Re-sending same reply.
I20260709 12:19:31.249644 15271 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.251749 13212 raft_consensus.cc:2368] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
W20260709 12:19:31.240041 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 55375.2us
I20260709 12:19:31.256366 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.218174 15322 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:31.240444 14973 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:31.259414 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.264020 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.254830 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:31.275615 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 440237us
I20260709 12:19:31.281440 15182 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:31.282084 15182 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:31.282678 15182 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:31.286774 13102 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:31.291379 15271 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:31.292218 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:31.292964 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:31.283818 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 84416.8us
W20260709 12:19:31.296103 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 59018.7us
I20260709 12:19:31.296240 15322 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.298492 13100 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:31.299397 15323 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:31.299549 15219 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:31.300213 15323 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.295043 13841 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:31.311879 13177 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.312932 14978 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:31.313520 14978 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.313987 14978 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:31.289813 15236 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:31.300799 15323 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:31.321764 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.279399 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.327711 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.328444 13206 raft_consensus.cc:2376] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5. Re-sending same reply.
I20260709 12:19:31.329444 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.330657 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.305285 15288 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:31.331952 13285 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:31.305285 14967 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:31.335017 13100 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:31.336308 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 340) took 2823 ms. Trace:
I20260709 12:19:31.335347 15221 raft_consensus.cc:3055] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:31.336535 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:31.337101 15221 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:31.337858 14998 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:31.338160 15205 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:31.338667 15205 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.339016 15205 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:31.336812 13204 rpcz_store.cc:276] 0709 12:19:28.513293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.523961 (+ 10668us) service_pool.cc:224] Handling call
0709 12:19:30.413928 (+1889967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.810826 (+396898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.335934 (+525108us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54002f17d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:31.336102 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4272826752}
I20260709 12:19:31.340390 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.341771 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.338194 15221 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.344812 15221 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:31.345208 13103 leader_election.cc:336] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 2.222s (SENT)
I20260709 12:19:31.345824 15186 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:19:31.346853 13103 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:31.343545 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.348189 15321 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:31.349215 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.350811 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.340318 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.343165 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.352825 13212 raft_consensus.cc:2368] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
W20260709 12:19:31.352265 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:31.354552 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 50097.2us
I20260709 12:19:31.303215 15264 raft_consensus.cc:697] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:31.352121 13840 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:31.351392 13207 raft_consensus.cc:2376] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2. Re-sending same reply.
I20260709 12:19:31.359848 13100 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:31.362982 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.303623 15284 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.367187 15053 tablet_copy_client.cc:538] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:31.367962 15284 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:31.352836 15198 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:31.373534 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.379278 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.380661 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.383495 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.385818 13206 raft_consensus.cc:2368] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:31.387152 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.393844 13207 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:31.393388 15321 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:31.397899 13211 raft_consensus.cc:2393] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:31.402890 15197 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:31.403628 15197 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.407049 15197 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:31.408937 13137 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:19:31.411401 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 55532.7us
I20260709 12:19:31.413128 13100 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:31.419687 13840 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:31.419874 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.420681 13136 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:31.422417 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.423352 13136 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
W20260709 12:19:31.425133 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.440119 13103 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:31.426067 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.384831 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.444195 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.438436 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.446180 15275 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:31.439316 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.446703 15275 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.447225 15275 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:31.447270 13128 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:31.448058 15303 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:31.437505 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.428050 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:31.451222 13135 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:31.454734 15118 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.456043 13212 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:31.458575 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.428958 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.460153 13133 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:31.426795 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.461938 15118 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:31.462337 13137 raft_consensus.cc:2410] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:19:31.463142 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 43600.4us
I20260709 12:19:31.463397 15326 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:31.464406 15238 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:31.464995 15314 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:31.461521 15219 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:31.441308 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 56045.2us
I20260709 12:19:31.425232 13177 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.464442 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:31.474414 13207 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:31.476186 13135 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:31.477226 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.463291 15288 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:31.482059 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 117051us
W20260709 12:19:31.482024 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 69255.7us
I20260709 12:19:31.487848 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.491752 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:31.494676 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 68480.2us
I20260709 12:19:31.499456 13103 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:31.502684 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:31.502720 13177 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.482405 15265 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:31.506721 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.492185 15197 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:31.511071 13203 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:31.494338 15118 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:31.514125 13206 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:31.512143 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.517091 13207 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:31.521986 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:31.499095 15314 raft_consensus.cc:697] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:31.512281 15197 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:31.523231 15197 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:31.523672 15314 consensus_queue.cc:237] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.527763 15118 raft_consensus.cc:697] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:31.528415 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.529076 13205 raft_consensus.cc:2376] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2. Re-sending same reply.
I20260709 12:19:31.529012 15118 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:31.529904 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.530241 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.530851 13205 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:31.531117 14967 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:19:31.532361 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.533231 14986 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:31.533671 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:31.533756 14986 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:31.534369 13280 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:31.535181 13281 raft_consensus.cc:1240] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:31.536551 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:31.537130 13281 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:31.541482 13280 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:31.543907 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:31.545058 13282 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 4: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:19:31.546041 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.541548 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:31.547358 13279 raft_consensus.cc:2393] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 4: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:31.547596 15265 raft_consensus.cc:697] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:31.547453 15197 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.564776 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.569003 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:31.569164 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.570711 13211 raft_consensus.cc:2368] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:31.518034 15326 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:31.573833 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.534377 14986 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:31.581363 13207 raft_consensus.cc:2410] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:31.584692 15197 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:31.588364 13175 leader_election.cc:400] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3.
I20260709 12:19:31.588714 13284 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:31.588755 15077 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:31.589846 13281 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:31.591631 15244 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:19:31.563325 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 47061.4us
I20260709 12:19:31.601516 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.602996 13100 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:31.606945 13206 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:31.609413 13203 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:31.624615 15326 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.625538 13205 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:31.626824 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.626987 15221 raft_consensus.cc:3055] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:31.627379 15221 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:31.628665 15221 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.520229 15264 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.630205 15221 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:31.630638 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:31.603754 14978 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.636687 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:31.637946 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:31.638059 14978 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:31.638525 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:31.638934 15219 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:31.639338 15236 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:31.639353 15219 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:31.605973 15077 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:31.632130 13277 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:31.634229 13280 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:19:31.549067 15265 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.640172 13286 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:31.634883 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:31.639405 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:31.643028 15219 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:31.639889 15303 consensus_queue.cc:1059] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 12:19:31.653563 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 230405us
I20260709 12:19:31.654383 15303 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:31.654893 15303 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:31.654075 14973 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.658418 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.660816 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.662562 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.663539 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.664314 13211 raft_consensus.cc:2376] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5. Re-sending same reply.
I20260709 12:19:31.672241 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.640803 15326 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:31.656270 15322 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:31.673749 13137 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:31.676162 13212 raft_consensus.cc:2393] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:31.677549 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.660215 15343 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.686197 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.645653 15244 raft_consensus.cc:697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:31.660310 15197 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:31.682155 13136 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:31.672989 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.690627 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.690778 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:31.693270 13102 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:31.737071 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 43869us
I20260709 12:19:31.690637 15275 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.697458 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:31.698402 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.699354 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.699815 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.703392 13135 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:31.703860 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.703547 15343 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.706365 15323 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.707422 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:31.708443 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.709378 15182 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.744865 15197 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.718343 15077 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.640156 15340 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:19:31.747020 15205 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.718889 13249 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.688262 13206 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:31.719290 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.681401 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:31.778858 13284 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:31.732375 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.773433 13204 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 2: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:31.740208 13209 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:31.743294 13208 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:31.773584 13207 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:31.739151 13130 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:31.768783 13129 raft_consensus.cc:2393] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:31.769068 15303 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.769600 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.770301 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:31.786304 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:31.786432 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 67659.8us
I20260709 12:19:31.770776 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.772507 13103 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:31.749580 15227 consensus_meta.cc:287] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.001s
I20260709 12:19:31.773924 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.776156 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:31.789965 13206 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:31.774492 15205 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:31.792160 13205 raft_consensus.cc:2393] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:31.794932 13133 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 2: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:31.795992 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.795693 15244 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.796298 15343 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:31.796578 15275 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:31.797241 13137 raft_consensus.cc:2368] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3.
I20260709 12:19:31.798893 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:31.745608 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 268447us
W20260709 12:19:31.769358 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:31.801177 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:31.801637 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.787685 13135 raft_consensus.cc:2393] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:31.802810 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.803359 13135 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:31.690912 15266 consensus_queue.cc:1059] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.222s
I20260709 12:19:31.804153 13284 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:31.809372 13132 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:31.777010 15326 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:31.771713 15197 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:31.784061 15186 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:31.814389 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:31.817193 13249 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:31.823539 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 51110.2us
I20260709 12:19:31.824584 13103 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:31.806986 14967 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:31.829821 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 365459us
I20260709 12:19:31.830602 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.805044 15227 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:31.840237 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 291163us
I20260709 12:19:31.816435 15288 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:31.864234 13177 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.818732 15303 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:31.820679 15340 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:31.867628 13249 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.868929 13135 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:19:31.869987 13136 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:31.789978 13208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:31.867228 15340 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:31.874897 15340 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:31.876258 15227 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:31.879580 14991 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:31.834373 15266 raft_consensus.cc:3055] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:31.880122 14991 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:31.880519 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:31.881067 15053 tablet_bootstrap.cc:492] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:19:31.861879 15197 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:31.887954 15197 raft_consensus.cc:697] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:31.888602 15340 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:31.889135 15197 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.893507 13210 raft_consensus.cc:2393] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:31.880528 15266 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:31.880703 14991 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:31.873843 13208 raft_consensus.cc:606] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:31.900365 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.902269 13206 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:31.905898 13207 raft_consensus.cc:2410] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:31.910799 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.918550 13135 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:31.926834 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.901094 15236 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:31.928941 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.934448 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:31.936491 13206 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:31.936650 13207 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:19:31.939073 13252 leader_election.cc:336] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.529s (SENT)
I20260709 12:19:31.939317 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:31.940158 13136 raft_consensus.cc:2410] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:19:31.940856 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1224) took 1561 ms. Trace:
I20260709 12:19:31.941365 13207 rpcz_store.cc:276] 0709 12:19:30.375754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.910601 (+1534847us) service_pool.cc:224] Handling call
0709 12:19:31.934277 (+ 23676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.937155 (+  2878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.937418 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:31.942345 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2407) took 1702 ms. Trace:
I20260709 12:19:31.943092 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2411) took 1701 ms. Trace:
I20260709 12:19:31.942847 13204 rpcz_store.cc:276] 0709 12:19:30.234628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.812887 (+1578259us) service_pool.cc:224] Handling call
0709 12:19:31.869849 (+ 56962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.931315 (+ 61466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:31.931360 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:31.937000 (+  5640us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:31.937046 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.937105 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:31.937218 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:31.915934 14973 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:31.944319 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:31.921452 15227 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:31.891052 14986 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.946029 13135 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:19:31.955921 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.919765 15238 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:19:31.933050 15236 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:31.951553 14998 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.951834 13252 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:31.952445 13136 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:31.963861 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:31.964114 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.918246 15221 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:31.943928 13206 rpcz_store.cc:276] 0709 12:19:30.236253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.914321 (+1678068us) service_pool.cc:224] Handling call
0709 12:19:31.936270 (+ 21949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.937647 (+  1377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.938031 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:31.873382 15326 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.965767 13206 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:31.968370 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.973166 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.974839 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1248) took 1143 ms. Trace:
I20260709 12:19:31.975733 13206 rpcz_store.cc:276] 0709 12:19:30.824148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.965187 (+1141039us) service_pool.cc:224] Handling call
0709 12:19:31.965555 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.967277 (+  1722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.967484 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:31.956449 15340 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:31.967000 15227 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:31.984339 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 68077us
I20260709 12:19:31.984495 15227 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:31.986115 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:31.988546 15343 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:31.991681 13204 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:31.991937 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:31.992413 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1245) took 1181 ms. Trace:
I20260709 12:19:31.992848 13208 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:31.992777 13204 rpcz_store.cc:276] 0709 12:19:30.810685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.961123 (+1150438us) service_pool.cc:224] Handling call
0709 12:19:31.991469 (+ 30346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.992146 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.992350 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:31.993640 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1230) took 1584 ms. Trace:
I20260709 12:19:31.993551 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:31.994447 13881 raft_consensus.cc:2393] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 4: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:31.994059 13208 rpcz_store.cc:276] 0709 12:19:30.409718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.940017 (+1530299us) service_pool.cc:224] Handling call
0709 12:19:31.992651 (+ 52634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.993385 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.993586 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:31.994915 15238 raft_consensus.cc:3055] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:19:31.995723 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 43988.1us
W20260709 12:19:31.996484 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.994172 13204 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:19:31.999390 13206 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:19:32.023502 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 48264.5us
I20260709 12:19:32.024868 13207 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:32.025838 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1232) took 1615 ms. Trace:
I20260709 12:19:32.026262 13207 rpcz_store.cc:276] 0709 12:19:30.410392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.942403 (+1532011us) service_pool.cc:224] Handling call
0709 12:19:32.024637 (+ 82234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:32.025487 (+   850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.025753 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:31.962879 15236 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:32.048386 13134 raft_consensus.cc:2393] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:32.048708 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:31.995296 15238 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:32.073853 13208 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:32.075048 13206 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:32.076942 13840 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:31.980779 14998 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:19:32.081514 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 95492.3us
I20260709 12:19:32.105273 13841 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:32.078210 15340 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:32.088204 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.108803 13132 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:32.109104 13887 raft_consensus.cc:2410] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:31.966749 14967 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:31.996328 15264 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:32.071879 15221 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.107784 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:31.995610 15266 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.088416 15343 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:32.110257 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 61411us
W20260709 12:19:32.121801 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.121955 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:32.128960 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:32.127343 13136 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:32.128993 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:32.130228 13279 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.137425 13841 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:32.129701 13132 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.125139 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:32.153457 13284 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:32.155700 13279 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:32.123682 15275 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:32.172106 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.176344 13887 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:19:32.173434 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 49251.8us
W20260709 12:19:32.186430 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 295924us
W20260709 12:19:32.188462 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.160434 15271 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:32.175769 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:32.192701 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.205757 13884 raft_consensus.cc:2410] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:32.211640 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.204432 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:32.215152 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:32.215325 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 261019us
I20260709 12:19:32.183161 15075 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:32.219347 13887 raft_consensus.cc:2410] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:32.194991 15266 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.190073 15077 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:32.191375 15275 raft_consensus.cc:697] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:32.237705 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2408) took 2002 ms. Trace:
I20260709 12:19:32.248814 13203 rpcz_store.cc:276] 0709 12:19:30.234929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.817742 (+1582813us) service_pool.cc:224] Handling call
0709 12:19:31.864989 (+ 47247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.876881 (+ 11892us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:31.877227 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 12:19:32.236752 (+359525us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:32.236887 (+   135us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:32.237011 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.237201 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:32.237494 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2580,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"thread_start_us":353152,"threads_started":1}
I20260709 12:19:32.259588 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.216665 15205 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:19:32.230314 15321 consensus_queue.cc:1059] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:19:32.217916 15238 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.232685 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2405) took 1982 ms. Trace:
I20260709 12:19:32.482077 15373 consensus_queue.cc:1059] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.134s
I20260709 12:19:32.484876 15118 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.579941 15322 raft_consensus.cc:3055] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:19:32.479828 15363 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:19:32.582545 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.579155 15238 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:32.583309 15118 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.581233 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:32.574523 15323 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:32.571882 13210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1231) took 2161 ms (client timeout 2019 ms). Trace:
I20260709 12:19:32.280896 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.587100 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:32.401499 15350 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:19:32.585796 13210 rpcz_store.cc:269] 0709 12:19:30.410120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.171248 (+761128us) service_pool.cc:224] Handling call
0709 12:19:32.571634 (+1400386us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54000b7054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:32.571809 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626962816}
W20260709 12:19:32.567744 13209 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1246) took 1756 ms (client timeout 1994 ms). Trace:
I20260709 12:19:32.259923 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.588598 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:32.588656 15323 raft_consensus.cc:3055] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:32.589217 15323 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:32.589643 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.590076 15323 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.590793 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.591068 15323 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:32.571966 13204 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:32.573735 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.582577 15322 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:32.593057 15322 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.594328 15322 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:32.279044 13885 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:32.595780 13881 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:32.596848 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.596889 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.439687 14998 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:32.598181 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:32.354509 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.598855 13881 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:19:32.260531 15344 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:32.600637 15344 raft_consensus.cc:697] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:32.418084 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 213677us
W20260709 12:19:32.312505 15357 log.cc:927] Time spent T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:19:32.236534 14986 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:32.502787 15303 consensus_meta.cc:287] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
W20260709 12:19:32.262055 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 86030.3us
I20260709 12:19:32.278820 13886 raft_consensus.cc:1240] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:32.604758 13840 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:32.279043 15326 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:32.605578 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.605489 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:32.407056 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 177988us
I20260709 12:19:32.606323 13879 raft_consensus.cc:2410] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:32.268759 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:32.281246 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:32.588604 13209 rpcz_store.cc:269] 0709 12:19:30.811101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.238384 (+427283us) service_pool.cc:224] Handling call
0709 12:19:32.567522 (+1329138us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54000735d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:32.567660 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779827968}
I20260709 12:19:32.354604 13132 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:32.514412 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2410) took 2279 ms. Trace:
I20260709 12:19:32.612187 13103 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:32.612483 13840 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:32.582006 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.312876 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.583755 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:32.412232 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 274879us
W20260709 12:19:32.372321 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 212231us
W20260709 12:19:32.432111 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 200169us
I20260709 12:19:32.614851 13249 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:32.605870 15238 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:19:32.395048 13175 connection.cc:256] RPC call timeout handler was delayed by -1.8281844430000547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 12:19:32.618990 13175 connection.cc:256] RPC call timeout handler was delayed by -1.6157844429999386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
W20260709 12:19:32.619351 13175 connection.cc:256] RPC call timeout handler was delayed by -1.5122844429999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 12:19:32.619711 13175 connection.cc:256] RPC call timeout handler was delayed by -1.5122844429999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 12:19:32.620133 13175 connection.cc:256] RPC call timeout handler was delayed by -1.4591844429999128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 12:19:32.620432 13175 connection.cc:256] RPC call timeout handler was delayed by -1.4411844429998837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 12:19:32.620716 13175 connection.cc:256] RPC call timeout handler was delayed by -1.3628844429999845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260709 12:19:32.620986 13175 connection.cc:256] RPC call timeout handler was delayed by -1.3133844429999044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 12:19:32.621280 13175 connection.cc:256] RPC call timeout handler was delayed by -1.2935844429998724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 12:19:32.621526 13175 connection.cc:256] RPC call timeout handler was delayed by -1.2224844429999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 12:19:32.621742 13175 connection.cc:256] RPC call timeout handler was delayed by -1.2062844429999586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260709 12:19:32.326225 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2409) took 2091 ms. Trace:
I20260709 12:19:32.622193 13211 rpcz_store.cc:276] 0709 12:19:30.235204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.827761 (+1592557us) service_pool.cc:224] Handling call
0709 12:19:31.877787 (+ 50026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.878018 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:32.151872 (+273854us) log.cc:844] Serialized 14 byte log entry
0709 12:19:32.325740 (+173868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:32.325817 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:32.325881 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.325971 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:32.326136 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1772,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":218715,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":45,"thread_start_us":325037,"threads_started":2,"wal-append.queue_time_us":364843}
I20260709 12:19:32.481581 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:32.458873 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.585907 15118 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:32.601053 15321 raft_consensus.cc:3055] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:32.624799 15321 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:19:32.573757 14991 consensus_meta.cc:287] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.647s	user 0.004s	sys 0.004s
I20260709 12:19:32.625363 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.625546 14991 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.625797 15321 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.626384 13880 raft_consensus.cc:2410] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:32.626996 15321 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.371564 14995 ts_tablet_manager.cc:1916] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260709 12:19:32.627703 14991 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:32.587316 13882 raft_consensus.cc:2410] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:32.629868 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.630551 13882 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 1.
I20260709 12:19:32.453339 15186 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.445057 15275 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.371263 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:32.624701 13881 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:32.602500 15344 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:32.314005 15198 consensus_meta.cc:287] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.942s	user 0.010s	sys 0.003s
W20260709 12:19:32.645998 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 43647.9us
I20260709 12:19:32.637015 13884 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:32.278887 13878 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:32.612325 13212 rpcz_store.cc:276] 0709 12:19:30.235983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.864153 (+1628170us) service_pool.cc:224] Handling call
0709 12:19:31.915868 (+ 51715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:31.975011 (+ 59143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:31.975042 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:31.988060 (+ 13018us) log.cc:844] Serialized 26 byte log entry
0709 12:19:32.175943 (+187883us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:32.175980 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.176045 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:32.514173 (+338128us) raft_consensus.cc:1685] finished
0709 12:19:32.514197 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:32.514347 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3248,"raft.queue_time_us":82627,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6828,"thread_start_us":187508,"threads_started":1,"wal-append.queue_time_us":397018}
W20260709 12:19:32.364177 15219 consensus_meta.cc:287] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.710s	user 0.012s	sys 0.000s
I20260709 12:19:32.636149 15186 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.655045 13209 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:32.638695 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.258497 15340 raft_consensus.cc:697] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:32.493597 15182 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:32.645818 13252 leader_election.cc:400] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:32.663106 13252 leader_election.cc:403] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:19:32.648823 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.663514 13280 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:32.649470 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.631623 15326 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:32.668834 14978 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.669083 15326 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:32.669577 15326 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.669373 14978 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.670879 15244 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:32.671567 13207 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:32.671736 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:32.672415 13208 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:32.672596 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:32.675499 13203 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:32.618525 15238 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.654855 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:32.460131 15221 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:32.627331 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.635110 15205 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:32.660403 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:32.660652 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.530484 15236 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.636510 14998 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.698858 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.664511 13286 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:32.697335 13208 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:32.664424 13885 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:32.662789 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:32.665565 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.665930 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.662789 15378 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:32.668327 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:32.645808 15350 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:32.726306 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:32.698326 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:32.663416 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.702828 13203 raft_consensus.cc:3055] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:32.729969 13203 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:32.658309 15219 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.706840 13278 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:32.707455 15364 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:19:32.760195 15364 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:32.760576 15364 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:32.761456 14986 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.761988 14986 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.761616 15364 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.755128 15219 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:32.693054 15323 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:19:32.764496 14986 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:32.765018 15323 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:32.765523 15323 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:32.608671 13205 rpcz_store.cc:276] 0709 12:19:30.234090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.793016 (+1558926us) service_pool.cc:224] Handling call
0709 12:19:31.793436 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.793696 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:19:31.794061 (+   365us) log.cc:844] Serialized 14 byte log entry
0709 12:19:32.154971 (+360910us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:32.174245 (+ 19274us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:32.189815 (+ 15570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.200539 (+ 10724us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:32.211402 (+ 10863us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":841,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":97657,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":329053,"threads_started":1,"wal-append.queue_time_us":856702}
I20260709 12:19:32.742969 15326 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.706939 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.769534 13279 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:32.725692 15205 raft_consensus.cc:697] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:32.738557 14978 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:32.707932 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.686420 15381 consensus_queue.cc:1059] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:19:32.720847 13883 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:32.726056 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 372) took 1030 ms. Trace:
I20260709 12:19:32.314543 15343 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.726934 13887 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:19:32.726959 13210 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.771066 15205 consensus_queue.cc:237] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.771096 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:32.784637 13211 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.772734 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:32.785897 13284 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:32.687199 15238 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:32.736142 13277 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:32.737023 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:32.777196 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.792593 13132 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:32.739452 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:32.731945 13212 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:32.743783 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 106980us
I20260709 12:19:32.744266 13102 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:32.744441 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.726202 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.745633 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.745731 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:32.763273 15364 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.746878 13886 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:19:32.725919 14998 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.748960 15236 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:32.749298 15186 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:32.751080 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.731983 15378 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:32.836267 13278 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:32.751998 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:32.836839 15378 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.837447 13103 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:32.837700 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 102925us
I20260709 12:19:32.753115 15244 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.838413 15244 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:32.752774 13203 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:32.755635 15376 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:19:32.839321 13203 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:32.839594 15321 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:32.693708 15303 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
W20260709 12:19:32.800180 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 55999.2us
I20260709 12:19:32.800241 13884 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:32.766568 15323 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.771318 13283 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:32.780112 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.701545 15314 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.807029 13879 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:32.776808 13137 rpcz_store.cc:276] 0709 12:19:31.695666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.732031 (+ 36365us) service_pool.cc:224] Handling call
0709 12:19:32.725845 (+993814us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b54001f4ad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:32.725993 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40477440}
I20260709 12:19:32.817147 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:32.771668 15326 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:32.842068 13205 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:32.856138 13203 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:19:32.827927 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 138361us
I20260709 12:19:32.776268 15386 raft_consensus.cc:3055] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:32.832597 13881 raft_consensus.cc:2368] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8.
I20260709 12:19:32.781695 15266 consensus_queue.cc:1059] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:19:32.863979 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:32.865756 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:32.865868 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:32.866518 13282 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:32.832885 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.832600 15342 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.868054 15342 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.871059 15342 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:32.834782 15347 consensus_queue.cc:1059] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:32.872467 15347 raft_consensus.cc:3055] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:32.872993 15347 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:32.873518 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:32.874230 15347 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.835579 13207 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:32.835907 15379 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.836221 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.876528 13885 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:32.876233 15379 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.879084 15379 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:32.868086 13886 raft_consensus.cc:2368] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8.
I20260709 12:19:32.840770 15374 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:32.863318 15266 raft_consensus.cc:3055] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:32.842092 13102 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:32.881716 15266 raft_consensus.cc:740] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:32.882332 15075 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:32.882807 15266 consensus_queue.cc:260] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:32.884399 15266 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:32.755782 15350 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:32.890341 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:32.758363 15360 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:19:32.783586 15221 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:32.891969 15221 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.832617 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2422) took 1227 ms. Trace:
I20260709 12:19:32.893343 13204 rpcz_store.cc:276] 0709 12:19:31.604802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.092760 (+487958us) service_pool.cc:224] Handling call
0709 12:19:32.571777 (+479017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:32.599811 (+ 28034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.832386 (+232575us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54000b7050. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:32.832548 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070893824}
I20260709 12:19:32.895800 15265 consensus_queue.cc:1059] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:32.897202 15265 raft_consensus.cc:3055] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:32.897675 15265 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:32.882817 15075 raft_consensus.cc:697] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:32.901046 15075 consensus_queue.cc:237] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.904353 13884 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:32.904556 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:32.905422 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.906141 13884 raft_consensus.cc:2393] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:32.906884 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.778640 14995 ts_tablet_manager.cc:1929] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.2
I20260709 12:19:32.908249 14995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f042aff5e3084d5e8bd6fcb5335160f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.908315 15323 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:32.818486 15288 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:32.910322 13838 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:32.914285 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.856452 15284 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:32.915681 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.916026 15284 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:32.916425 15284 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.916811 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.917903 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.918566 13879 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 4: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:32.915567 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.920101 13885 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:32.800359 14978 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 12:19:32.921978 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 104915us
W20260709 12:19:32.919834 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 100601us
I20260709 12:19:32.838382 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:32.855090 13887 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:32.775108 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:32.745563 15391 consensus_queue.cc:1059] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 12:19:32.859043 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:32.880383 15347 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:32.938344 13100 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:32.938628 13885 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:32.881201 15374 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:32.948190 15374 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:32.950930 15221 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:32.927719 13281 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:32.919338 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.931744 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:32.935613 13880 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:32.936089 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:32.936447 13887 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
W20260709 12:19:32.973739 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 54163.4us
I20260709 12:19:32.936992 13252 leader_election.cc:400] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:32.937286 15326 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:32.841434 15321 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.841403 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:32.974596 13252 leader_election.cc:403] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:19:32.831205 13128 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
W20260709 12:19:32.975214 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 50537us
I20260709 12:19:32.976047 13208 raft_consensus.cc:2410] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:19:32.974386 13879 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:32.976255 13203 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:32.977325 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:32.978564 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:32.951332 13210 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
W20260709 12:19:32.958952 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 120669us
I20260709 12:19:32.968305 13211 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:32.981837 15275 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:32.985996 15219 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:32.986552 15284 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:32.991261 13282 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:32.992329 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 55504us
I20260709 12:19:32.993052 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:32.992066 15321 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:32.998361 15373 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:32.998827 15284 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:32.999446 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 133739us
I20260709 12:19:33.000016 15321 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:32.937011 15238 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:33.001014 13887 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:33.002357 15238 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:33.003182 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 159244us
I20260709 12:19:32.823475 15340 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:33.003939 13838 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:32.997949 13252 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:33.005406 13252 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:33.006814 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:33.007855 13249 leader_election.cc:336] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.570s (SENT)
I20260709 12:19:33.008303 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:33.010324 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:32.964344 13132 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:19:33.012051 13212 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:33.013167 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:32.850222 13883 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:33.019896 15186 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:19:33.019979 15373 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:32.898821 15265 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:33.407604 15265 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:33.019910 15342 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:32.858752 15314 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:33.049032 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.910395 15386 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:32.987946 14967 raft_consensus.cc:2764] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:19:33.117889 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.937283 15288 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 12:19:33.047603 13882 raft_consensus.cc:2368] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:33.250939 13879 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
W20260709 12:19:33.252214 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 258881us
I20260709 12:19:33.340505 13886 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
W20260709 12:19:33.362946 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 370595us
I20260709 12:19:33.040663 15221 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 12:19:33.402989 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.386502 13885 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:33.381188 15379 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:33.381282 14998 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:33.293228 15118 raft_consensus.cc:3055] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:19:33.460661 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:33.457556 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 449685us
W20260709 12:19:33.408406 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:33.511101 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:33.407833 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 469516us
I20260709 12:19:33.449175 13132 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:33.513273 13884 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:19:33.475579 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.409680 13283 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:19:33.410029 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 66635.1us
I20260709 12:19:33.343672 15197 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:33.293228 15326 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:33.343114 15236 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:19:33.405505 15364 consensus_meta.cc:287] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.573s	user 0.018s	sys 0.015s
W20260709 12:19:33.520687 13249 leader_election.cc:336] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.592s (SENT)
I20260709 12:19:33.520493 13175 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:33.456001 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:33.489789 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:33.527936 13279 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:33.529814 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:33.504248 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:33.506217 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 502312us
I20260709 12:19:33.448868 13133 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:33.515507 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.341104 15344 consensus_queue.cc:1059] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.209s
I20260709 12:19:33.510207 15118 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:33.520612 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 514028us
I20260709 12:19:33.501305 13286 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:33.499836 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:33.382413 15284 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.128s
W20260709 12:19:33.524466 13249 leader_election.cc:336] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.935s (SENT)
I20260709 12:19:33.524765 15326 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.525449 15219 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:33.505178 15350 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 12:19:33.534518 15340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.016s	sys 0.035s
I20260709 12:19:33.570582 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:33.534368 15347 consensus_meta.cc:287] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.597s	user 0.017s	sys 0.016s
I20260709 12:19:33.576244 13252 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:33.515038 14967 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 12:19:33.539795 15266 consensus_meta.cc:287] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.655s	user 0.016s	sys 0.001s
I20260709 12:19:33.579527 13282 raft_consensus.cc:3055] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:33.540078 15369 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:33.583681 15371 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:19:33.576887 15219 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:33.585479 14995 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.676s	user 0.007s	sys 0.009s
W20260709 12:19:33.586848 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 55089.1us
I20260709 12:19:33.577070 15326 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:33.602815 13279 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:33.574927 15271 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:19:33.623311 13102 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:19:33.541971 15244 consensus_meta.cc:287] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.703s	user 0.015s	sys 0.000s
I20260709 12:19:33.528121 15197 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:33.612881 13282 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:33.620322 13175 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:33.608963 15340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.017s	sys 0.035s
W20260709 12:19:33.602835 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 78412.9us
W20260709 12:19:33.655014 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 78884.9us
I20260709 12:19:33.656587 13840 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:33.750475 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 93908.5us
I20260709 12:19:33.657372 15303 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:33.755532 15244 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:33.628871 15219 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:33.625946 15236 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:33.857491 13252 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:33.858245 13102 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:33.859171 13286 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
W20260709 12:19:33.861021 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 204502us
W20260709 12:19:33.863967 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 288259us
I20260709 12:19:33.851727 15373 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.863397 13282 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:33.863564 15408 log.cc:927] Time spent T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.098s	user 0.003s	sys 0.003s
W20260709 12:19:33.863811 15410 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.100s	user 0.002s	sys 0.003s
I20260709 12:19:33.850978 15288 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:33.854808 15266 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:33.570474 15386 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:33.887773 13282 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:33.886234 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 259760us
I20260709 12:19:33.865954 14998 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:33.903405 13175 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:33.905119 15393 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:33.919602 15386 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.924994 15244 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:33.932694 15326 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:33.940651 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:33.885492 15340 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:33.945617 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 88220.2us
I20260709 12:19:33.897305 15288 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.900731 13881 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:33.946619 15393 raft_consensus.cc:697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:33.862152 15197 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:33.886035 15373 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:33.878509 15364 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:19:33.861766 15236 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:19:33.960791 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 58314.6us
I20260709 12:19:33.958511 15266 raft_consensus.cc:2764] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:19:33.960512 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:33.966586 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 81458.1us
I20260709 12:19:33.976336 13205 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:33.964586 15288 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:33.981154 13282 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:19:33.979969 13838 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:33.963828 15219 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.982134 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:33.985867 13210 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
W20260709 12:19:33.978602 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.984402 13282 pending_rounds.cc:85] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 4
I20260709 12:19:33.981614 13103 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:33.980579 14995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45928 (request call id 451) took 10644 ms. Trace:
I20260709 12:19:33.989166 13207 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:34.016964 13252 leader_election.cc:400] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:34.022573 13252 leader_election.cc:403] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:33.853317 15118 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:33.988678 15391 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.972342 15236 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:33.985196 15414 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:34.031538 15075 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:34.036623 15414 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.038025 15118 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.038121 14978 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:19:34.039842 15407 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:19:34.040673 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:34.029223 15393 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.041313 13203 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.043810 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1089) took 1201 ms. Trace:
I20260709 12:19:34.044217 13135 rpcz_store.cc:276] 0709 12:19:32.842339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.842646 (+   307us) service_pool.cc:224] Handling call
0709 12:19:32.910788 (+ 68142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:32.911140 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:32.911168 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:32.958326 (+ 47158us) log.cc:844] Serialized 26 byte log entry
0709 12:19:33.573556 (+615230us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:33.573706 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.573962 (+   256us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:34.043500 (+469538us) raft_consensus.cc:1685] finished
0709 12:19:34.043535 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.043739 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43798,"raft.queue_time_us":9583,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":10773,"thread_start_us":235082,"threads_started":1,"wal-append.queue_time_us":955942}
I20260709 12:19:34.045285 15345 raft_consensus.cc:3055] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:34.045780 15345 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:34.037007 15075 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:34.037070 13204 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:19:34.039186 15401 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:19:34.048383 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.049000 15391 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.049902 15378 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:34.051736 13209 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:34.047341 15075 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.054615 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1091) took 1211 ms. Trace:
W20260709 12:19:34.057024 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 58424.7us
I20260709 12:19:34.057039 15275 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.057893 15275 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:34.063897 15387 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.064471 15387 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:34.066592 15387 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:34.067860 13033 catalog_manager.cc:5697] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 3, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 2 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
W20260709 12:19:34.070639 15394 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.570s	user 0.003s	sys 0.009s
I20260709 12:19:34.074062 15053 tablet_bootstrap.cc:492] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:34.074400 15314 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:34.076226 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2437) took 1086 ms. Trace:
W20260709 12:19:34.078101 15399 log.cc:927] Time spent T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.217s	user 0.001s	sys 0.001s
I20260709 12:19:34.079336 15238 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:34.080730 13281 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:19:34.081246 15265 consensus_meta.cc:287] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.604s	user 0.002s	sys 0.010s
I20260709 12:19:34.082350 15368 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:34.082795 15373 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:34.083715 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 112329us
I20260709 12:19:34.085049 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:34.001961 15219 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:34.023674 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:34.094417 15238 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:34.099934 13878 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:34.055027 13133 rpcz_store.cc:276] 0709 12:19:32.843314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.851386 (+  8072us) service_pool.cc:224] Handling call
0709 12:19:32.904125 (+ 52739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.540277 (+636152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.054375 (+514098us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54001374d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:34.054554 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097903360}
I20260709 12:19:34.100912 15238 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.102782 15238 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:33.986984 13282 pending_rounds.cc:107] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:19:34.103899 13282 raft_consensus.cc:2889] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:34.027865 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48688.5us
I20260709 12:19:34.011823 15221 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.051191 15391 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:34.091075 13208 rpcz_store.cc:276] 0709 12:19:32.990149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.006628 (+ 16479us) service_pool.cc:224] Handling call
0709 12:19:33.042231 (+ 35603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:33.448950 (+406719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:33.448984 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:33.502547 (+ 53563us) log.cc:844] Serialized 26 byte log entry
0709 12:19:33.960799 (+458252us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:33.960857 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.960954 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:34.075988 (+115034us) raft_consensus.cc:1685] finished
0709 12:19:34.076013 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.076160 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160755,"raft.queue_time_us":207086,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":46390,"thread_start_us":427202,"threads_started":1,"wal-append.queue_time_us":552672}
I20260709 12:19:34.039176 15414 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:34.093839 15244 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:34.098172 13838 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:34.099105 13211 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:34.087184 13033 catalog_manager.cc:5697] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 4, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 4 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.025478 15326 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:34.105223 13103 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:34.107908 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 253539us
I20260709 12:19:34.113780 13841 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:34.114322 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.114986 13203 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:34.121377 13033 catalog_manager.cc:5697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 3, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 3 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:19:34.123378 13033 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:34.125763 13249 leader_election.cc:336] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 2.072s (SENT)
I20260709 12:19:34.097806 15368 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:34.126734 15314 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.127449 15314 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:34.127228 15368 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:34.128527 15368 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:34.130931 13841 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:34.131616 15221 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:34.132082 15053 tablet_bootstrap.cc:492] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:19:34.132047 15221 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.132517 15221 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:34.135056 13249 leader_election.cc:336] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 2.122s (SENT)
I20260709 12:19:34.135625 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:34.137377 13177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.035s	sys 0.049s
W20260709 12:19:34.137769 13177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.035s	sys 0.049s
W20260709 12:19:34.138546 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 649291us
W20260709 12:19:34.142030 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.138068 13033 catalog_manager.cc:5697] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 4, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 4 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:34.144708 13033 catalog_manager.cc:5697] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.132937 15053 ts_tablet_manager.cc:1403] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 2.252s	user 0.049s	sys 0.066s
W20260709 12:19:34.146339 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.125490 15265 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:19:34.149245 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.146895 13033 catalog_manager.cc:5697] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 3, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 3 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:34.153872 13281 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:34.137632 15314 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:34.156054 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:34.142783 15373 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.142863 15323 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.166435 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:34.170097 13284 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 4: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:34.151608 13033 catalog_manager.cc:5697] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:34.173833 13882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 551) took 1647 ms (client timeout 1935 ms). Trace:
W20260709 12:19:34.174326 13882 rpcz_store.cc:269] 0709 12:19:32.526769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.643186 (+116417us) service_pool.cc:224] Handling call
0709 12:19:34.173610 (+1530424us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b5400618854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:34.173770 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633038208}
I20260709 12:19:34.175714 13033 catalog_manager.cc:5697] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 3 to 4, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:19:34.180685 13033 catalog_manager.cc:5697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.155292 15266 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.142328 15364 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:19:34.160391 15369 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:34.190451 13249 connection.cc:256] RPC call timeout handler was delayed by -1.1591103490000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260709 12:19:34.194967 13249 connection.cc:256] RPC call timeout handler was delayed by -1.1492103489999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
I20260709 12:19:34.183202 13033 catalog_manager.cc:5697] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 3, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:34.146114 15326 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:19:34.158907 15265 raft_consensus.cc:697] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:34.154894 15387 consensus_queue.cc:1059] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:19:34.197039 13033 catalog_manager.cc:5697] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 4, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 4 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.218226 13838 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:34.181330 15340 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.221652 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:34.222518 13130 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
W20260709 12:19:34.195490 13249 connection.cc:256] RPC call timeout handler was delayed by -1.1132103489999281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
I20260709 12:19:34.197041 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:34.223775 13284 raft_consensus.cc:2393] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:19:34.223721 13249 connection.cc:256] RPC call timeout handler was delayed by -1.0619103490000725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
I20260709 12:19:34.195396 15266 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:34.224709 13249 connection.cc:256] RPC call timeout handler was delayed by -1.0187826890000906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
I20260709 12:19:34.224049 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:34.227926 13175 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:34.181057 15205 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:34.177399 15314 raft_consensus.cc:697] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:34.203019 15368 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:19:34.231510 13838 leader_election.cc:400] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3.
I20260709 12:19:34.234095 13838 leader_election.cc:403] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:34.222023 13033 catalog_manager.cc:5697] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:19:34.231755 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:34.204116 15197 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:34.180100 15323 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:34.243283 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.246075 13249 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:34.227002 15378 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:34.206149 15244 consensus_queue.cc:1059] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:19:34.022009 14995 rpcz_store.cc:276] 0709 12:19:23.321710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.328617 (+  6907us) service_pool.cc:224] Handling call
0709 12:19:27.217144 (+3888527us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:28.162953 (+945809us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:28.474423 (+311470us) ts_tablet_manager.cc:919] Shutdown and deleted data from running replica
0709 12:19:28.565304 (+ 90881us) ts_tablet_manager.cc:934] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
0709 12:19:32.070688 (+3505384us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:32.750769 (+680081us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:32.778458 (+ 27689us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:32.907871 (+129413us) tablet_copy_client.cc:463] Replaced tombstoned tablet metadata.
0709 12:19:33.654673 (+746802us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:33.885151 (+230478us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:33.946965 (+ 61814us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:33.964059 (+ 17094us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":22701,"mutex_wait_us":2703506,"tablet-copy.queue_time_us":144,"thread_start_us":1079557,"threads_started":1}
I20260709 12:19:34.224886 15379 consensus_queue.cc:1059] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:19:34.270097 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 121390us
I20260709 12:19:34.274758 13252 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:34.270998 13132 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
W20260709 12:19:34.271934 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 46995.9us
I20260709 12:19:34.275475 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:34.249984 15421 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:34.275990 13838 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:19:34.276834 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 99755.1us
I20260709 12:19:34.249459 15387 consensus_queue.cc:1243] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:19:34.205261 15369 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:34.230350 15275 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.263797 15238 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 2. Current term is 3.
I20260709 12:19:34.282626 15186 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:34.283236 15197 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.273720 15340 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:34.296263 15340 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.296711 15340 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:34.241179 15205 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.299614 15075 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:34.300451 15303 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:34.300577 15186 raft_consensus.cc:697] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:34.301685 15186 consensus_queue.cc:237] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:34.283265 15314 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.292586 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:34.292078 15197 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:34.300225 15075 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:34.287474 14995 tablet_copy_client.cc:806] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:34.280997 15265 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.281210 13133 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:19:34.321590 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 46206.7us
I20260709 12:19:34.324568 15266 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:34.287138 15378 raft_consensus.cc:3055] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:34.292160 15420 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:19:34.328316 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.341408 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.342523 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:34.335835 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.343606 13252 connection.cc:256] RPC call timeout handler was delayed by -2.3081564290000642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 12:19:34.338229 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.344255 13252 connection.cc:256] RPC call timeout handler was delayed by -1.5006894880000345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2715s for a response
I20260709 12:19:34.337924 13175 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:34.340096 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:34.344476 13100 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:34.329162 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:19:34.344676 13252 connection.cc:256] RPC call timeout handler was delayed by -1.3905284360000678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 12:19:34.345890 13252 connection.cc:256] RPC call timeout handler was delayed by -1.3842284360000576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 12:19:34.346163 13252 connection.cc:256] RPC call timeout handler was delayed by -1.2098546930001248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24830000000000002s for a response
W20260709 12:19:34.346515 13252 connection.cc:256] RPC call timeout handler was delayed by -1.070755095000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
I20260709 12:19:34.347651 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:34.348090 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 725) took 1442 ms. Trace:
I20260709 12:19:34.348918 13249 leader_election.cc:400] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8.
W20260709 12:19:34.349072 15426 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:19:34.349290 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:34.351606 15385 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:34.341084 15378 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:34.353083 15205 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:34.353309 15323 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:34.325090 15303 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:34.354774 13252 connection.cc:256] RPC call timeout handler was delayed by -1.0342709630001536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260709 12:19:34.353848 15387 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:34.340936 15219 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:34.356688 15427 log.cc:927] Time spent T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:19:34.356830 13100 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:34.357366 15416 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:34.385980 14986 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:34.386116 13249 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:34.387785 13249 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:34.389016 14986 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:34.389271 13249 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:34.390303 15373 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:34.390733 15373 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:34.391223 15373 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:34.393347 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 561) took 1679 ms. Trace:
I20260709 12:19:34.393815 13881 rpcz_store.cc:276] 0709 12:19:32.713832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.862085 (+148253us) service_pool.cc:224] Handling call
0709 12:19:32.862527 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.967329 (+1104802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.393040 (+425711us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54007602d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:34.393269 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340768128}
I20260709 12:19:34.396507 13282 raft_consensus.cc:3055] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:34.358225 15075 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:34.361208 15197 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:34.336198 14995 tablet_copy_client.cc:670] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:34.397993 15345 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.361904 15275 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:34.364506 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:34.399531 15345 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:34.400759 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:34.401539 13283 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:34.402657 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:34.372049 13280 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:19:34.403836 13286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 1665) took 1446 ms (client timeout 1820 ms). Trace:
W20260709 12:19:34.377933 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 45350.3us
I20260709 12:19:34.370519 13884 rpcz_store.cc:276] 0709 12:19:32.905480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.928510 (+ 23030us) service_pool.cc:224] Handling call
0709 12:19:33.489038 (+560528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.513671 (+ 24633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.347861 (+834190us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b540058a2d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:34.348004 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160878848}
I20260709 12:19:34.376042 15387 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:19:34.404510 13286 rpcz_store.cc:269] 0709 12:19:32.957358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.978019 (+ 20661us) service_pool.cc:224] Handling call
0709 12:19:34.403640 (+1425621us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54000e5954. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:34.403750 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135745408}
I20260709 12:19:34.405099 15387 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:34.407531 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:34.382273 15369 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:34.396938 13282 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:34.365649 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:34.408149 13206 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:34.408715 13285 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:34.403898 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:34.408138 13203 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:34.408968 13282 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:34.410120 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:34.410841 13285 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:34.410152 15369 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:34.411536 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.403254 15432 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:34.375543 15420 raft_consensus.cc:697] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:34.411553 15369 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.413401 15369 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:34.377027 15378 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.412434 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:34.373834 15385 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:34.404532 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:34.403295 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:34.413661 15420 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.417500 13177 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:34.424172 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:34.390964 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:34.439895 13282 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:34.439740 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:34.437587 13206 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:34.440548 13211 raft_consensus.cc:2376] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6. Re-sending same reply.
I20260709 12:19:34.441572 13100 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:34.444837 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:34.445451 13211 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:34.375747 14967 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:34.448426 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:34.450852 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:34.451165 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:34.447825 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:34.448838 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:34.449065 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:34.422798 15378 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.412501 15432 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:34.456857 13279 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:34.457098 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:34.458806 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 67905.1us
I20260709 12:19:34.463814 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:34.439477 15303 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:34.474956 13210 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:34.475200 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:34.452311 15321 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:34.476666 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:34.452164 15238 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:34.480700 13211 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:34.482884 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:34.457684 15075 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.482084 13841 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:34.483744 15238 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.484333 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:34.484694 15275 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:34.485242 15275 raft_consensus.cc:697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:34.483976 15075 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.492113 15238 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:34.494263 15075 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:34.495546 13133 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:34.496068 14995 tablet_copy_client.cc:538] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:34.497777 15431 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:34.497956 13208 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:34.498729 15326 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.499281 15326 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.499817 15238 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:34.500381 15238 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.480823 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:34.502630 15238 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:34.483285 13282 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:34.485267 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:34.505806 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:34.487035 13252 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.566s (SENT) [suppressed 41 similar messages]
I20260709 12:19:34.450662 15197 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:19:34.467584 15432 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:34.515129 13252 leader_election.cc:336] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.807s (SENT)
I20260709 12:19:34.525094 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:34.468695 15385 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:34.523315 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:34.479331 15321 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.524344 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:34.525382 13136 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:34.515133 13206 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:34.527513 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:34.474472 15393 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:19:34.528982 13129 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:19:34.539410 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:34.544070 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:34.527563 15238 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.545928 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:34.526710 15288 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 12:19:34.549166 13137 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:34.613435 13136 pending_rounds.cc:85] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 1
I20260709 12:19:34.613940 13136 pending_rounds.cc:107] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:19:34.531806 15347 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:19:34.583130 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 68038.1us
I20260709 12:19:34.619309 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:34.619856 13132 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
W20260709 12:19:34.619915 13252 leader_election.cc:336] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.845s (SENT)
I20260709 12:19:34.614249 13136 raft_consensus.cc:2889] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:34.547554 13129 pending_rounds.cc:85] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 2
I20260709 12:19:34.618335 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:34.619987 13879 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:34.620867 13252 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:34.544902 15321 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:34.618358 13205 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:34.621426 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:34.621616 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:34.544994 13881 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:34.582314 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:34.632755 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:34.634586 15436 log.cc:927] Time spent T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:19:34.636412 15326 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:34.637265 15326 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:34.639240 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:34.630244 13252 leader_election.cc:336] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.860s (SENT)
I20260709 12:19:34.643213 13252 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:34.644739 13252 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:34.533674 15236 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:34.622260 13129 pending_rounds.cc:107] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.3
I20260709 12:19:34.645740 15417 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:34.612264 15221 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.659575 13129 raft_consensus.cc:2917] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Aborting config change with OpId 3.3: Aborted: Op aborted by new leader
I20260709 12:19:34.620168 15347 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:34.624761 15385 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.620958 15303 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:19:34.663105 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.669845 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.670455 13129 raft_consensus.cc:2889] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:34.550401 15275 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.673772 13277 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:34.648609 13131 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:34.612097 15238 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:34.679510 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.616426 15288 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:19:34.749568 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 104931us
I20260709 12:19:34.751333 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60850 (request call id 16) took 10053 ms. Trace:
I20260709 12:19:34.673741 13878 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:34.642624 15340 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:34.766285 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 146824us
I20260709 12:19:34.656505 15369 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:34.674474 15417 raft_consensus.cc:697] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:34.772823 13134 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:34.772917 13879 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:34.766203 13880 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:34.783617 13203 raft_consensus.cc:2368] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6.
W20260709 12:19:34.857610 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 69032.4us
I20260709 12:19:34.672600 15385 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:34.868520 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 71587.3us
W20260709 12:19:34.869814 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.756142 13129 rpcz_store.cc:276] 0709 12:19:24.697612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.438673 (+741061us) service_pool.cc:224] Handling call
0709 12:19:26.087684 (+649011us) log.cc:844] Serialized 499 byte log entry
0709 12:19:26.771357 (+683673us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5400521aa0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e02dbe 00007f70f4e0d930 00007f70f4e0d8d8 00007f70f4e0d858 00007f70f4e0d813 00007f70f4e0ca9c 00007f70facf82f6 00007f70facf2aa8 00007f70f4e497cb 00007f70f4e4c2c0
0709 12:19:27.543246 (+771889us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b5400521aa0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e06142 00007f70f4de6eaa 00007f70f4dedd53 00007f70f4dedcd9 00007f70f4dedc69 00007f70f4dedc31 00007f70f4decdfd 0000000000388634 0000000000388479 00007f70f1da0475
0709 12:19:28.030904 (+487658us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b5400521aa0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e0db26 00007f70f4e0749a 00007f70f4e06714 00007f70f4de6eaa 00007f70f4dedd53 00007f70f4dedcd9 00007f70f4dedc69 00007f70f4dedc31 00007f70f4decdfd 0000000000388634
0709 12:19:29.066504 (+1035600us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4c00478800. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3159a20 00007f70f316aa29 00007f70f316b13f 00007f70f312f2ab 00007f70f315cf3c 00007f70f315d3fe 00007f70f33ea50b 00007f70f4de9381 00007f70f4de726b 00007f70f4dedd53 00007f70f4dedcd9
0709 12:19:34.751241 (+5684737us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83513,"raft.queue_time_us":180951,"raft.run_cpu_time_us":52642,"raft.run_wall_time_us":3909527,"spinlock_wait_cycles":122988032,"thread_start_us":207306,"threads_started":1,"wal-append.queue_time_us":260129,"wal-append.run_cpu_time_us":4557,"wal-append.run_wall_time_us":1389482}
W20260709 12:19:34.881268 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.886930 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:34.777006 15053 raft_consensus.cc:359] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:34.919269 15444 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:34.780859 15347 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:34.941816 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.874454 15387 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:34.913259 15197 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:34.946012 13886 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:34.916538 15053 raft_consensus.cc:740] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
W20260709 12:19:34.978819 15449 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:19:34.979975 15288 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:34.978636 15314 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.995855 13286 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:34.954347 15443 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:34.980810 15417 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:35.007493 15347 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:35.011466 15385 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:34.962185 13083 auto_rebalancer.cc:629] Failed to schedule move for tablet d4a97da851674edaa6a93f32de934f5c: Aborted: Op aborted by new leader
I20260709 12:19:35.015682 15053 consensus_queue.cc:260] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:35.017158 15369 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:35.017244 15321 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.019899 15432 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.020901 13285 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:35.021967 15432 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.025046 15303 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:19:35.026916 15445 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:19:35.027175 15321 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.029156 13133 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
W20260709 12:19:35.034044 13083 auto_rebalancer.cc:629] Failed to schedule move for tablet 25bd867e44d047eeb41637598bf8d7fc: Illegal state: Replica af3f42f0797349058724e0cb2e637d24 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
W20260709 12:19:35.038241 15450 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:19:35.041385 13285 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:35.042404 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:35.043812 13249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.028s
W20260709 12:19:35.044220 13249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.000s	sys 0.028s
I20260709 12:19:35.044099 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:35.045080 13129 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:35.045295 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:35.045667 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 44965.8us
I20260709 12:19:35.046802 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:35.047551 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:35.047351 13283 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:35.045924 13282 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:35.053045 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:35.053866 13280 raft_consensus.cc:2393] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:35.056932 13252 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:35.058265 13252 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:34.993364 15236 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:35.062698 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:35.064818 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:35.064987 13838 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:35.043982 14986 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.068130 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:35.068926 13887 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:35.069308 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:35.071878 13279 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 1.
W20260709 12:19:35.070340 13252 leader_election.cc:336] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 2.000s (SENT)
I20260709 12:19:35.043789 15321 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.044207 15288 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:35.073945 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:35.076714 13887 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:35.056219 13132 pending_rounds.cc:85] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 4
I20260709 12:19:35.077454 13132 pending_rounds.cc:107] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:19:35.077787 13132 raft_consensus.cc:2889] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:35.069597 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:35.052824 15221 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:34.984477 15197 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.060151 15443 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:35.042112 15314 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.059684 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:35.068095 15303 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:35.067879 15326 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:35.098913 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:35.040452 15444 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:19:35.085012 13102 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:35.052385 15432 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:19:35.084259 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:35.079916 15340 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:35.097963 13131 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:35.107657 13102 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:35.112763 15458 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.113348 15458 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:35.114575 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 140908us
I20260709 12:19:35.103356 13128 raft_consensus.cc:2393] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:35.096349 15385 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.084895 15321 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.077389 14986 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.085246 15288 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:35.134186 13175 connection.cc:256] RPC call timeout handler was delayed by -2.3778243809999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.40140000000000003s for a response
I20260709 12:19:35.110700 15443 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.110167 15456 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:35.108245 15326 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:35.153342 15053 ts_tablet_manager.cc:1434] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 1.000s	user 0.009s	sys 0.008s
W20260709 12:19:35.154206 13175 connection.cc:256] RPC call timeout handler was delayed by -1.4316399379999893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 12:19:35.155994 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:35.156221 13129 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:35.136348 13880 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:19:35.182281 13175 connection.cc:256] RPC call timeout handler was delayed by -1.3587399379998715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 12:19:35.182793 13175 connection.cc:256] RPC call timeout handler was delayed by -1.2597399379999388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
W20260709 12:19:35.183421 13175 connection.cc:256] RPC call timeout handler was delayed by -1.2354399379998995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 12:19:35.183940 13175 connection.cc:256] RPC call timeout handler was delayed by -1.224639937999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 12:19:35.184427 13175 connection.cc:256] RPC call timeout handler was delayed by -1.185039937999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 12:19:35.184881 13175 connection.cc:256] RPC call timeout handler was delayed by -1.1382399379999697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 12:19:35.185354 13175 connection.cc:256] RPC call timeout handler was delayed by -1.1085399379999217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 12:19:35.185806 13175 connection.cc:256] RPC call timeout handler was delayed by -1.0788399379998737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 12:19:35.135776 15347 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.153728 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1668) took 1005 ms. Trace:
I20260709 12:19:35.163034 15369 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.198534 13249 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:35.164996 15053 ts_tablet_manager.cc:1467] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Tablet startup took 1016ms
I20260709 12:19:35.181908 15414 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:35.136610 15385 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:35.164300 15463 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:35.190469 15303 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:35.200213 14995 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:19:35.209345 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:35.191939 15387 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.193080 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:35.199973 15458 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:35.215095 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:35.213954 15303 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.219281 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:35.215111 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:35.196422 15236 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:19:35.163139 15443 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.226439 13130 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:35.212956 13100 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:35.209219 15414 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.215728 15340 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:35.196456 15347 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:35.230705 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:35.234710 13136 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:35.232746 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 95114.2us
I20260709 12:19:35.207417 15432 consensus_queue.cc:1059] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:19:35.242295 15347 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:35.242599 15432 raft_consensus.cc:3055] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:35.243136 15432 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:19:35.244738 15465 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:19:35.244218 15432 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.245937 15432 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:35.209875 15369 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.233932 15414 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:35.201228 13278 rpcz_store.cc:276] 0709 12:19:34.140909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.142272 (+  1363us) service_pool.cc:224] Handling call
0709 12:19:34.159553 (+ 17281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:34.234533 (+ 74980us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:34.353570 (+119037us) log.cc:844] Serialized 14 byte log entry
0709 12:19:34.759539 (+405969us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:34.868643 (+109104us) log.cc:844] Serialized 26 byte log entry
0709 12:19:34.890099 (+ 21456us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:34.907879 (+ 17780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.913013 (+  5134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:35.131463 (+218450us) raft_consensus.cc:1685] finished
0709 12:19:35.131483 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:35.146771 (+ 15288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15729,"prepare.queue_time_us":119873,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":25423,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":13701,"thread_start_us":464571,"threads_started":2,"wal-append.queue_time_us":442500}
I20260709 12:19:35.200219 15459 consensus_queue.cc:1059] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 12:19:35.241864 15345 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.842s	user 0.004s	sys 0.007s
I20260709 12:19:35.241014 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:35.230207 15470 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.227632 13133 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:35.230466 15303 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:35.256557 15221 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:35.260829 15373 consensus_meta.cc:287] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.869s	user 0.006s	sys 0.006s
I20260709 12:19:35.238555 15417 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:35.239179 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:35.272758 13137 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:35.277349 13137 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:35.278554 13137 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:35.273157 15443 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.274210 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:35.267556 15347 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:35.285503 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:35.286486 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:35.270239 15221 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.280737 13880 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:35.297308 13887 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:35.301079 13175 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:35.304365 15314 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:35.267895 15470 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.307475 13136 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:35.308194 15186 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:35.308658 15186 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:35.309051 15186 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:35.309285 15470 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:35.310729 15221 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:35.297413 15347 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:35.311635 15347 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.250313 15326 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:35.288664 15417 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:35.277158 15373 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.292179 14986 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:35.323860 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.315965 15236 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.330504 13130 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:35.314067 15321 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.322809 15369 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.324993 15385 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:35.334388 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:35.331223 15417 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:35.340749 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:19:35.207113 15053 ts_tablet_manager.cc:1469] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Trace:
0709 12:19:20.936157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.944785 (+  8628us) service_pool.cc:224] Handling call
0709 12:19:21.173340 (+228555us) ts_tablet_manager.cc:934] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
0709 12:19:25.703873 (+4530533us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:27.472147 (+1768274us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:27.496002 (+ 23855us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:27.943056 (+447054us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:28.014727 (+ 71671us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:28.060566 (+ 45839us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:28.060666 (+   100us) inbound_call.cc:177] Queueing success response
0709 12:19:29.591477 (+1530811us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b1800316120. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d1ac0a 00007f70fb45a219 00007f70f1c44ed8 00007f70f1d9fde2 00007f70f9e04d23 00007f70f9e0455d 00007f70f9ea03d8 00007f70f9ed1f4e 00007f70f9eb6fdd
0709 12:19:31.871269 (+2279792us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:19:34.153448 (+2282179us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:19:34.342092 (+188644us) tablet_replica.cc:261] Starting instrumentation
0709 12:19:34.342736 (+   644us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":30342,"mutex_wait_us":83155,"raft.queue_time_us":72188,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":13568,"spinlock_wait_cycles":5485440,"tablet-copy.queue_time_us":172121,"tablet-download-pool.queue_time_us":44528,"tablet-download-pool.run_cpu_time_us":3080,"tablet-download-pool.run_wall_time_us":1969074,"thread_start_us":208010,"threads_started":3}
I20260709 12:19:35.344393 15480 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:35.346423 15448 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
I20260709 12:19:35.352808 15478 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:35.353338 15478 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:35.353729 15478 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:35.333050 15236 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:35.357649 15373 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.358886 15236 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:35.360457 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:35.364902 15186 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:35.367532 15386 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:19:35.367741 13133 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
W20260709 12:19:35.365422 15378 consensus_meta.cc:287] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.892s	user 0.008s	sys 0.004s
I20260709 12:19:35.372881 14967 raft_consensus.cc:2764] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:19:35.374177 15347 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.386284 15186 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.390235 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:35.391670 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:19:35.392371 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 179515us
I20260709 12:19:35.392513 15467 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:35.393733 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:35.394290 15467 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:35.394318 15186 raft_consensus.cc:2764] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:19:35.395653 15463 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:35.399760 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:35.402908 13175 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:35.404929 15347 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:35.405395 15347 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:35.405908 15347 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:35.405321 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:35.407644 13282 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:35.387212 15238 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:35.410857 15480 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:35.411092 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:35.409451 15431 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.413779 15431 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:35.414397 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 566) took 1075 ms. Trace:
I20260709 12:19:35.414796 13878 rpcz_store.cc:276] 0709 12:19:34.339208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.340608 (+  1400us) service_pool.cc:224] Handling call
0709 12:19:34.342972 (+  2364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:34.769998 (+427026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:35.414153 (+644155us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400752454. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:35.414331 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727930112}
I20260709 12:19:35.416112 15431 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:35.418493 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:35.427940 13134 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:35.401252 15432 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.458274 13282 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
W20260709 12:19:35.450909 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 215080us
I20260709 12:19:35.465633 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:35.466490 13132 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:35.449115 15186 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:35.472987 13102 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:35.475641 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:35.477095 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:35.477998 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:35.478752 13207 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:35.481751 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:35.482169 13204 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:35.482674 13205 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:35.449103 15480 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:19:35.485208 15484 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:35.485816 15484 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.486209 15484 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:35.464284 15431 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:35.481082 15477 log.cc:927] Time spent T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
I20260709 12:19:35.474000 15386 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.473779 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:35.468597 14998 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 12:19:35.513459 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 102857us
I20260709 12:19:35.516165 13175 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:35.516906 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:35.518673 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:35.520347 13252 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:35.472235 15432 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.522832 13252 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:35.526511 13205 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:35.496155 15417 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:35.528101 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:35.528206 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:35.531477 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 55914.8us
I20260709 12:19:35.531870 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:35.494046 13880 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:35.533931 13209 raft_consensus.cc:2410] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:35.534982 13204 raft_consensus.cc:2393] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:35.535333 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:35.536154 13210 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:35.515019 15474 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:35.531317 15236 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:35.563179 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:35.496716 15431 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:35.563022 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:35.527868 15387 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:35.507697 15386 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.521381 15303 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.552378 15471 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:35.554822 15474 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:35.590636 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 73799.2us
I20260709 12:19:35.548192 15417 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:35.694271 13134 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:35.591907 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:35.892676 13210 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:35.594671 13280 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:35.635977 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:35.895107 13284 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:35.638448 13884 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:19:35.611486 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 56117.8us
I20260709 12:19:35.577348 15368 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:35.579610 15236 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:35.901582 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:35.902274 13203 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:35.592242 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:35.900638 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:35.644631 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2453) took 1480 ms. Trace:
I20260709 12:19:35.618387 13204 raft_consensus.cc:1240] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:35.903383 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:35.899353 13103 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:35.583374 15471 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.928390 13280 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:35.933879 13282 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:35.929401 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:35.927896 13286 rpcz_store.cc:276] 0709 12:19:34.164223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.405572 (+241349us) service_pool.cc:224] Handling call
0709 12:19:34.405879 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:34.996598 (+590719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:35.644310 (+647712us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54004092d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:35.644530 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328534784}
W20260709 12:19:35.890234 15487 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 12:19:35.694658 15482 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:19:35.585100 15474 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:35.646365 15488 log.cc:927] Time spent T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:19:35.601148 14998 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:35.739225 15326 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:35.950309 13210 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:35.591172 15387 raft_consensus.cc:697] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:35.643472 15197 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.967233 14998 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.940127 15238 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.935629 15471 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:35.967502 15303 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.632619 15414 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:35.592327 15478 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:35.978749 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:35.947475 15490 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:35.928124 15368 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:35.719537 15491 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:35.965235 15386 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:35.972191 15498 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:35.981249 14998 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.006011 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:35.989650 15197 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.004112 15490 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:36.040964 15490 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:36.041567 15244 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:36.042168 15244 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.021565 15478 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:36.003459 15303 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:36.027560 15491 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:36.047348 15303 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:36.048599 15491 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.049777 15303 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:36.050880 15494 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:19:36.028563 13208 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:35.991628 15340 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:36.052245 15340 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.054382 15340 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:36.054831 15340 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:36.055583 15466 raft_consensus.cc:3055] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:36.056149 15466 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:36.057153 15466 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.058204 15466 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:36.055545 15340 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.061478 15340 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:36.067889 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.068655 15414 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:36.069806 13278 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:36.070196 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:36.037330 15236 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:36.071065 13885 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 570) took 1449 ms (client timeout 1711 ms). Trace:
I20260709 12:19:36.071286 13278 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:19:36.071478 13885 rpcz_store.cc:269] 0709 12:19:34.621803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.642521 (+ 20718us) service_pool.cc:224] Handling call
0709 12:19:36.070054 (+1427533us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:36.071009 (+   955us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12586752}
I20260709 12:19:36.072649 13278 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:19:36.078089 13285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42730 (request call id 325) took 1578 ms (client timeout 1946 ms). Trace:
W20260709 12:19:36.018884 15347 consensus_meta.cc:287] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.000s
W20260709 12:19:36.078648 13285 rpcz_store.cc:269] 0709 12:19:34.499305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.547296 (+ 47991us) service_pool.cc:224] Handling call
0709 12:19:36.077879 (+1530583us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400408dd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:36.078015 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915469568}
I20260709 12:19:36.085721 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:36.087989 13886 raft_consensus.cc:2410] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:35.979553 15326 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:35.997886 15492 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:19:36.019150 15386 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:36.097858 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:36.098711 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.092561 13885 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:35.990866 15496 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 12:19:36.034857 15499 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.991325 15238 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.082012 15345 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.102149 13175 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:36.109529 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:19:36.106382 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 168518us
I20260709 12:19:36.082903 15379 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.113047 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:36.110699 13286 raft_consensus.cc:2410] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:19:36.102932 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 114168us
W20260709 12:19:36.111042 13249 leader_election.cc:336] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.649s (SENT)
I20260709 12:19:36.116525 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:36.124251 13175 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:36.019670 15498 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:36.106591 15484 consensus_meta.cc:287] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.005s
W20260709 12:19:36.162990 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 45333.8us
I20260709 12:19:36.163844 13103 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:36.092742 15347 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:36.173772 13249 leader_election.cc:336] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.711s (SENT)
I20260709 12:19:36.174331 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:36.117209 15118 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:36.117437 15186 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.149381 15501 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:36.106082 15369 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:19:36.149232 15480 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:36.163463 15340 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.104431 15386 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.184759 13207 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:36.112802 15345 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:36.185483 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 68827.7us
I20260709 12:19:36.092520 15387 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:36.209267 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2451) took 2056 ms. Trace:
I20260709 12:19:36.209789 13277 rpcz_store.cc:276] 0709 12:19:34.152446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.152582 (+   136us) service_pool.cc:224] Handling call
0709 12:19:34.152887 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:34.749310 (+596423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.208948 (+1459638us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b5400336654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:36.209180 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196380032}
I20260709 12:19:36.165017 15490 consensus_queue.cc:1059] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:19:36.170552 15484 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:36.164711 15495 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:19:36.226044 15480 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:36.125305 15379 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.226881 13136 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:36.221727 15496 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:36.108772 15499 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:36.222033 15507 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:36.181567 15186 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:36.354070 13102 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:36.346210 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:36.465382 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 111395us
I20260709 12:19:36.379837 13208 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:36.459239 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.467067 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.346634 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:36.259001 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 397) took 1216 ms. Trace:
I20260709 12:19:36.467886 13204 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:36.394150 13205 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:36.474031 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.424144 14995 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:36.378113 13203 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:19:36.468091 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 304302us
I20260709 12:19:36.261282 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:36.484930 13103 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:36.209009 15236 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:36.485343 13277 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:36.261942 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:36.393669 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:36.208931 13278 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:36.459074 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 334886us
I20260709 12:19:36.227748 15421 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:36.468115 13129 rpcz_store.cc:276] 0709 12:19:35.042876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.045715 (+  2839us) service_pool.cc:224] Handling call
0709 12:19:35.045954 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:35.181691 (+135737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.258776 (+1077085us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540010c7d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:36.258939 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252546304}
I20260709 12:19:36.345148 15197 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:36.493841 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:36.255194 15386 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:36.480196 15496 consensus_queue.cc:1059] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:19:36.496882 15500 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:36.497205 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:36.500406 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:36.256564 15340 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:36.452742 15466 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:36.339257 15118 raft_consensus.cc:3055] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:36.465200 13210 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:36.354264 15495 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.261193 15498 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:36.263105 15288 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:36.550048 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.258229 15454 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:36.554490 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.554747 15454 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.555694 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:36.556407 13210 raft_consensus.cc:2368] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6.
I20260709 12:19:36.465143 15303 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:36.557642 15303 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:36.264010 15326 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:36.371625 15244 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:36.558506 15454 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:36.557138 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:36.350008 15347 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:36.455858 15501 raft_consensus.cc:697] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:36.521919 14995 tablet_bootstrap.cc:492] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:19:36.348487 14998 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:36.227094 15491 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.280s
I20260709 12:19:36.535702 15509 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:36.538537 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:36.539255 15466 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.539557 15493 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:19:36.540534 13204 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:36.606443 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:36.606750 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.607095 13210 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:36.607460 13204 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:36.541062 13286 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:36.532604 15238 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:36.542512 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:36.559170 15379 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:36.543581 15505 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:36.546160 15421 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:36.551789 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.620024 13212 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:36.552515 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.553807 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.554010 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1681) took 1139 ms. Trace:
I20260709 12:19:36.620800 13205 raft_consensus.cc:2376] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5. Re-sending same reply.
I20260709 12:19:36.497452 15484 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:36.621976 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 162523us
I20260709 12:19:36.342051 15490 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.480064 15467 consensus_queue.cc:1059] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:19:36.560694 14995 ts_tablet_manager.cc:1403] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 1.395s	user 0.030s	sys 0.018s
W20260709 12:19:36.563267 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.260936 15345 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:36.521844 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.591190 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:36.589425 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 89108.8us
I20260709 12:19:36.214121 15506 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.307s
I20260709 12:19:36.549219 15496 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:36.594571 13280 raft_consensus.cc:2393] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:36.519042 15500 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.597334 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:36.639846 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.640663 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:36.601370 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 399149us
I20260709 12:19:36.559062 15326 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:36.541561 15431 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:36.522663 13221 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-b5031b82872c430cbd03772ba96480ff received from {username='slave'} at 127.0.0.1:36412
W20260709 12:19:36.558534 15474 consensus_meta.cc:287] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.000s
I20260709 12:19:36.531836 15118 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:36.611233 13281 raft_consensus.cc:2410] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:36.654944 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:36.543203 15503 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 12:19:36.612239 15509 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:36.662806 13221 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-b5031b82872c430cbd03772ba96480ff on tablet b5031b82872c430cbd03772ba96480ff with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:36.521570 15507 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:36.498255 15236 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.555522 15186 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:36.594208 15288 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:36.667517 15507 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.668201 15525 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:19:36.670034 15507 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:36.650786 15345 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:19:36.671011 15345 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:36.671499 15345 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.671571 15421 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:36.672508 15236 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:36.673713 15345 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:36.674384 15345 raft_consensus.cc:3055] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:36.674703 15345 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:36.663127 15509 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.676509 15466 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:36.620972 13279 rpcz_store.cc:276] 0709 12:19:35.414632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.414820 (+   188us) service_pool.cc:224] Handling call
0709 12:19:35.415233 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:35.415696 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:35.415732 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:35.416249 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:19:36.260921 (+844672us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b18003915a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f4a354bc 00007f70f1d8348b 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1
0709 12:19:36.261086 (+   165us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:36.261121 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.261178 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:36.551805 (+290627us) spinlock_profiling.cc:243] Waited 7.46 ms on lock 0x7b18003915a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:19:36.553742 (+  1937us) raft_consensus.cc:1685] finished
0709 12:19:36.553772 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.553936 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12815,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":16009,"spinlock_wait_cycles":24555648,"thread_start_us":44875,"threads_started":1,"wal-append.queue_time_us":45311}
I20260709 12:19:36.625547 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.625922 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:36.629135 13252 leader_election.cc:336] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.566s (SENT)
I20260709 12:19:36.456115 15480 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:36.638370 13206 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:36.618595 15238 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.574594 15495 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:36.650974 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.650290 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.653534 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:36.655577 13210 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:36.658366 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:37.100769 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.178155 13205 raft_consensus.cc:2410] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:19:36.758217 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 116757us
W20260709 12:19:37.178429 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 523507us
I20260709 12:19:37.186879 13103 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:37.180303 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.646234 15500 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:36.935073 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 308234us
I20260709 12:19:37.179044 13281 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:36.639771 15496 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:36.664758 15513 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:37.210227 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:37.211233 13280 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:19:36.857203 15523 log.cc:927] Time spent T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.226s	user 0.002s	sys 0.000s
W20260709 12:19:36.757620 15471 consensus_meta.cc:287] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.002s
I20260709 12:19:37.208863 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:37.199741 13252 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:37.231624 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:37.231639 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:37.232775 13280 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:37.204613 13212 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 2: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:36.854079 15421 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.737443 15186 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.678444 15499 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:37.217378 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:36.912706 15493 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:19:37.253690 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 44930.1us
I20260709 12:19:37.254853 13841 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:37.243238 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 328) took 1075 ms. Trace:
I20260709 12:19:36.657181 15474 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:36.637620 15490 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.205847 15236 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.081485 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:37.249217 13282 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:37.252267 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:36.650615 15531 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.580s
I20260709 12:19:37.256578 13280 rpcz_store.cc:276] 0709 12:19:36.168057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.242178 (+1074121us) service_pool.cc:224] Handling call
0709 12:19:37.242585 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.242813 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.242851 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:37.242910 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:37.242955 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.243028 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.243155 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:37.267984 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1689) took 1150 ms. Trace:
I20260709 12:19:37.269002 13281 raft_consensus.cc:2410] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:19:37.400470 13279 rpcz_store.cc:276] 0709 12:19:36.117883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.234063 (+1116180us) service_pool.cc:224] Handling call
0709 12:19:37.267409 (+ 33346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.267611 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.267636 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:37.267692 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:37.267739 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.267799 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.267922 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.737442 15326 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.244516 15463 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:37.288152 15536 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:19:37.244179 15471 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.656571 15379 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.604s
I20260709 12:19:37.414338 15379 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.414836 15379 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.416841 15379 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:37.273645 14995 raft_consensus.cc:359] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:37.417658 14995 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:19:37.418358 14995 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:37.419977 14995 ts_tablet_manager.cc:1434] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.793s	user 0.005s	sys 0.011s
W20260709 12:19:37.420243 14995 ts_tablet_manager.cc:1467] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Tablet startup took 792ms
I20260709 12:19:37.421628 15368 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:37.422937 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2448) took 1943 ms. Trace:
I20260709 12:19:37.423347 13207 rpcz_store.cc:276] 0709 12:19:35.479805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.479908 (+   103us) service_pool.cc:224] Handling call
0709 12:19:35.480189 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.188842 (+708653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.422660 (+1233818us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b540041d7d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:37.422866 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619910528}
I20260709 12:19:37.300587 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:37.424670 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1685) took 1325 ms. Trace:
I20260709 12:19:37.253563 15484 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:19:37.253582 15530 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.261230 15521 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:37.300766 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:37.201752 14998 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:37.300138 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 330) took 1125 ms. Trace:
I20260709 12:19:36.655341 15501 consensus_queue.cc:237] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:37.207010 15238 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:36.849337 15345 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.431931 13282 rpcz_store.cc:276] 0709 12:19:36.174761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.273779 (+1099018us) service_pool.cc:224] Handling call
0709 12:19:37.299488 (+ 25709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.299726 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.299765 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:37.299833 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:37.299892 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.299950 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.300075 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:36.665540 15118 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:37.306602 13203 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:37.272101 15499 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:37.262632 15478 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:37.217572 15513 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:37.303200 15493 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:37.252496 15467 consensus_queue.cc:1059] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:19:37.334904 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2476) took 1406 ms. Trace:
W20260709 12:19:37.335675 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 104129us
I20260709 12:19:37.449364 13103 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:37.300453 15495 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:37.313838 15534 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:19:37.344662 15490 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:37.260526 15186 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:37.348462 15515 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 1.088s	user 0.006s	sys 0.006s
W20260709 12:19:37.350355 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.351506 15474 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:37.351584 13208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c6b052993424c29a7d49943db353a08"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:37.306033 15454 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:37.470302 13208 raft_consensus.cc:606] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:37.470679 13208 raft_consensus.cc:614] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:37.354777 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 177458us
I20260709 12:19:37.262403 15421 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:37.350364 13278 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:37.300755 15236 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:37.481277 15500 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:37.483187 15236 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:37.483922 15236 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:37.484874 15493 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:37.301360 15496 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:37.485932 15493 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.486671 15496 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:37.489209 15421 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:37.491068 15500 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:37.492321 15432 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:37.440790 15530 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.496074 13203 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:37.377584 15546 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:37.497558 15530 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:37.497962 15546 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:37.498970 15546 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.502697 15513 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:37.504410 15551 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:37.505041 15551 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:37.505532 15551 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:37.390718 14967 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:37.508340 14967 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.508775 15238 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:37.510743 14967 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:37.448625 15499 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:37.391548 15539 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:37.511588 15539 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.512796 15499 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:37.513939 15539 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:37.245983 15519 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.021s	sys 0.025s
W20260709 12:19:37.514632 15519 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.025s	sys 0.025s
I20260709 12:19:37.515014 15471 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:37.404646 13280 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:37.516026 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 336) took 1138 ms. Trace:
I20260709 12:19:37.446693 15521 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.516536 13280 rpcz_store.cc:276] 0709 12:19:36.377808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.403992 (+1026184us) service_pool.cc:224] Handling call
0709 12:19:37.404415 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.515707 (+111292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.515954 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:37.518282 13280 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:37.403189 13279 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:19:37.519204 13279 pending_rounds.cc:85] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 4
I20260709 12:19:37.519539 13279 pending_rounds.cc:107] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:19:37.519814 13279 raft_consensus.cc:2889] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:37.406097 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 151317us
I20260709 12:19:37.407473 13281 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:37.521714 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 338) took 1056 ms. Trace:
I20260709 12:19:37.425139 13285 rpcz_store.cc:276] 0709 12:19:36.099757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.099936 (+   179us) service_pool.cc:224] Handling call
0709 12:19:36.264347 (+164411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.264550 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:36.600931 (+336381us) log.cc:844] Serialized 14 byte log entry
0709 12:19:36.656295 (+ 55364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:36.656373 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:36.656546 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.656672 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.424448 (+767776us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54002da5d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:37.424596 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2745,"prepare.queue_time_us":472653,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":2901,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":377270656,"thread_start_us":388202,"threads_started":2,"wal-append.queue_time_us":375198}
I20260709 12:19:37.432507 13207 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:19:37.430754 15463 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.533030 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 337) took 1076 ms. Trace:
I20260709 12:19:37.472563 15454 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.438995 15368 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:37.448987 13283 rpcz_store.cc:276] 0709 12:19:35.928391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.948054 (+ 19663us) service_pool.cc:224] Handling call
0709 12:19:35.948352 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:36.103684 (+155332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:36.103730 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:36.117699 (+ 13969us) log.cc:844] Serialized 26 byte log entry
0709 12:19:36.464267 (+346568us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:36.464466 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.465279 (+   813us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:36.856304 (+391025us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:37.334501 (+478197us) raft_consensus.cc:1685] finished
0709 12:19:37.334531 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.334823 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20374,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":27113344,"thread_start_us":405059,"threads_started":2,"wal-append.queue_time_us":361992}
W20260709 12:19:37.533571 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 904379us
I20260709 12:19:37.477916 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2462) took 1927 ms. Trace:
I20260709 12:19:37.537590 13209 rpcz_store.cc:276] 0709 12:19:35.550377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.550554 (+   177us) service_pool.cc:224] Handling call
0709 12:19:35.564775 (+ 14221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:35.964190 (+399415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:35.964239 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:35.964302 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:35.964350 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.477642 (+1513292us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54001c5054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:37.477696 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.477844 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917818112}
W20260709 12:19:37.478489 15517 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 1.219s	user 0.011s	sys 0.000s
I20260709 12:19:37.479288 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 332) took 1289 ms. Trace:
W20260709 12:19:37.403420 13840 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.023s	sys 0.047s
I20260709 12:19:37.497598 13203 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:37.520917 13841 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:37.522099 13281 rpcz_store.cc:276] 0709 12:19:36.465392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.402445 (+937053us) service_pool.cc:224] Handling call
0709 12:19:37.402836 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.521403 (+118567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.521652 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99328}
I20260709 12:19:37.533416 13280 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:37.533466 13279 rpcz_store.cc:276] 0709 12:19:36.456820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.402446 (+945626us) service_pool.cc:224] Handling call
0709 12:19:37.402836 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.532685 (+129849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.532952 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17920}
W20260709 12:19:37.534003 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 61934.4us
W20260709 12:19:37.420519 14995 ts_tablet_manager.cc:1469] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Trace:
0709 12:19:23.321710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.328617 (+  6907us) service_pool.cc:224] Handling call
0709 12:19:27.217144 (+3888527us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:28.162953 (+945809us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:28.474423 (+311470us) ts_tablet_manager.cc:919] Shutdown and deleted data from running replica
0709 12:19:28.565304 (+ 90881us) ts_tablet_manager.cc:934] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
0709 12:19:32.070688 (+3505384us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:32.750769 (+680081us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:32.778458 (+ 27689us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:32.907871 (+129413us) tablet_copy_client.cc:463] Replaced tombstoned tablet metadata.
0709 12:19:33.654673 (+746802us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:33.885151 (+230478us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:33.946965 (+ 61814us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:33.964059 (+ 17094us) inbound_call.cc:177] Queueing success response
0709 12:19:35.157020 (+1192961us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:19:36.627320 (+1470300us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:19:36.851996 (+224676us) tablet_replica.cc:261] Starting instrumentation
0709 12:19:36.852649 (+   653us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":22701,"mutex_wait_us":3094462,"raft.queue_time_us":959,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":165,"tablet-copy.queue_time_us":144,"tablet-download-pool.queue_time_us":220,"tablet-download-pool.run_cpu_time_us":1469,"tablet-download-pool.run_wall_time_us":98013,"thread_start_us":1079557,"threads_started":1}
W20260709 12:19:37.538370 13838 connection.cc:256] RPC call timeout handler was delayed by -1.3153623059999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 12:19:37.545480 13838 connection.cc:256] RPC call timeout handler was delayed by -1.2046623060000456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 12:19:37.538586 13252 leader_election.cc:336] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.599s (SENT)
I20260709 12:19:37.559122 13252 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:37.455595 15478 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:37.737663 15549 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:37.690083 15505 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.008s	sys 0.052s
I20260709 12:19:37.519670 15118 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:37.626372 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:37.691260 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 71250.8us
I20260709 12:19:37.742558 15549 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.655364 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:37.726970 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:37.638368 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:19:37.742631 15505 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.009s	sys 0.057s
I20260709 12:19:37.656432 15552 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:37.745577 15552 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.746080 15552 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:37.654968 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:37.653405 15539 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:37.709170 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:37.747633 15539 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.748338 13886 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:37.726341 13133 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:37.749704 15539 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:37.571529 13840 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.023s	sys 0.047s
W20260709 12:19:37.569799 13211 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.006s	sys 0.007s
W20260709 12:19:37.750644 13211 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.008s	sys 0.008s
I20260709 12:19:37.654455 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:37.751961 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.753511 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 390) took 1296 ms. Trace:
I20260709 12:19:37.755292 13209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:37.756096 13209 raft_consensus.cc:606] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Received request to transfer leadership
I20260709 12:19:37.756963 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46516 (request call id 97) took 1204 ms. Trace:
I20260709 12:19:37.757457 13209 rpcz_store.cc:276] 0709 12:19:36.552716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.547467 (+994751us) service_pool.cc:224] Handling call
0709 12:19:37.756892 (+209425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:37.762627 13203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:37.763355 13203 raft_consensus.cc:606] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Received request to transfer leadership
I20260709 12:19:37.574388 15463 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.767673 15326 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:37.768711 15463 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:37.769094 15303 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:37.769330 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:37.537014 15454 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:37.777393 15521 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:37.778306 15186 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:37.710155 15471 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:19:37.780182 13175 leader_election.cc:336] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.512s (SENT)
I20260709 12:19:37.780689 13175 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:37.645478 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 106901us
W20260709 12:19:37.782083 13252 leader_election.cc:336] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.606s (SENT)
W20260709 12:19:37.782393 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 144162us
W20260709 12:19:37.622483 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 101661us
I20260709 12:19:37.783141 13838 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:37.783998 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:37.788357 13883 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:37.789384 13841 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:37.779328 15471 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:37.664520 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:37.789742 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:37.623221 15513 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:37.806494 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 52882.1us
I20260709 12:19:37.621318 15474 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:37.799328 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.573873 15548 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.734445 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:37.750582 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 932204us
I20260709 12:19:37.709096 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:37.573959 15495 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:37.860774 13135 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:37.869737 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 50784.3us
I20260709 12:19:37.777419 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:37.633260 15484 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.875321 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:37.877687 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:37.754001 13211 rpcz_store.cc:276] 0709 12:19:36.457462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.457614 (+   152us) service_pool.cc:224] Handling call
0709 12:19:36.458206 (+   592us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:36.466146 (+  7940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:36.466173 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:36.548242 (+ 82069us) log.cc:844] Serialized 52 byte log entry
0709 12:19:36.612276 (+ 64034us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:37.751125 (+1138849us) log.cc:844] Serialized 14 byte log entry
0709 12:19:37.752779 (+  1654us) log.cc:844] Serialized 14 byte log entry
0709 12:19:37.753146 (+   367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.753214 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:37.753260 (+    46us) raft_consensus.cc:1685] finished
0709 12:19:37.753290 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.753444 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19497,"prepare.queue_time_us":7929,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":14117,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":45175,"thread_start_us":1201697,"threads_started":2,"wal-append.queue_time_us":431020}
W20260709 12:19:37.878741 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 429422us
I20260709 12:19:37.881243 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:37.802482 14978 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:37.901531 13129 raft_consensus.cc:2410] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:37.880259 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:37.542055 15368 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.539458 15499 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.335s
I20260709 12:19:37.905718 13209 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:37.909487 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:37.791030 15530 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:37.816099 15534 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:19:37.962352 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.963691 13252 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:37.867671 15303 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.909584 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:37.973417 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 93254.9us
I20260709 12:19:38.030925 13280 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
W20260709 12:19:37.980042 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 62837.8us
I20260709 12:19:37.980187 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:38.031813 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 68265.5us
I20260709 12:19:37.823355 15539 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.178s
I20260709 12:19:37.876010 13883 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:37.860706 15455 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:37.823654 15186 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:38.016883 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:37.904363 15519 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 12:19:37.901062 15432 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:37.825228 15444 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:37.542878 13278 rpcz_store.cc:276] 0709 12:19:36.190663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.299030 (+1108367us) service_pool.cc:224] Handling call
0709 12:19:37.304373 (+  5343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.475474 (+171101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.479207 (+  3733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:38.033130 13252 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:37.980739 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:37.908190 14978 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.112488 13285 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:37.974598 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:38.001065 15379 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:38.010146 15531 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:19:38.042800 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:37.882340 15548 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:37.973142 15326 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:37.881830 15495 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.096071 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.148419 13134 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:37.901911 13878 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:37.877636 15474 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.108309 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:37.905578 15484 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.113579 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:38.149715 13883 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:38.134577 13279 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 1.
I20260709 12:19:38.001380 13221 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-f042aff5e3084d5e8bd6fcb5335160f5 received from {username='slave'} at 127.0.0.1:36412
I20260709 12:19:38.039965 15511 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:38.148260 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 283179us
I20260709 12:19:37.877282 15513 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.047322 15303 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.150876 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:38.248566 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.249135 13883 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:19:38.249522 13131 raft_consensus.cc:2393] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:38.249912 14998 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.250525 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:38.250413 14998 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:38.152429 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 121296us
I20260709 12:19:38.261559 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:38.263073 13175 leader_election.cc:336] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.748s (SENT)
I20260709 12:19:38.131954 13128 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:38.114341 15467 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.115455 14978 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:38.189181 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.290576 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:38.114189 15534 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:19:38.296198 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.296726 13883 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:38.297997 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:38.042176 15558 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:38.308215 13134 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
W20260709 12:19:38.276016 15496 consensus_meta.cc:287] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.785s	user 0.005s	sys 0.006s
W20260709 12:19:38.272356 15552 consensus_meta.cc:287] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.003s
I20260709 12:19:38.180398 15505 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.331020 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.307585 15467 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:38.362879 15471 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:38.367069 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1309) took 1816 ms. Trace:
I20260709 12:19:38.367540 13204 rpcz_store.cc:276] 0709 12:19:36.551090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.437171 (+886081us) service_pool.cc:224] Handling call
0709 12:19:37.471394 (+ 34223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:37.534004 (+ 62610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.534064 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:37.534689 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:19:37.784994 (+250305us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:38.115954 (+330960us) log.cc:844] Serialized 14 byte log entry
0709 12:19:38.116828 (+   874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.116926 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:38.366848 (+249922us) raft_consensus.cc:1685] finished
0709 12:19:38.366868 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:38.367006 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81960,"raft.queue_time_us":79838,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":16595,"thread_start_us":407900,"threads_started":2,"wal-append.queue_time_us":710455}
I20260709 12:19:38.369280 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.369320 15496 consensus_queue.cc:1059] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:38.370080 13204 raft_consensus.cc:2410] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:38.370957 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.371248 15496 raft_consensus.cc:3055] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:38.372292 15496 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:19:38.373165 13022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 236545us
I20260709 12:19:38.373549 15496 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:38.376271 15561 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:19:38.381080 15495 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:38.385558 15560 log.cc:927] Time spent T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
W20260709 12:19:38.387733 15570 log.cc:927] Time spent T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:19:38.389011 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1310) took 1837 ms. Trace:
I20260709 12:19:38.115749 15444 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:38.315233 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.404662 13209 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:38.297346 13221 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-f042aff5e3084d5e8bd6fcb5335160f5 on tablet f042aff5e3084d5e8bd6fcb5335160f5 with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:38.323223 13132 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:38.101485 15559 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:38.389510 13208 rpcz_store.cc:276] 0709 12:19:36.551340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.476219 (+924879us) service_pool.cc:224] Handling call
0709 12:19:37.476566 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:37.534771 (+ 58205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.534816 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:37.535383 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:19:37.915929 (+380546us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:37.916139 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.916436 (+   297us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:38.388682 (+472246us) raft_consensus.cc:1685] finished
0709 12:19:38.388713 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:38.388928 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57778,"raft.queue_time_us":58761,"spinlock_wait_cycles":15005440,"thread_start_us":296491,"threads_started":1,"wal-append.queue_time_us":599427}
I20260709 12:19:38.410688 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:38.411635 13208 raft_consensus.cc:2393] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:38.412540 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.413674 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:38.392554 13204 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:38.314996 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:38.400000 15454 consensus_meta.cc:287] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.608s	user 0.007s	sys 0.003s
I20260709 12:19:38.415975 13103 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:38.418649 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.180686 15326 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:38.436065 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1307) took 1885 ms. Trace:
I20260709 12:19:38.375285 15496 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:38.438534 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:38.431337 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.439945 13883 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:38.433970 15562 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:38.419360 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:38.444849 13209 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:38.390913 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.437752 13212 rpcz_store.cc:276] 0709 12:19:36.550617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.432977 (+882360us) service_pool.cc:224] Handling call
0709 12:19:37.445611 (+ 12634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:37.472677 (+ 27066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.472730 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:37.479392 (+  6662us) log.cc:844] Serialized 26 byte log entry
0709 12:19:37.752885 (+273493us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:38.142338 (+389453us) log.cc:844] Serialized 14 byte log entry
0709 12:19:38.142843 (+   505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.142947 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:38.435820 (+292873us) raft_consensus.cc:1685] finished
0709 12:19:38.435838 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:38.435989 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36034,"prepare.queue_time_us":648386,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":22459,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":35474,"thread_start_us":629244,"threads_started":2,"wal-append.queue_time_us":954086}
I20260709 12:19:38.448726 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:38.453945 13883 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:38.451242 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:38.451253 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.455806 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.456543 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.457847 13209 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:38.459055 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:38.460251 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 198783us
I20260709 12:19:38.456642 13204 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:38.452044 13175 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:38.469385 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.470253 13212 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:38.471879 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.472703 13134 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:38.473871 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.474795 13134 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:38.430934 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.479769 15586 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.480486 15467 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:38.480362 15586 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.480826 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.391180 15505 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:38.441617 15236 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:38.484704 15586 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:38.468143 15454 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.485833 15548 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:38.488023 13879 raft_consensus.cc:2368] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5.
I20260709 12:19:38.468693 15480 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:19:38.435092 15373 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:19:38.433207 15444 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:38.432066 14998 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:38.433312 15478 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:38.484422 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:38.345927 15552 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.490921 13207 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:38.483407 15562 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:38.494385 15474 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:38.504787 13885 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 4: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:19:38.495747 15516 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 2.238s	user 0.012s	sys 0.021s
I20260709 12:19:38.478385 15499 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:38.493148 13249 connection.cc:256] RPC call timeout handler was delayed by -1.2782649149999088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:19:38.487572 15454 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:38.501304 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.503790 15417 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:38.528286 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2479) took 1891 ms. Trace:
I20260709 12:19:38.528477 15549 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:38.528697 13282 rpcz_store.cc:276] 0709 12:19:36.637238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.451886 (+814648us) service_pool.cc:224] Handling call
0709 12:19:37.520178 (+ 68292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:37.534960 (+ 14782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.535008 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:37.540997 (+  5989us) log.cc:844] Serialized 26 byte log entry
0709 12:19:37.883478 (+342481us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:37.883520 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.883593 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:38.528070 (+644477us) raft_consensus.cc:1685] finished
0709 12:19:38.528089 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:38.528230 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":579,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5370,"thread_start_us":154397,"threads_started":1,"wal-append.queue_time_us":889193}
I20260709 12:19:38.501780 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.530747 13207 raft_consensus.cc:2410] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:38.531847 13207 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:38.531883 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.533051 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.506070 13128 raft_consensus.cc:2376] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4. Re-sending same reply.
I20260709 12:19:38.517714 15345 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:38.518878 13131 raft_consensus.cc:2393] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:19:38.516826 15118 consensus_meta.cc:287] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.774s	user 0.009s	sys 0.000s
I20260709 12:19:38.530613 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.533387 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:38.544709 13279 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:38.507053 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.534768 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:38.529556 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.547897 13280 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:38.548046 13134 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:38.549364 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.551784 13209 raft_consensus.cc:2410] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:38.551997 13134 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:38.553186 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.553879 13134 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:38.541759 13883 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:38.549546 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:38.556715 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:38.556880 15552 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:38.557479 15443 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:38.557562 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:38.557924 15443 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:38.558375 15443 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:38.558445 13278 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:38.560962 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:38.558748 15265 consensus_queue.cc:1059] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:19:38.563318 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.564174 13135 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:38.565018 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:38.504637 15562 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:38.534765 15499 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.447641 15559 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:38.578522 13100 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:38.581825 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.582993 13134 raft_consensus.cc:2410] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:19:38.586869 15551 consensus_meta.cc:287] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.081s	user 0.008s	sys 0.003s
I20260709 12:19:38.588366 15500 raft_consensus.cc:3055] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:38.588967 15500 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:38.589851 15500 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.590921 15500 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:38.570252 15444 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:38.591729 15444 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:38.583132 13280 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:38.573467 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:38.605059 13279 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:38.593771 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.614470 13100 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:38.593209 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:38.615936 15484 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:38.616637 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:38.573370 15499 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:38.571004 15562 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:38.629951 13840 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.051s	sys 0.078s
W20260709 12:19:38.630388 13840 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.051s	sys 0.078s
I20260709 12:19:38.630414 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:38.630713 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 547588us
I20260709 12:19:38.635597 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.636497 13135 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:38.637580 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:38.611817 15444 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:38.638165 13134 raft_consensus.cc:2376] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5. Re-sending same reply.
I20260709 12:19:38.614559 15471 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:38.642195 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.643625 13134 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:38.646327 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.646989 13135 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:38.620875 15484 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:38.623594 15513 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:38.649459 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:38.649818 13283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.026s	sys 0.023s
I20260709 12:19:38.592088 14978 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.650164 13134 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
W20260709 12:19:38.650120 13283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.026s	sys 0.023s
I20260709 12:19:38.653411 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.654569 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:38.587370 15551 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:38.643988 15265 consensus_queue.cc:1059] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:19:38.651320 15505 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:38.671113 13883 raft_consensus.cc:2393] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:38.670360 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.700460 13134 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:38.683845 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.672163 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 344) took 1526 ms. Trace:
I20260709 12:19:38.702693 13283 rpcz_store.cc:276] 0709 12:19:37.146151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.536719 (+390568us) service_pool.cc:224] Handling call
0709 12:19:37.537006 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.537195 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:38.030632 (+493437us) log.cc:844] Serialized 14 byte log entry
0709 12:19:38.671609 (+640977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:38.671685 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:38.671776 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.671877 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:38.672022 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19301,"prepare.queue_time_us":759030,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":19473,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":130,"thread_start_us":881533,"threads_started":2}
I20260709 12:19:38.707573 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.708640 13134 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:19:38.709303 13838 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:38.656203 13878 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
W20260709 12:19:38.659443 13252 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.013s	sys 0.032s
W20260709 12:19:38.715871 13252 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.015s	sys 0.032s
I20260709 12:19:38.714458 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:38.711180 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.669975 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:38.722160 15559 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:38.724530 15551 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:38.716758 15447 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:38.726161 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.728711 13134 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
W20260709 12:19:38.726137 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 693047us
I20260709 12:19:38.741513 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.719291 15558 raft_consensus.cc:697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:38.742250 13135 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:38.743198 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:38.742902 15558 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.743948 13135 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:38.744915 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.716681 15244 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:38.717792 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 507) took 1088 ms. Trace:
I20260709 12:19:38.750214 13252 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:38.746728 13281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.012s	sys 0.031s
I20260709 12:19:38.744534 15551 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.743638 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:38.753036 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:38.753885 13281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.012s	sys 0.031s
I20260709 12:19:38.747555 15244 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.724864 15443 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.758807 13252 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:38.759616 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.779641 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 345) took 1623 ms. Trace:
I20260709 12:19:38.780296 13281 rpcz_store.cc:276] 0709 12:19:37.155935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.543592 (+387657us) service_pool.cc:224] Handling call
0709 12:19:37.543899 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.544191 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:37.992388 (+448197us) log.cc:844] Serialized 14 byte log entry
0709 12:19:38.760472 (+768084us) log.cc:844] Serialized 14 byte log entry
0709 12:19:38.761010 (+   538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:38.761057 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:38.779355 (+ 18298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.779461 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:38.779581 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":225710,"prepare.queue_time_us":860048,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":361,"thread_start_us":977816,"threads_started":2}
I20260709 12:19:38.781239 13252 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:38.754071 15554 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:38.790751 13252 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:19:38.785784 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 333785us
I20260709 12:19:38.794557 13285 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
W20260709 12:19:38.799365 13175 leader_election.cc:336] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.863s (SENT)
I20260709 12:19:38.759079 15513 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:38.749827 13878 rpcz_store.cc:276] 0709 12:19:37.629725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.777101 (+147376us) service_pool.cc:224] Handling call
0709 12:19:38.716958 (+939857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:38.761426 15244 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:38.810174 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:38.818596 13175 leader_election.cc:336] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.922s (SENT)
I20260709 12:19:38.819058 13175 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:38.759172 15551 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:38.821599 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.791322 15583 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:19:38.823372 13175 leader_election.cc:336] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 2.029s (SENT)
I20260709 12:19:38.825356 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.854837 13175 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:38.856879 13136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 1609) took 3329 ms (client timeout 1801 ms). Trace:
I20260709 12:19:38.864806 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.819886 15513 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:38.871250 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 47900.7us
I20260709 12:19:38.871383 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:38.857452 13136 rpcz_store.cc:269] 0709 12:19:35.527710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.527862 (+   152us) service_pool.cc:224] Handling call
0709 12:19:38.856605 (+3328743us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54001383d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:38.856793 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1595013888}
I20260709 12:19:38.854962 15417 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:38.903676 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.856323 15583 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:38.902381 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:38.901175 13175 leader_election.cc:336] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 2.084s (SENT)
I20260709 12:19:38.904932 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:38.904901 13135 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:38.985956 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1620) took 1084 ms. Trace:
I20260709 12:19:39.093963 13130 rpcz_store.cc:276] 0709 12:19:37.901993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.902186 (+   193us) service_pool.cc:224] Handling call
0709 12:19:38.000339 (+ 98153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:38.308920 (+308581us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:38.347046 (+ 38126us) log.cc:844] Serialized 14 byte log entry
0709 12:19:38.748832 (+401786us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:38.753151 (+  4319us) log.cc:844] Serialized 26 byte log entry
0709 12:19:38.753302 (+   151us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:38.753528 (+   226us) log.cc:844] Serialized 14 byte log entry
0709 12:19:38.753722 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.753797 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:38.985638 (+231841us) raft_consensus.cc:1685] finished
0709 12:19:38.985668 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:38.985871 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16793,"prepare.queue_time_us":49841,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":8329,"raft.queue_time_us":151774,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":72182,"spinlock_wait_cycles":9462912,"thread_start_us":589075,"threads_started":2,"wal-append.queue_time_us":441022}
I20260709 12:19:39.097999 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1114) took 1166 ms. Trace:
I20260709 12:19:39.122978 13175 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:39.122812 13132 rpcz_store.cc:276] 0709 12:19:37.931198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.096959 (+1165761us) service_pool.cc:224] Handling call
0709 12:19:39.097324 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:39.097542 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:39.097580 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:39.097637 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:39.097689 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.097759 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.097927 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.128499 13132 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:39.130119 13132 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:39.136938 13136 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:38.869829 15506 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:39.123968 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 333319us
I20260709 12:19:39.143735 13252 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:39.156615 13135 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:19:39.157569 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1621) took 1152 ms. Trace:
I20260709 12:19:39.157975 13135 rpcz_store.cc:276] 0709 12:19:38.005076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.119788 (+1114712us) service_pool.cc:224] Handling call
0709 12:19:39.156287 (+ 36499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:39.157213 (+   926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.157477 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.140977 15557 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:39.161046 15595 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
W20260709 12:19:39.162365 15601 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:19:39.165737 15551 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:38.931411 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.175299 15379 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.177012 13130 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:39.176726 15379 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:39.180126 15379 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:38.900764 14978 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:38.901566 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.182969 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 580) took 1149 ms. Trace:
I20260709 12:19:39.183379 13878 rpcz_store.cc:276] 0709 12:19:38.033055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.828581 (+795526us) service_pool.cc:224] Handling call
0709 12:19:39.182907 (+354326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.184484 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.185813 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.186539 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 583) took 1152 ms. Trace:
W20260709 12:19:38.968837 15594 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 12:19:38.968103 15588 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 12:19:38.989162 15592 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:19:38.987316 15598 log.cc:927] Time spent T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:19:39.186862 13878 rpcz_store.cc:276] 0709 12:19:38.033831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.185540 (+1151709us) service_pool.cc:224] Handling call
0709 12:19:39.186486 (+   946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.255174 13135 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:19:39.271514 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 370334us
W20260709 12:19:39.288100 13175 leader_election.cc:336] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 2.106s (SENT)
I20260709 12:19:38.955099 15562 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:39.293826 13130 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:39.298071 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1121) took 1117 ms. Trace:
I20260709 12:19:39.298498 13130 rpcz_store.cc:276] 0709 12:19:38.181001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.122773 (+941772us) service_pool.cc:224] Handling call
0709 12:19:39.176846 (+ 54073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:39.297741 (+120895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.297998 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.300159 13130 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:19:39.302834 15583 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:39.315945 15605 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.316687 15605 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:39.291795 15345 consensus_meta.cc:287] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.001s
W20260709 12:19:39.325594 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 181960us
W20260709 12:19:39.330070 13286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42730 (request call id 335) took 3001 ms (client timeout 1794 ms). Trace:
W20260709 12:19:39.330384 13133 consensus_meta.cc:287] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.001s
I20260709 12:19:39.330787 13133 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
W20260709 12:19:39.330516 13286 rpcz_store.cc:269] 0709 12:19:36.328511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.496904 (+168393us) service_pool.cc:224] Handling call
0709 12:19:39.329854 (+2832950us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b54001adbd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:39.329964 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49608064}
I20260709 12:19:39.331468 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 1614) took 1540 ms. Trace:
I20260709 12:19:39.331825 13133 rpcz_store.cc:276] 0709 12:19:37.791146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.810214 (+ 19068us) service_pool.cc:224] Handling call
0709 12:19:38.743399 (+933185us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b5800001298. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:39.331388 (+587989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20102912}
I20260709 12:19:39.334996 15529 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:39.335824 15529 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:39.343624 15454 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.344530 15454 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:39.345322 15444 consensus_meta.cc:287] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.000s
I20260709 12:19:39.345772 15444 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:39.347909 15444 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:39.347990 13887 raft_consensus.cc:2410] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:39.348497 15444 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:39.355836 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:39.356549 13128 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:39.358233 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:39.358942 13133 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:39.359163 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:39.359900 13130 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:39.360014 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:39.360607 13133 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:39.360667 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:39.361811 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:39.362658 13128 raft_consensus.cc:2393] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:19:39.321623 15594 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:19:39.365188 13249 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:39.375859 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:39.377516 13249 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:39.368680 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:39.339102 15529 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:39.349117 15444 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:19:39.387871 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:39.388597 13130 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:39.358920 15244 consensus_meta.cc:287] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.001s
I20260709 12:19:39.398013 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:39.398842 13133 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
W20260709 12:19:39.399832 15499 consensus_meta.cc:287] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.762s	user 0.011s	sys 0.001s
I20260709 12:19:39.401111 13211 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:39.403724 13130 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:39.404520 13103 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:39.409785 13838 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:39.396636 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:39.410017 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:39.417402 13211 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:39.417758 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:39.418792 13130 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:39.419269 13103 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:39.400916 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:39.421581 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:39.408465 15385 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:39.425519 15484 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:39.429569 15484 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:39.429543 15385 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:39.430285 15484 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:39.430933 15385 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:39.397465 15244 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:39.434171 15244 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:39.401563 15499 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:39.425680 15444 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:39.426466 15609 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:39.435653 15444 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.435863 15609 raft_consensus.cc:697] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:39.436185 15444 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:39.436487 15604 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:19:39.436810 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2471) took 1525 ms. Trace:
I20260709 12:19:39.436939 15609 consensus_queue.cc:237] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:39.437875 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:39.438464 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:39.424937 15600 log.cc:927] Time spent T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.173s	user 0.004s	sys 0.000s
I20260709 12:19:39.439950 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2479) took 1458 ms. Trace:
I20260709 12:19:39.409569 15345 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:19:39.423946 15379 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:39.440429 13207 rpcz_store.cc:276] 0709 12:19:37.981138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.787469 (+806331us) service_pool.cc:224] Handling call
0709 12:19:38.787795 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:38.788120 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.792477 (+  4357us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:38.807456 (+ 14979us) log.cc:844] Serialized 26 byte log entry
0709 12:19:39.139365 (+331909us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:39.139419 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.139694 (+   275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:39.340530 (+200836us) spinlock_profiling.cc:243] Waited 8.34 ms on lock 0x7b4800002dd8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f9db6aa1 00007f70f9dadb37 00007f70f9dad9ca 00007f70f9ea526f 00007f70f9ea4f37 00007f70f9eb955c 00007f70f9eb9508 00007f70f9eb9488 00007f70f9eb9443 00007f70f9eb86ec 00007f70f8de2a96
0709 12:19:39.439645 (+ 99115us) raft_consensus.cc:1685] finished
0709 12:19:39.439667 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.439887 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":69573,"raft.run_wall_time_us":550499,"spinlock_wait_cycles":19182848,"thread_start_us":283155,"threads_started":1,"wal-append.queue_time_us":467084}
I20260709 12:19:39.437299 13212 rpcz_store.cc:276] 0709 12:19:37.911089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.471038 (+559949us) service_pool.cc:224] Handling call
0709 12:19:38.492010 (+ 20972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:38.492205 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:38.495751 (+  3546us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.435958 (+940207us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b1800156820. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d1ac0a 00007f70fb45a219 00007f70f1da2a40 00007f70f1d9d4e4 00007f70f1d9d455 00007f70f88853c7 00007f70f4e979a7 00007f70f4ea70bf 00007f70f4ea7038
0709 12:19:39.436251 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.436456 (+   205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:39.436507 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:39.436552 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.436620 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.436741 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9597,"prepare.queue_time_us":633927,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":88,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":5446,"spinlock_wait_cycles":7369600,"thread_start_us":314948,"threads_started":1,"wal-append.queue_time_us":673096}
I20260709 12:19:39.428874 13211 raft_consensus.cc:1240] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:39.456866 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2485) took 1084 ms. Trace:
I20260709 12:19:39.457353 13211 rpcz_store.cc:276] 0709 12:19:38.372182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.427894 (+1055712us) service_pool.cc:224] Handling call
0709 12:19:39.428606 (+   712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:39.456522 (+ 27916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.456794 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.446480 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2486) took 1073 ms. Trace:
I20260709 12:19:39.461228 13207 rpcz_store.cc:276] 0709 12:19:38.372618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.445513 (+1072895us) service_pool.cc:224] Handling call
0709 12:19:39.445892 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:39.446113 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:39.446151 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:39.446196 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:39.446228 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.446282 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.446413 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.429266 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.483711 13207 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:19:39.439342 13880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 499) took 1815 ms (client timeout 2029 ms). Trace:
I20260709 12:19:39.484370 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1323) took 1069 ms. Trace:
I20260709 12:19:39.427011 13878 raft_consensus.cc:2376] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5. Re-sending same reply.
W20260709 12:19:39.474823 15236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.028s	sys 0.024s
I20260709 12:19:39.483167 13882 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:39.487937 15236 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:19:39.488005 13882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 506) took 1858 ms (client timeout 1747 ms). Trace:
I20260709 12:19:39.488438 15236 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:39.488502 13882 rpcz_store.cc:269] 0709 12:19:37.629443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.744383 (+114940us) service_pool.cc:224] Handling call
0709 12:19:39.429099 (+1684716us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:39.487923 (+ 58824us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58250624}
I20260709 12:19:39.488924 15236 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:39.490072 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:39.486397 13880 rpcz_store.cc:269] 0709 12:19:37.624322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.633272 (+  8950us) service_pool.cc:224] Handling call
0709 12:19:39.438288 (+1805016us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:39.439277 (+   989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17076096}
I20260709 12:19:39.482141 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2469) took 1571 ms. Trace:
I20260709 12:19:39.492657 13208 rpcz_store.cc:276] 0709 12:19:37.910598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.465722 (+555124us) service_pool.cc:224] Handling call
0709 12:19:38.466057 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:38.466333 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.466371 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:38.502133 (+ 35762us) log.cc:844] Serialized 26 byte log entry
0709 12:19:38.863885 (+361752us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:19:38.863923 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.863998 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:39.399988 (+535990us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:39.479659 (+ 79671us) raft_consensus.cc:1685] finished
0709 12:19:39.479684 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.482044 (+  2360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5487360,"thread_start_us":295445,"threads_started":1,"wal-append.queue_time_us":601899}
I20260709 12:19:39.465140 15244 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:19:39.490762 13882 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:39.517132 15499 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:39.484741 13207 rpcz_store.cc:276] 0709 12:19:38.414513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.483029 (+1068516us) service_pool.cc:224] Handling call
0709 12:19:39.483372 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:39.484127 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.484316 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.520445 13207 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:19:39.520593 13885 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 505) took 1891 ms (client timeout 1818 ms). Trace:
I20260709 12:19:39.521771 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 503) took 1896 ms. Trace:
W20260709 12:19:39.547442 13885 rpcz_store.cc:269] 0709 12:19:37.629155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.744408 (+115253us) service_pool.cc:224] Handling call
0709 12:19:38.451109 (+706701us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:39.520372 (+1069263us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b54005eae54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:39.520523 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172237440}
I20260709 12:19:39.547569 13887 rpcz_store.cc:276] 0709 12:19:37.625584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.654653 (+ 29069us) service_pool.cc:224] Handling call
0709 12:19:39.521582 (+1866929us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54005b3e54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:39.521714 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3680925952}
I20260709 12:19:39.549376 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.550889 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:39.522223 13841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.673s (SENT) [suppressed 41 similar messages]
I20260709 12:19:39.496351 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.519223 15244 consensus_queue.cc:1059] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:19:39.525976 15524 raft_consensus.cc:3055] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:39.527972 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.528854 15484 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:39.559368 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 181929us
W20260709 12:19:39.533051 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 205319us
I20260709 12:19:39.552721 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 578) took 1520 ms. Trace:
W20260709 12:19:39.553834 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 264134us
I20260709 12:19:39.555073 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.531507 15591 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:39.563839 13887 rpcz_store.cc:276] 0709 12:19:38.032534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.550606 (+1518072us) service_pool.cc:224] Handling call
0709 12:19:39.552641 (+  2035us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.566184 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.556231 15524 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:39.568323 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.557394 13880 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 1.
I20260709 12:19:39.580439 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 575) took 1548 ms. Trace:
I20260709 12:19:39.581045 13887 rpcz_store.cc:276] 0709 12:19:38.031783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.568069 (+1536286us) service_pool.cc:224] Handling call
0709 12:19:39.580375 (+ 12306us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:39.558751 15518 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.304s	user 0.009s	sys 0.037s
I20260709 12:19:39.558466 15519 raft_consensus.cc:3055] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:39.562345 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:39.582276 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.579737 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.586620 13887 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 4: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:39.579257 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:39.563460 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.588025 13252 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:39.590159 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.590988 13885 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:39.591585 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 585) took 1128 ms. Trace:
I20260709 12:19:39.591974 13885 rpcz_store.cc:276] 0709 12:19:38.463188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.589841 (+1126653us) service_pool.cc:224] Handling call
0709 12:19:39.591512 (+  1671us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.593127 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:39.595067 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:39.595918 13887 raft_consensus.cc:2368] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:39.594900 15340 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:39.600309 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.560951 15492 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:19:39.600749 13878 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:39.596203 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 586) took 1105 ms. Trace:
I20260709 12:19:39.601912 13880 rpcz_store.cc:276] 0709 12:19:38.483579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.492162 (+1008583us) service_pool.cc:224] Handling call
0709 12:19:39.588951 (+ 96789us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.602483 13887 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:39.603096 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.601857 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.600270 15340 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.604440 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.604717 15340 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:39.604990 15484 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:39.605789 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.606369 15607 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:39.606885 15607 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:39.578702 13882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 577) took 1546 ms. Trace:
I20260709 12:19:39.607548 15607 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:39.607719 13882 rpcz_store.cc:276] 0709 12:19:38.032286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.527669 (+1495383us) service_pool.cc:224] Handling call
0709 12:19:39.568606 (+ 40937us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:39.608841 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.600452 15387 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:39.607024 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.603559 13252 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:39.589349 15518 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.330s	user 0.009s	sys 0.038s
I20260709 12:19:39.609933 13882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b675043435441bb980d9a219c4d3450"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:19:39.585179 15549 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.604477 13878 raft_consensus.cc:2393] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 4: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:19:39.614884 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 190483us
I20260709 12:19:39.617897 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:39.589150 15519 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:39.622591 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:39.612313 15387 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.620733 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:39.626293 13205 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:39.615530 15492 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.625066 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:39.632902 13175 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:39.614465 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:39.625293 13838 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:39.603542 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:39.635289 13887 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:39.635354 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:39.634526 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:39.641834 13175 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:39.624127 13882 raft_consensus.cc:606] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:19:39.626389 15529 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:39.624303 15562 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:39.630121 15387 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:39.657932 13887 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:19:39.630139 15525 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:39.660921 13887 pending_rounds.cc:85] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Aborting all ops after (but not including) 4
I20260709 12:19:39.661312 13887 pending_rounds.cc:107] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:19:39.639737 15506 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:39.637485 15118 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:39.661725 13887 raft_consensus.cc:2889] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:39.677016 13205 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:39.622373 15549 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:39.654467 13882 raft_consensus.cc:614] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:39.654570 15499 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:39.645262 15557 raft_consensus.cc:2764] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:19:39.619221 15524 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:39.641215 15236 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:39.686736 15118 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.730809 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 508) took 2100 ms. Trace:
I20260709 12:19:39.637485 15492 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:39.662643 15525 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:39.685781 15345 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:39.757773 13887 rpcz_store.cc:276] 0709 12:19:37.630016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.640265 (+2010249us) service_pool.cc:224] Handling call
0709 12:19:39.640998 (+   733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:39.730396 (+ 89398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.730718 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:39.744036 15613 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:19:39.759102 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 236879us
I20260709 12:19:39.663357 15614 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:39.687467 15506 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.688503 13103 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:39.736515 15499 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.662180 15519 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.190912 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2490) took 1700 ms. Trace:
I20260709 12:19:40.357580 13209 rpcz_store.cc:276] 0709 12:19:38.490871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.506695 (+ 15824us) service_pool.cc:224] Handling call
0709 12:19:40.142515 (+1635820us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b54002d4954. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:40.190835 (+ 48320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12562816}
W20260709 12:19:40.213861 13175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.052s	sys 0.052s
W20260709 12:19:40.360205 13175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.055s	sys 0.056s
W20260709 12:19:40.360582 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 707082us
W20260709 12:19:40.158905 13252 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.040s	sys 0.068s
I20260709 12:19:40.311800 13208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
W20260709 12:19:40.235054 13838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.013s	sys 0.091s
W20260709 12:19:40.362409 13838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.018s	sys 0.091s
W20260709 12:19:40.361922 13252 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.045s	sys 0.074s
W20260709 12:19:39.857502 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.140671 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:40.364051 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 760535us
I20260709 12:19:40.364373 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2484) took 2216 ms. Trace:
I20260709 12:19:40.368471 13887 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:19:40.362773 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 728359us
I20260709 12:19:40.365092 13210 rpcz_store.cc:276] 0709 12:19:38.148259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.810152 (+661893us) service_pool.cc:224] Handling call
0709 12:19:38.810466 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:38.815399 (+  4933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.815475 (+    76us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:38.823783 (+  8308us) log.cc:844] Serialized 52 byte log entry
0709 12:19:39.323937 (+500154us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:39.655797 (+331860us) log.cc:844] Serialized 14 byte log entry
0709 12:19:40.129563 (+473766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.129677 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:40.129744 (+    67us) raft_consensus.cc:1685] finished
0709 12:19:40.129762 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.364292 (+234530us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158175,"prepare.queue_time_us":153827,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":105,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":10614,"spinlock_wait_cycles":1700608,"thread_start_us":1107757,"threads_started":3,"wal-append.queue_time_us":552549}
I20260709 12:19:39.757294 13878 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:40.362476 13208 raft_consensus.cc:606] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:40.369520 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 753) took 2453 ms. Trace:
I20260709 12:19:40.377902 13887 rpcz_store.cc:276] 0709 12:19:37.915796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.367539 (+2451743us) service_pool.cc:224] Handling call
0709 12:19:40.367986 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.369217 (+  1231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.369444 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.374240 13841 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:19:40.328143 15617 log.cc:927] Time spent T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:19:40.337926 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.376122 13838 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:19:39.755911 15606 log.cc:927] Time spent T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:19:40.122905 15386 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.367352 15506 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:40.268160 15532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.026s	sys 0.022s
I20260709 12:19:39.738564 15616 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:40.357159 15345 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:40.282783 15551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.017s	sys 0.032s
W20260709 12:19:40.282609 15529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.008s	sys 0.005s
W20260709 12:19:40.315868 15612 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.689s	user 0.000s	sys 0.001s
I20260709 12:19:40.381134 15519 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:40.369155 15614 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:40.369032 15525 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:40.387735 13885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.024s	sys 0.035s
W20260709 12:19:40.404631 13885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.024s	sys 0.036s
I20260709 12:19:40.393096 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 754) took 2477 ms. Trace:
I20260709 12:19:40.376549 15524 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:40.190532 15609 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:40.214183 15340 consensus_meta.cc:287] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.609s	user 0.004s	sys 0.006s
I20260709 12:19:39.762221 15118 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:40.384675 13882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 751) took 2467 ms. Trace:
I20260709 12:19:40.369987 15499 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:40.405007 13887 rpcz_store.cc:276] 0709 12:19:37.916059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.379647 (+2463588us) service_pool.cc:224] Handling call
0709 12:19:40.392434 (+ 12787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.392665 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.392716 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:40.392776 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:40.392823 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.392895 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.393025 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:40.399855 15529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.011s	sys 0.006s
W20260709 12:19:40.400244 15551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.017s	sys 0.033s
I20260709 12:19:40.416522 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:40.394949 15532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.026s	sys 0.034s
W20260709 12:19:40.409781 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:40.410322 15379 consensus_meta.cc:287] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.945s	user 0.007s	sys 0.003s
W20260709 12:19:40.425868 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 64644.6us
I20260709 12:19:40.399791 15345 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:40.400784 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 511) took 2764 ms. Trace:
I20260709 12:19:40.447458 13208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:40.408811 15614 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:40.448413 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 74281us
I20260709 12:19:40.451500 15632 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:40.418485 13882 rpcz_store.cc:276] 0709 12:19:37.915228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.254303 (+2339075us) service_pool.cc:224] Handling call
0709 12:19:40.337764 (+ 83461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.354351 (+ 16587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.355528 (+  1177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:40.357594 (+  2066us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:40.358268 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.375785 (+ 17517us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.382741 (+  6956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.395663 15386 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.459934 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:40.439343 15549 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:40.467510 13884 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 496) took 2836 ms (client timeout 1748 ms). Trace:
W20260709 12:19:40.488288 13884 rpcz_store.cc:269] 0709 12:19:37.623260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.653996 (+ 30736us) service_pool.cc:224] Handling call
0709 12:19:40.416362 (+2762366us) spinlock_profiling.cc:243] Waited 964 us on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:40.459468 (+ 43106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2216832}
I20260709 12:19:40.489913 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:40.490700 13884 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
W20260709 12:19:40.467411 13175 connection.cc:256] RPC call timeout handler was delayed by -1.6312169870000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 12:19:40.458616 13208 raft_consensus.cc:606] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
W20260709 12:19:40.491828 13175 leader_election.cc:336] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 2.664s (SENT)
I20260709 12:19:40.416682 15236 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:40.492792 13175 leader_election.cc:336] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 2.975s (SENT)
I20260709 12:19:40.460523 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 755) took 2544 ms. Trace:
I20260709 12:19:40.493445 13887 rpcz_store.cc:276] 0709 12:19:37.916301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.437919 (+2521618us) service_pool.cc:224] Handling call
0709 12:19:40.459876 (+ 21957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.460105 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.460144 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:40.460199 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:40.460247 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.460318 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.460451 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:40.494052 13175 connection.cc:256] RPC call timeout handler was delayed by -1.0911630949999562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
I20260709 12:19:40.494859 13887 raft_consensus.cc:1240] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:40.418702 15340 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.494926 13208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9377aea669547028ee8449f654c60b7"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:40.500376 13208 raft_consensus.cc:606] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:40.500813 13208 raft_consensus.cc:614] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:40.439785 15529 raft_consensus.cc:697] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:40.505540 15529 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.498621 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:40.507937 13209 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:40.508855 15386 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.509091 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:40.509876 15454 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:40.510250 13209 raft_consensus.cc:2410] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:40.471745 15379 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:40.507946 15629 log.cc:927] Time spent T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:19:40.461221 15532 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:40.499558 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:40.500301 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:40.513170 13210 raft_consensus.cc:2368] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6.
I20260709 12:19:40.513105 13206 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:40.513983 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:40.514312 13206 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:19:40.496438 13841 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:40.516515 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:19:40.518502 15607 consensus_meta.cc:287] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.910s	user 0.004s	sys 0.004s
I20260709 12:19:40.519668 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:40.520289 13882 raft_consensus.cc:2376] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2. Re-sending same reply.
I20260709 12:19:40.521974 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 756) took 2585 ms. Trace:
I20260709 12:19:40.522706 15525 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.523907 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:40.511307 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:40.503283 15492 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.525029 15525 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.484838 15632 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.504222 15340 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.487602 15633 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:40.526979 15632 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.459802 13878 rpcz_store.cc:276] 0709 12:19:37.630843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.657027 (+2026184us) service_pool.cc:224] Handling call
0709 12:19:39.735031 (+ 78004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.381356 (+646325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.395178 (+ 13822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.518929 15607 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:40.497170 15622 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 12:19:40.484328 15513 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 12:19:40.542040 15444 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.105s	user 0.009s	sys 0.003s
I20260709 12:19:40.542599 15444 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:40.417200 15609 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.545156 15609 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.500075 15549 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:19:40.546546 13033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42062 (request call id 293) took 8856 ms. Trace:
I20260709 12:19:40.547379 15634 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:19:40.548313 13879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 501) took 2923 ms (client timeout 2106 ms). Trace:
W20260709 12:19:40.548724 13879 rpcz_store.cc:269] 0709 12:19:37.624987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.626035 (+  1048us) service_pool.cc:224] Handling call
0709 12:19:40.548092 (+2922057us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b5400691ed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:40.548230 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712402304}
I20260709 12:19:40.550140 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:40.550971 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:40.524772 13205 raft_consensus.cc:2410] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:40.522531 13887 rpcz_store.cc:276] 0709 12:19:37.916527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.494353 (+2577826us) service_pool.cc:224] Handling call
0709 12:19:40.494687 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.501867 (+  7180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.502121 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.561482 13886 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:40.501842 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:40.567833 13887 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:40.589673 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 523) took 1228 ms. Trace:
I20260709 12:19:40.589731 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 509) took 2959 ms. Trace:
I20260709 12:19:40.590096 13887 rpcz_store.cc:276] 0709 12:19:39.361097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.565907 (+1204810us) service_pool.cc:224] Handling call
0709 12:19:40.566274 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.589396 (+ 23122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.589597 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:40.568116 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.546934 13033 rpcz_store.cc:276] 0709 12:19:31.690168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.691461 (+  1293us) service_pool.cc:224] Handling call
0709 12:19:40.546481 (+8855020us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:34.582150 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:34.873803 (+291653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:34.873874 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:19:34.873925 (+    51us) tablet.cc:662] Decoding operations
0709 12:19:35.040058 (+166133us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:35.040121 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:35.040149 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:19:35.230681 (+190532us) tablet.cc:701] Row locks acquired
0709 12:19:35.233850 (+  3169us) write_op.cc:260] PREPARE: finished
0709 12:19:35.237893 (+  4043us) write_op.cc:270] Start()
0709 12:19:35.238064 (+   171us) write_op.cc:276] Timestamp: P: 1783599575237820 usec, L: 0
0709 12:19:35.238084 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:19:35.243819 (+  5735us) log.cc:844] Serialized 5191 byte log entry
0709 12:19:36.047929 (+804110us) op_driver.cc:464] REPLICATION: finished
0709 12:19:36.408046 (+360117us) write_op.cc:301] APPLY: starting
0709 12:19:36.408141 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:36.408474 (+   333us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:36.487922 (+ 79448us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:36.534884 (+ 46962us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:36.535187 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:19:36.535241 (+    54us) write_op.cc:312] APPLY: finished
0709 12:19:36.612979 (+ 77738us) log.cc:844] Serialized 95 byte log entry
0709 12:19:36.613179 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:36.613311 (+   132us) write_op.cc:454] Released schema lock
0709 12:19:36.613378 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:36.613777 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:36.613812 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":359808,"apply.run_cpu_time_us":4801,"apply.run_wall_time_us":205730,"num_ops":13,"prepare.queue_time_us":127224,"prepare.run_cpu_time_us":24112,"prepare.run_wall_time_us":757675,"raft.queue_time_us":366017,"raft.run_cpu_time_us":19966,"raft.run_wall_time_us":139334,"replication_time_us":809670,"thread_start_us":483567,"threads_started":4,"wal-append.queue_time_us":80611,"wal-append.run_cpu_time_us":31583,"wal-append.run_wall_time_us":2289553}]]}
I20260709 12:19:40.570740 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2488) took 2197 ms. Trace:
I20260709 12:19:40.583802 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:40.592118 13211 raft_consensus.cc:606] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Received request to transfer leadership
I20260709 12:19:40.593340 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:40.591884 13212 rpcz_store.cc:276] 0709 12:19:38.373048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.475466 (+1102418us) service_pool.cc:224] Handling call
0709 12:19:39.484223 (+  8757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:39.484629 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:39.484669 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:39.494400 (+  9731us) log.cc:844] Serialized 26 byte log entry
0709 12:19:39.754875 (+260475us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:40.215093 (+460218us) log.cc:844] Serialized 14 byte log entry
0709 12:19:40.530127 (+315034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.530238 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:40.568032 (+ 37794us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18003c63a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:19:40.570398 (+  2366us) raft_consensus.cc:1685] finished
0709 12:19:40.570515 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.570677 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":480555,"raft.queue_time_us":236510,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":8535,"spinlock_wait_cycles":49559552,"thread_start_us":361341,"threads_started":2,"wal-append.queue_time_us":834458}
I20260709 12:19:40.595311 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:40.571862 15506 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:40.566260 15607 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:40.572142 15345 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.565624 15583 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:40.577128 15387 consensus_meta.cc:287] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.891s	user 0.008s	sys 0.002s
I20260709 12:19:40.573736 15118 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:40.579990 15643 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.584328 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:40.584626 13205 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:40.585709 15532 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:40.585943 15379 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.654649 15532 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:40.655273 15532 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:40.654827 15379 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.656073 15303 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.656883 15643 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:40.657400 15591 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:40.657644 15379 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:40.657936 15591 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:40.586232 13880 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEARNER]: Advancing to term 5
I20260709 12:19:40.575565 15632 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:40.586423 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 90072.7us
I20260709 12:19:40.586998 15633 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:40.471482 15638 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 12:19:40.590169 13885 rpcz_store.cc:276] 0709 12:19:37.630283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.641666 (+2011383us) service_pool.cc:224] Handling call
0709 12:19:39.642089 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:39.646543 (+  4454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:39.646593 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:39.657280 (+ 10687us) log.cc:844] Serialized 26 byte log entry
0709 12:19:40.405036 (+747756us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:40.428291 (+ 23255us) log.cc:844] Serialized 14 byte log entry
0709 12:19:40.589516 (+161225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.589567 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:40.589594 (+    27us) raft_consensus.cc:1685] finished
0709 12:19:40.589603 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.589688 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3945,"prepare.queue_time_us":95511,"raft.queue_time_us":247299,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":14411,"thread_start_us":836679,"threads_started":3,"wal-append.queue_time_us":732613}
I20260709 12:19:40.680651 13887 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 2 LEARNER]: Advancing to term 3
W20260709 12:19:40.598848 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 97077.8us
I20260709 12:19:40.681090 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:40.605270 15644 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:40.591286 13102 connection.cc:256] RPC call timeout handler was delayed by -2.703853067999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
I20260709 12:19:40.678593 15632 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.679605 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:40.682399 13210 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:40.599922 15616 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:40.682160 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:40.604562 15609 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:40.685937 13102 connection.cc:256] RPC call timeout handler was delayed by -2.6471530680000797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
I20260709 12:19:40.701799 13277 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:40.689291 13281 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:40.696184 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:40.699066 13286 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:19:40.660126 15607 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:40.699594 13102 connection.cc:256] RPC call timeout handler was delayed by -2.6120530680000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 12:19:40.719843 13208 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:40.687803 13282 raft_consensus.cc:2393] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:40.681090 13885 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:40.709250 13205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:40.709583 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:40.659324 15643 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:40.680208 15633 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.721251 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 764) took 1320 ms. Trace:
I20260709 12:19:40.684762 15236 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:40.723024 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 45731.2us
I20260709 12:19:40.685743 15644 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:40.728147 13885 rpcz_store.cc:276] 0709 12:19:39.401321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.680669 (+1279348us) service_pool.cc:224] Handling call
0709 12:19:40.680926 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.720989 (+ 40063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.721192 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.729712 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:40.730736 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:40.721269 13205 raft_consensus.cc:606] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Received request to transfer leadership
I20260709 12:19:40.697888 15631 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:40.642025 15387 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:40.736073 13281 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:40.737068 13208 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:40.701526 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 515) took 2660 ms. Trace:
I20260709 12:19:40.706378 15444 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:40.742389 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:40.742996 13280 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:40.720228 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:40.739264 13887 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 3 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:40.643777 15583 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:40.737303 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:40.746711 13286 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:40.746841 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 594) took 1356 ms. Trace:
I20260709 12:19:40.736261 13282 raft_consensus.cc:2410] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:19:40.744897 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:40.747318 13887 rpcz_store.cc:276] 0709 12:19:39.390831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.637308 (+1246477us) service_pool.cc:224] Handling call
0709 12:19:40.680505 (+ 43197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.746594 (+ 66089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.746786 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.728924 15637 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:40.749897 15638 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:40.750509 15638 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:40.750639 15506 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:40.731911 15633 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:40.752591 13887 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:40.753222 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 768) took 1333 ms. Trace:
I20260709 12:19:40.753490 15583 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:40.705866 15609 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.757516 15609 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.760475 15118 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:40.760771 15499 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.761870 13137 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:40.762665 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1113) took 2834 ms. Trace:
I20260709 12:19:40.763036 15345 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:40.762967 13137 rpcz_store.cc:276] 0709 12:19:37.928542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.930211 (+  1669us) service_pool.cc:224] Handling call
0709 12:19:40.761505 (+2831294us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b5800001298. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e66fc0 00007f70f9e51929 00007f70f9e513d2 00007f70f33c8bd4
0709 12:19:40.761701 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.762423 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.762607 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102080896}
I20260709 12:19:40.751061 15638 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:40.764386 13211 raft_consensus.cc:2393] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:40.686501 15614 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.753518 13887 rpcz_store.cc:276] 0709 12:19:39.419899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.749046 (+1329147us) service_pool.cc:224] Handling call
0709 12:19:40.752415 (+  3369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.752980 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.753157 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.761937 15632 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.766270 13841 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:40.737979 15644 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:40.727051 15607 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.780066 13100 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:19:40.780655 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 1.0922e+06us
I20260709 12:19:40.789739 13286 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
W20260709 12:19:40.781170 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.738227 15236 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:40.781710 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:40.734377 15643 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:19:40.782310 15379 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:40.771716 15385 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.807008 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:40.808583 13252 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:40.794596 13129 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:40.767539 15637 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:40.778128 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:40.808751 13134 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:40.796155 13137 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:40.776547 15463 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.792737 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:40.826922 13286 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:40.809741 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:40.828586 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:40.809724 13252 leader_election.cc:400] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6.
I20260709 12:19:40.829785 13252 leader_election.cc:403] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:19:40.839898 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:40.841717 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:40.819945 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:40.844202 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:40.844343 13206 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:40.844805 13134 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:40.783722 15499 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.845742 13282 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:40.845890 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:40.851276 13130 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:40.847851 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:40.852849 13252 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:40.850597 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:40.854225 13137 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:40.777439 15652 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.790905 15345 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:19:40.856837 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:40.829849 13278 raft_consensus.cc:2410] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:19:40.884053 13282 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:40.845276 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:40.856680 13129 raft_consensus.cc:2393] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:40.864228 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:40.868557 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:40.886045 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:40.886724 13129 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:40.887120 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 587) took 2326 ms. Trace:
I20260709 12:19:40.887225 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:40.887581 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:40.855368 15513 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6.
I20260709 12:19:40.826648 15524 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.827211 15492 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:40.874155 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:40.878194 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:40.903631 13205 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:40.835042 15340 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:40.856782 13136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1131) took 2360 ms. Trace:
I20260709 12:19:40.904163 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 766) took 1497 ms. Trace:
I20260709 12:19:40.826398 15609 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:40.772636 15616 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.889756 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:40.908179 13130 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:40.891798 13282 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:40.892565 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:40.826246 15385 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.893332 15521 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:40.865983 15444 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:19:40.867380 15506 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 12:19:40.918568 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 70273.6us
I20260709 12:19:40.905009 15640 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:40.894256 15387 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:40.900190 15652 raft_consensus.cc:697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:40.898490 15650 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:19:40.827284 15525 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:19:40.858466 15637 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.826891 15632 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:19:40.866185 15583 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:40.868014 15634 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:19:40.904788 13885 rpcz_store.cc:276] 0709 12:19:39.406679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.739619 (+1332940us) service_pool.cc:224] Handling call
0709 12:19:40.739939 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.740165 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:40.745970 (+  5805us) log.cc:844] Serialized 14 byte log entry
0709 12:19:40.903666 (+157696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:40.903738 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:40.903811 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.903905 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.904088 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5637,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":186,"thread_start_us":157159,"threads_started":1}
I20260709 12:19:40.846150 15463 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:40.890254 13134 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:40.863533 15499 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:19:40.887614 13879 rpcz_store.cc:276] 0709 12:19:38.560460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.549502 (+1989042us) service_pool.cc:224] Handling call
0709 12:19:40.549845 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:40.679177 (+129332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.679209 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:40.679776 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:19:40.868471 (+188695us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:40.868517 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.868585 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:40.886913 (+ 18328us) raft_consensus.cc:1685] finished
0709 12:19:40.886934 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.887063 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83078,"raft.queue_time_us":151686,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":22767,"thread_start_us":179233,"threads_started":1,"wal-append.queue_time_us":205307}
I20260709 12:19:40.893858 13129 raft_consensus.cc:2410] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:40.893914 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:40.904582 13136 rpcz_store.cc:276] 0709 12:19:38.496226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.137930 (+641704us) service_pool.cc:224] Handling call
0709 12:19:39.138227 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:39.138455 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:39.402032 (+263577us) log.cc:844] Serialized 14 byte log entry
0709 12:19:40.140005 (+737973us) log.cc:844] Serialized 14 byte log entry
0709 12:19:40.758892 (+618887us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b180036e980. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d1ac0a 00007f70fb45a219 00007f70f1da2a40 00007f70f1d9d4e4 00007f70f1d9d455 00007f70f4e85060 00007f70f4e97716 00007f70f4ea8287 00007f70f4ea8208
0709 12:19:40.856372 (+ 97480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:40.856423 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:40.856558 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.856619 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.856730 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58080,"prepare.queue_time_us":642486,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":667929,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":5869,"spinlock_wait_cycles":112678784,"thread_start_us":671544,"threads_started":4,"wal-append.queue_time_us":335280}
I20260709 12:19:40.984987 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:40.910684 15492 raft_consensus.cc:697] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:40.927655 15554 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:40.986933 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:40.987536 13206 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:40.912855 15653 log.cc:927] Time spent T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:19:40.897644 13880 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 5 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:40.992063 15501 raft_consensus.cc:3055] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:40.992260 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 513) took 3354 ms. Trace:
I20260709 12:19:40.992504 15501 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:40.992774 13880 rpcz_store.cc:276] 0709 12:19:37.637939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.585744 (+2947805us) service_pool.cc:224] Handling call
0709 12:19:40.586082 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.991966 (+405884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.992197 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.993376 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:40.994599 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:40.920049 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:40.995752 13102 connection.cc:256] RPC call timeout handler was delayed by -1.9567196129999047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:19:40.996126 13102 connection.cc:256] RPC call timeout handler was delayed by -1.9342040859999088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24s for a response
W20260709 12:19:40.996471 13102 connection.cc:256] RPC call timeout handler was delayed by -1.2665504920000785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 12:19:40.996882 13102 connection.cc:256] RPC call timeout handler was delayed by -1.1915210759998445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
I20260709 12:19:40.923822 13286 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:19:40.907312 15609 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:40.919732 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:40.997239 13102 connection.cc:256] RPC call timeout handler was delayed by -1.0556210759998521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
I20260709 12:19:40.997887 13102 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:40.997969 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 78328.4us
I20260709 12:19:40.999996 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:41.001605 13129 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:19:41.002264 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:40.925710 13137 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:40.931079 13282 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:40.912611 13128 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:40.911188 15303 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:40.932480 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:40.986507 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.740353 13878 rpcz_store.cc:276] 0709 12:19:38.038131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.535494 (+2497363us) service_pool.cc:224] Handling call
0709 12:19:40.535862 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.602704 (+ 66842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.604789 (+  2085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:40.640768 (+ 35979us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:40.644493 (+  3725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.681619 (+ 37126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.698104 (+ 16485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99315,"raft.queue_time_us":68075,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":2867}
I20260709 12:19:40.932579 15551 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:41.023689 13206 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:40.919476 15521 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:40.972579 15385 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.972887 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:40.973172 15368 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.973865 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:40.975450 15583 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:41.032577 15607 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:40.978173 13883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 514) took 2940 ms (client timeout 2024 ms). Trace:
I20260709 12:19:41.033046 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:41.033705 13278 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:41.033460 13883 rpcz_store.cc:269] 0709 12:19:38.037783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.573128 (+535345us) service_pool.cc:224] Handling call
0709 12:19:40.977970 (+2404842us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b54004b8054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:40.978105 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133141760}
W20260709 12:19:41.034552 15654 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 12:19:40.961215 13205 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:41.036232 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:40.988209 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:40.990523 15652 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.037472 13879 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:19:41.038064 15608 log.cc:927] Time spent T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 1.564s	user 0.005s	sys 0.005s
I20260709 12:19:41.038690 15443 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.989815 15236 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:40.909075 15651 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:41.003232 15506 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:41.011348 15605 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:40.908285 15524 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.026335 15551 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.026830 15463 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:41.027506 15521 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:40.996613 15554 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.031564 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:41.068710 13281 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:19:41.069730 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:41.070112 15326 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:41.070343 13281 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:41.032658 15583 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:40.999617 15609 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:41.003244 15662 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:41.008483 15525 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:41.072949 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:41.097335 15525 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.097808 15525 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:41.066428 15591 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.008353 15303 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:41.099076 15303 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:41.005210 15633 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.029064 15614 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:41.071328 15554 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:41.095849 15492 consensus_queue.cc:237] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.095377 15662 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.119803 15529 raft_consensus.cc:3055] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:41.123872 15529 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:41.125036 15529 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.126336 15529 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:41.128791 15474 raft_consensus.cc:3055] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:41.129307 15474 raft_consensus.cc:740] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:41.129468 15591 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:41.130410 15474 consensus_queue.cc:260] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.132608 15643 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:41.146095 15643 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:41.147091 15643 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.148610 15643 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:41.152660 15474 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.139000 15501 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.154733 15549 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:41.155159 15549 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:41.156152 15549 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.157404 15549 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:41.174152 15672 log.cc:927] Time spent T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:19:40.908183 13022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 140486us
W20260709 12:19:40.931908 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 151900us
I20260709 12:19:41.210299 13129 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:40.944885 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:41.212436 13130 raft_consensus.cc:2376] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2. Re-sending same reply.
I20260709 12:19:41.003768 13175 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:41.215464 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 211595us
I20260709 12:19:41.216558 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 404) took 3358 ms. Trace:
I20260709 12:19:41.217037 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:41.024977 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:41.220583 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:41.222259 13206 raft_consensus.cc:2410] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:41.225858 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 400) took 3422 ms. Trace:
W20260709 12:19:41.226524 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.226433 13203 rpcz_store.cc:276] 0709 12:19:37.803128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.803326 (+   198us) service_pool.cc:224] Handling call
0709 12:19:37.803706 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:38.015673 (+211967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.015719 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:38.015781 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:38.015836 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.225166 (+3209330us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400072bd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:41.225264 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:41.225611 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486790528}
I20260709 12:19:41.064280 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:41.231217 13206 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:19:41.231384 13203 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:41.231537 13279 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:41.231279 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 1.64545e+06us
I20260709 12:19:41.240415 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:41.241683 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:41.244617 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:41.249580 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:41.250545 13208 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:41.252938 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 419) took 2677 ms. Trace:
W20260709 12:19:41.255836 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 257839us
W20260709 12:19:41.256100 13131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1119) took 3155 ms (client timeout 2173 ms). Trace:
W20260709 12:19:41.256749 13131 rpcz_store.cc:269] 0709 12:19:38.100566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.271910 (+171344us) service_pool.cc:224] Handling call
0709 12:19:41.255596 (+2983686us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5400060c54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:41.255884 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39823616}
I20260709 12:19:41.257444 13102 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:41.063926 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:41.259768 13286 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:41.260006 13135 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:41.233455 13206 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:41.262554 13206 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:41.263552 13281 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:41.264019 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2501) took 1650 ms. Trace:
I20260709 12:19:41.264577 13207 rpcz_store.cc:276] 0709 12:19:39.613164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.613761 (+   597us) service_pool.cc:224] Handling call
0709 12:19:39.614047 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:39.754679 (+140632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:39.754717 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:39.763605 (+  8888us) log.cc:844] Serialized 26 byte log entry
0709 12:19:40.495570 (+731965us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:40.495608 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.263171 (+767563us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54001c4154. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:41.263258 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:41.263383 (+   125us) raft_consensus.cc:1685] finished
0709 12:19:41.263399 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:41.263782 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":696365,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":118,"spinlock_wait_cycles":322403072,"thread_start_us":241689,"threads_started":1,"wal-append.queue_time_us":428286}
I20260709 12:19:41.266927 13278 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
W20260709 12:19:41.267987 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 56464us
I20260709 12:19:41.268798 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:41.269743 13100 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:41.260578 13175 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:41.057610 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:41.275314 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:41.097914 13881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 504) took 3470 ms (client timeout 2975 ms). Trace:
W20260709 12:19:41.067459 13840 connection.cc:256] RPC call timeout handler was delayed by -1.8229752470001586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.43250000000000005s for a response
W20260709 12:19:41.277055 13840 connection.cc:256] RPC call timeout handler was delayed by -1.8115676620002432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 12:19:41.217043 13204 rpcz_store.cc:276] 0709 12:19:37.858490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.461396 (+602906us) service_pool.cc:224] Handling call
0709 12:19:38.490053 (+ 28657us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:38.490472 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.490500 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:38.500095 (+  9595us) log.cc:844] Serialized 52 byte log entry
0709 12:19:38.802109 (+302014us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:38.823862 (+ 21753us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.439865 (+616003us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.440084 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.440179 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:39.515555 (+ 75376us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b180011fe00. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:19:40.994496 (+1478941us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b180011fe00. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:19:41.158863 (+164367us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b180011fe00. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:19:41.216021 (+ 57158us) raft_consensus.cc:1685] finished
0709 12:19:41.216055 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:41.216342 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1185167,"prepare.queue_time_us":590209,"prepare.run_cpu_time_us":1278,"prepare.run_wall_time_us":3169,"raft.queue_time_us":45468,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":17908,"spinlock_wait_cycles":101563520,"thread_start_us":235757,"threads_started":1,"wal-append.queue_time_us":343856}
I20260709 12:19:41.275133 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:41.281637 15118 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:41.282416 15118 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:41.283842 15421 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.283924 15414 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:41.284713 13886 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 510) took 3653 ms (client timeout 1841 ms). Trace:
I20260709 12:19:41.285219 15414 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:41.285019 15421 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:41.285285 13886 rpcz_store.cc:269] 0709 12:19:37.630554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.748947 (+118393us) service_pool.cc:224] Handling call
0709 12:19:40.140514 (+2391567us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:41.284165 (+1143651us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54005cd5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:41.284395 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525941248}
I20260709 12:19:41.286326 15414 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:41.277637 13840 connection.cc:256] RPC call timeout handler was delayed by -1.6207676620001621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 12:19:41.227263 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:41.297933 13840 connection.cc:256] RPC call timeout handler was delayed by -1.4776676620001581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
I20260709 12:19:41.271158 13102 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:41.302453 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:41.298586 15414 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:41.313902 15421 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:41.314620 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.314731 13212 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:41.318645 13212 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:41.253413 13132 rpcz_store.cc:276] 0709 12:19:38.575342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.142074 (+566732us) service_pool.cc:224] Handling call
0709 12:19:39.142436 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:39.352846 (+210410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:39.352877 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:39.353380 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:19:39.507231 (+153851us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:39.757810 (+250579us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.832191 (+ 74381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.252042 (+1419851us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540010c7d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:41.252115 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:41.252202 (+    87us) raft_consensus.cc:1685] finished
0709 12:19:41.252361 (+   159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:41.252655 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":581373,"prepare.queue_time_us":53629,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":104,"raft.queue_time_us":75337,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":306342,"spinlock_wait_cycles":483039488,"thread_start_us":397686,"threads_started":2,"wal-append.queue_time_us":258525}
W20260709 12:19:41.276526 13881 rpcz_store.cc:269] 0709 12:19:37.627555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.633290 (+  5735us) service_pool.cc:224] Handling call
0709 12:19:41.063948 (+3430658us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:41.097803 (+ 33855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17795456}
I20260709 12:19:41.336993 15557 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:41.337973 13211 raft_consensus.cc:1240] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:41.341229 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:41.340534 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:41.343394 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 102096us
I20260709 12:19:41.349969 15501 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:41.342520 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:41.350749 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 79870.8us
I20260709 12:19:41.351346 13280 raft_consensus.cc:2410] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:19:41.359800 13177 connection.cc:256] RPC call timeout handler was delayed by -1.3432594090002112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 12:19:41.360325 13177 connection.cc:256] RPC call timeout handler was delayed by -1.1497594090001257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 12:19:41.361394 13177 connection.cc:256] RPC call timeout handler was delayed by -1.1191594090000763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 12:19:41.361824 13177 connection.cc:256] RPC call timeout handler was delayed by -1.1173594090000734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
W20260709 12:19:41.362159 13177 connection.cc:256] RPC call timeout handler was delayed by -1.0813594090002425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 12:19:41.362444 13177 connection.cc:256] RPC call timeout handler was delayed by -1.0777594090002367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 12:19:41.362739 13177 connection.cc:256] RPC call timeout handler was delayed by -1.04265940900018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 12:19:41.371112 15651 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:41.371029 15524 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:41.373677 13278 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:41.343040 15386 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:41.373868 13285 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:41.342393 15326 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.366464 13882 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:41.378994 15499 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:41.379393 15521 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:41.382972 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:41.383347 15326 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.386114 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:41.399627 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 130161us
I20260709 12:19:41.402084 15614 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:41.405064 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:41.406610 13249 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:41.407907 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:41.408695 15326 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:41.409829 15326 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:41.410468 15326 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.411046 15326 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:41.411937 15386 raft_consensus.cc:2764] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:19:41.354718 15118 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.339381 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46516
I20260709 12:19:41.413782 13211 raft_consensus.cc:606] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Received request to transfer leadership
I20260709 12:19:41.414965 15386 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:41.415512 15386 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.415853 15386 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:41.416123 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:41.418596 15186 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:41.418634 15652 consensus_queue.cc:1059] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:41.421087 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1634) took 2619 ms. Trace:
I20260709 12:19:41.421696 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:41.421571 13135 rpcz_store.cc:276] 0709 12:19:38.802000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.288272 (+486272us) service_pool.cc:224] Handling call
0709 12:19:41.259149 (+1970877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:41.260399 (+  1250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.420818 (+160419us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b5400060c50. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:41.420983 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4516027776}
W20260709 12:19:41.402088 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:41.397758 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 64391.2us
I20260709 12:19:41.418596 13177 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:41.420508 15652 raft_consensus.cc:3055] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:19:41.414213 15631 consensus_meta.cc:287] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.014s
I20260709 12:19:41.397842 15651 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:41.432471 15499 raft_consensus.cc:697] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:41.439002 15524 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:41.440536 15499 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:41.450780 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 757) took 3450 ms. Trace:
I20260709 12:19:41.431941 15652 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:41.473697 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 90898.9us
W20260709 12:19:41.485958 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 55965.1us
I20260709 12:19:41.487073 13103 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:41.489223 15637 consensus_meta.cc:287] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.011s
I20260709 12:19:41.489717 15637 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.490706 15663 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:41.490864 13203 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:41.491549 15506 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:41.492323 15552 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:41.492238 15447 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:41.493222 15511 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.486038 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:41.483626 15673 log.cc:927] Time spent T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:19:41.470970 15631 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:41.484005 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 50791.4us
I20260709 12:19:41.493266 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:41.501552 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 83111.9us
I20260709 12:19:41.484143 13100 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:41.499993 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:41.506090 15652 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:41.507397 15636 consensus_queue.cc:1059] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:19:41.508728 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.493630 15238 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:19:41.512193 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:41.491267 15663 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:41.528518 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 58678.4us
I20260709 12:19:41.499786 15345 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:19:41.451257 13884 rpcz_store.cc:276] 0709 12:19:37.916794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.520896 (+2604102us) service_pool.cc:224] Handling call
0709 12:19:40.521741 (+   845us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:40.587471 (+ 65730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.587511 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:40.588024 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:19:40.722075 (+134051us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:40.722137 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.153746 (+431609us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b48000600d8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f9db6aa1 00007f70f9dadb37 00007f70f9dad9ca 00007f70f9ea526f 00007f70f9ea4f37 00007f70f9eb955c 00007f70f9eb9508 00007f70f9eb9488 00007f70f9eb9443 00007f70f9eb86ec 00007f70f8de2a96
0709 12:19:41.310172 (+156426us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b54007cf1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:41.327586 (+ 17414us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:41.334140 (+  6554us) raft_consensus.cc:1685] finished
0709 12:19:41.334160 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:41.367513 (+ 33353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60580,"raft.queue_time_us":73731,"raft.run_cpu_time_us":3096,"raft.run_wall_time_us":549730,"spinlock_wait_cycles":16871168,"thread_start_us":131384,"threads_started":1,"wal-append.queue_time_us":187641}
I20260709 12:19:41.504884 15447 consensus_queue.cc:1243] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:19:41.538316 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 45231.4us
I20260709 12:19:41.513093 15521 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:19:41.556588 15340 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:41.557086 15340 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:41.558075 15340 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.560510 15551 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:41.533385 15663 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:41.560990 15640 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:41.536267 15505 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:41.563849 15340 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:41.571241 15532 consensus_meta.cc:287] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.845s	user 0.011s	sys 0.014s
I20260709 12:19:41.574927 15525 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.570250 15368 consensus_queue.cc:1059] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 12:19:41.612012 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 100191us
I20260709 12:19:41.618498 13212 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:41.523228 14978 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 12:19:41.620262 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 87845.8us
I20260709 12:19:41.566387 15652 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:41.619709 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 89391.5us
W20260709 12:19:41.626650 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:41.628790 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 72075.4us
I20260709 12:19:41.568418 15640 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.632282 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:41.632340 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:41.610883 15505 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.636593 13204 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:41.537814 15511 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.628561 15614 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:41.647928 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:41.654567 15676 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:19:41.631489 15532 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.657599 15532 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:41.659636 15373 consensus_queue.cc:1059] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:41.660745 15373 raft_consensus.cc:3055] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:41.660977 13208 raft_consensus.cc:2393] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:41.661147 15373 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:41.662186 15373 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.634912 15640 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:41.670289 15303 consensus_meta.cc:287] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.007s
W20260709 12:19:41.670761 15554 consensus_meta.cc:287] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.008s
I20260709 12:19:41.672271 15386 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.654354 15589 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:41.639547 15505 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:41.654428 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:41.665300 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 133444us
I20260709 12:19:41.665925 15603 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:41.666402 15525 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:41.667273 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 65222us
I20260709 12:19:41.667958 15614 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:41.668606 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:41.673342 13252 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:41.649930 15637 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:41.548062 15651 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:41.683324 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:41.676606 15529 consensus_meta.cc:287] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.520s	user 0.016s	sys 0.002s
W20260709 12:19:41.686261 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 117392us
I20260709 12:19:41.670936 15303 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.686832 15474 consensus_queue.cc:1059] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:41.687496 13135 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:19:41.663403 15373 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:41.714177 15603 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.715852 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:41.742395 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:41.705701 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:41.688176 15614 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:41.692016 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 55247.4us
I20260709 12:19:41.737689 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:41.739370 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:41.704757 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 64167.1us
W20260709 12:19:41.725633 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.714381 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:41.703549 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:41.703899 13132 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:41.715975 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:41.781803 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:41.718709 13879 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:41.777347 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:41.784910 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:41.769568 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:41.771360 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:41.766101 13840 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:41.782552 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:41.790596 15678 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.246s	user 0.004s	sys 0.000s
I20260709 12:19:41.770531 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:41.705024 15551 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:41.798099 13885 raft_consensus.cc:2410] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:19:41.735284 13207 raft_consensus.cc:2376] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5. Re-sending same reply.
I20260709 12:19:41.890900 13887 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:41.696319 13177 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:41.768733 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:41.717932 15386 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:41.890749 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:41.789243 15643 consensus_meta.cc:287] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.003s
I20260709 12:19:41.894898 13133 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:41.711040 15631 raft_consensus.cc:3055] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:41.692446 15591 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:41.671227 15554 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:41.898307 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.705092 15511 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:41.780912 15661 raft_consensus.cc:3055] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:19:41.773243 15638 consensus_meta.cc:287] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.994s	user 0.016s	sys 0.010s
I20260709 12:19:41.767402 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:41.763815 13882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 758) took 3846 ms. Trace:
I20260709 12:19:41.764635 15474 raft_consensus.cc:3055] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:41.918836 15474 raft_consensus.cc:740] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:41.920055 15474 consensus_queue.cc:260] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.921541 15474 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:41.922796 13207 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:41.900496 13212 raft_consensus.cc:2410] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:19:41.770740 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:41.901302 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:41.709337 15500 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.188s
I20260709 12:19:41.706333 15633 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:41.767557 15463 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.689241 15636 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.202s
I20260709 12:19:41.766073 15665 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:41.767220 15662 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:41.908636 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.911908 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:41.714546 15589 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.940606 15463 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.943074 15589 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:41.943056 15303 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:41.946394 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 250239us
I20260709 12:19:41.946854 15463 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:41.696345 15368 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.211s
I20260709 12:19:41.947960 13177 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:41.924882 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:41.915865 13203 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:41.901791 15631 raft_consensus.cc:740] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:41.949838 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:41.949698 15631 consensus_queue.cc:260] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.766850 15648 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.143s
I20260709 12:19:41.928593 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:41.951937 13885 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:41.951380 15631 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:41.952821 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:41.953155 13885 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:41.932319 15500 raft_consensus.cc:3055] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:41.954100 15500 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:41.954196 15603 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:41.954341 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:41.933368 15505 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.955090 13130 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:41.956943 15505 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:41.957054 13034 catalog_manager.cc:5697] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.961603 15589 consensus_queue.cc:1059] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:41.962700 15589 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:41.961330 15303 consensus_queue.cc:1059] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 12:19:41.966123 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:41.968207 15677 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.340s	user 0.000s	sys 0.002s
I20260709 12:19:41.970146 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 532) took 1056 ms. Trace:
I20260709 12:19:41.970460 13203 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
W20260709 12:19:41.971819 15644 consensus_meta.cc:287] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 1.179s	user 0.010s	sys 0.015s
I20260709 12:19:41.970583 13880 rpcz_store.cc:276] 0709 12:19:40.913180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.993710 (+ 80530us) service_pool.cc:224] Handling call
0709 12:19:40.994077 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:40.994465 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.994497 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:40.995018 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:19:41.430560 (+435542us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:41.545494 (+114934us) log.cc:844] Serialized 14 byte log entry
0709 12:19:41.578630 (+ 33136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.632128 (+ 53498us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:41.967130 (+335002us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:41.969631 (+  2501us) raft_consensus.cc:1685] finished
0709 12:19:41.969746 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:41.969968 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56070,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":8021,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":7569,"spinlock_wait_cycles":244453248,"thread_start_us":378056,"threads_started":1,"wal-append.queue_time_us":533417}
I20260709 12:19:41.972393 15644 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:41.973474 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.974957 15644 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:41.975931 13205 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:41.977178 15680 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.330s	user 0.000s	sys 0.000s
W20260709 12:19:41.977377 15501 consensus_meta.cc:287] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.004s
I20260709 12:19:41.977523 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2503) took 1176 ms. Trace:
I20260709 12:19:41.978267 13209 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:41.971822 13884 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
W20260709 12:19:41.933391 15681 log.cc:927] Time spent T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.247s	user 0.002s	sys 0.000s
I20260709 12:19:41.934484 13136 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:19:41.981089 15609 consensus_meta.cc:287] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.905s	user 0.013s	sys 0.009s
I20260709 12:19:41.981622 15609 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.982105 13136 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:19:41.934429 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:41.983913 13129 raft_consensus.cc:2393] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:19:41.984637 15326 consensus_meta.cc:287] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.002s
I20260709 12:19:41.985037 13128 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:41.934952 15637 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:41.985920 15637 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:41.986436 15637 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:41.926956 15638 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:41.989637 15638 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:41.909981 15661 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:41.992702 15373 raft_consensus.cc:3055] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:41.992394 15661 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.993184 15373 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:41.994050 15661 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:41.994479 13206 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:41.994325 15373 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.924045 15118 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:41.935828 15521 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:41.930764 13102 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:19:41.909003 15679 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:19:41.933533 15667 consensus_queue.cc:1059] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:19:42.004666 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 104117us
I20260709 12:19:42.004871 13212 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:19:42.005409 15667 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:42.005532 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:42.006178 15667 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:42.006760 15616 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:42.007241 15616 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:42.009140 15524 raft_consensus.cc:3055] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:42.009696 15524 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:42.007068 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:41.956952 13130 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:41.964303 15554 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:41.995604 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2506) took 1127 ms. Trace:
I20260709 12:19:41.978003 13205 rpcz_store.cc:276] 0709 12:19:40.800781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.036813 (+236032us) service_pool.cc:224] Handling call
0709 12:19:41.037017 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:41.976444 (+939427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.977245 (+   801us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b54002166d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:41.977468 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158376192}
I20260709 12:19:42.001590 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:42.009088 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:41.927874 15591 raft_consensus.cc:697] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:41.916661 13882 rpcz_store.cc:276] 0709 12:19:37.917015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.521086 (+2604071us) service_pool.cc:224] Handling call
0709 12:19:41.330648 (+809562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:41.430004 (+ 99356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.763527 (+333523us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54005cd5d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:41.763728 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763158784}
I20260709 12:19:41.938535 15665 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:41.935528 15663 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:41.992434 15602 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.014647 13129 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:42.013070 13209 rpcz_store.cc:276] 0709 12:19:40.868323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.998668 (+130345us) service_pool.cc:224] Handling call
0709 12:19:41.979312 (+980644us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b540032c8d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:41.995538 (+ 16226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2247832960}
I20260709 12:19:42.010088 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:42.025403 13128 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:42.026731 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:42.027570 15373 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.027923 15609 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:42.029588 13100 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:41.985066 15326 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.031706 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:42.019631 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 237169us
I20260709 12:19:42.008142 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:42.007709 15616 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:42.017963 15636 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:19:42.021785 15686 log.cc:927] Time spent T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:19:42.015920 15532 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:19:42.023401 15653 log.cc:927] Time spent T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:19:42.049157 15463 consensus_queue.cc:1059] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:42.050575 15463 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:42.051031 15463 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:42.052084 15463 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.053079 15663 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:42.053747 15463 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:42.041328 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:42.055843 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:42.041246 15532 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.056564 13130 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:42.042520 15636 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:42.042976 15524 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.043534 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:42.010854 13034 catalog_manager.cc:5697] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 4, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:42.065653 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:42.065995 15524 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:42.066434 13210 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:42.067385 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:42.067968 13209 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:42.068195 15474 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:42.068771 15474 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.069206 15474 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:42.070796 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:42.024559 15602 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.071492 15505 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:42.029253 15665 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.008245 15667 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.073487 15492 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:42.075284 13034 catalog_manager.cc:5697] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 4, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:42.078871 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 71929us
I20260709 12:19:42.082545 15603 raft_consensus.cc:3055] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:42.062551 15631 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:42.084386 15636 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.086328 15532 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:42.088229 15602 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:42.037146 13131 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.037477 15326 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:42.091410 13209 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
W20260709 12:19:42.100704 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 71173.2us
I20260709 12:19:42.094076 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:42.077689 13034 catalog_manager.cc:5697] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:42.098978 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:42.102424 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 98560.2us
I20260709 12:19:42.011781 15640 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.104887 13103 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:42.107074 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:42.038981 15662 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:19:42.110791 13129 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:19:42.092087 15631 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:42.090921 15603 raft_consensus.cc:740] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:19:42.117772 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 170005us
I20260709 12:19:42.113382 13034 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:42.087210 15500 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.107395 15532 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:42.121634 13133 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:42.122970 13135 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:19:42.123626 13100 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:42.124392 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.128865 15368 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:42.131062 13881 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:19:42.132323 15685 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.123s	user 0.000s	sys 0.003s
W20260709 12:19:42.132532 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 105126us
I20260709 12:19:42.112529 15602 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:42.116858 15631 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:42.115383 15583 consensus_meta.cc:287] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.832s	user 0.005s	sys 0.024s
I20260709 12:19:42.139159 13177 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:42.139223 13249 connection.cc:256] RPC call timeout handler was delayed by -1.5366714419997152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 12:19:42.139902 13249 connection.cc:256] RPC call timeout handler was delayed by -1.3934556659999089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 12:19:42.140358 13249 connection.cc:256] RPC call timeout handler was delayed by -1.2428118409998206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
I20260709 12:19:42.142311 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:42.142253 13249 connection.cc:256] RPC call timeout handler was delayed by -1.0506099659999109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 12:19:42.146273 13209 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:42.147869 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:42.148643 13838 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:42.125993 15532 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.135748 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:42.144681 15118 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:42.159561 15244 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:42.159673 15603 consensus_queue.cc:260] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:42.160755 13286 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:42.122249 15499 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:19:42.163652 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:42.149915 15500 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.164911 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:42.164112 15345 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:42.169531 15345 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.170313 15665 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.166304 15244 raft_consensus.cc:697] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:42.172405 15244 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.168370 15447 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:42.174890 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:42.175771 13882 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:42.176806 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:42.177812 15474 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.180132 15474 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:42.169782 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:42.181910 15368 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:42.182317 15368 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:42.182701 15368 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:42.183912 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:42.184842 13887 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:42.185376 13128 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:42.145835 15583 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.186559 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:42.183856 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:42.187614 15557 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:42.158070 15602 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.187880 13277 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:42.189906 15557 raft_consensus.cc:3055] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:42.190001 15602 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:42.190320 15557 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:42.191030 13277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 1700) took 1479 ms (client timeout 1823 ms). Trace:
W20260709 12:19:42.195080 13277 rpcz_store.cc:269] 0709 12:19:40.711520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.711700 (+   180us) service_pool.cc:224] Handling call
0709 12:19:41.499645 (+787945us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800183f98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:42.190804 (+691159us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54001ad6d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:42.190938 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521409280}
I20260709 12:19:42.191723 13278 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:42.192123 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:42.191730 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:42.187796 13285 raft_consensus.cc:2410] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:19:42.193487 13884 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:19:42.191293 15557 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.193898 13252 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:42.194629 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:42.194454 15602 consensus_queue.cc:1059] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:42.197638 13886 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:42.154158 15532 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:42.215204 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 46130.7us
I20260709 12:19:42.187670 15583 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:42.238205 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 44419.6us
W20260709 12:19:42.248124 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 128400us
I20260709 12:19:42.227108 13128 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:42.252498 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 116414us
I20260709 12:19:42.249171 13100 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:42.256291 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:42.260597 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 155749us
I20260709 12:19:42.241134 15557 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:42.263124 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:42.242208 15602 consensus_queue.cc:1243] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:19:42.271034 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 125672us
I20260709 12:19:42.278708 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:42.272243 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:42.272909 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:42.224799 15511 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:19:42.156281 15591 consensus_queue.cc:237] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.284857 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:42.278023 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:42.280386 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:42.287907 15368 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.301009 13212 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:19:42.289354 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:42.309808 13285 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:42.281934 15492 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:42.318783 13286 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:42.285171 15589 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:42.320616 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:42.305711 15691 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 12:19:42.325623 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 559629us
W20260709 12:19:42.323191 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 74126.1us
I20260709 12:19:42.312343 15499 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:42.336783 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:42.330798 13277 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:42.337457 13283 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:42.317894 15551 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:42.319743 15492 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.348161 15492 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:42.347645 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 91476us
I20260709 12:19:42.351859 13177 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:42.353382 13177 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:42.317335 15640 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:42.347599 15484 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:42.345984 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:42.357460 15651 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:42.357816 15652 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:42.359342 13249 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:42.360812 13249 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:42.364531 15368 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:42.364686 15616 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.335326 15589 raft_consensus.cc:697] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:42.369094 15665 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.374601 13136 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:19:42.308835 15631 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.344784 15238 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:19:42.375777 15484 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:42.368829 15326 raft_consensus.cc:3055] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:19:42.344817 15690 log.cc:927] Time spent T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:19:42.338583 15499 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:42.380915 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:42.381368 13212 raft_consensus.cc:2410] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:19:42.389844 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:42.390455 15583 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:42.380793 15602 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:42.391541 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:42.393325 15447 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:42.394812 13100 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:42.382882 15521 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:19:42.395920 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:42.410705 13209 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
W20260709 12:19:42.412660 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 82385.8us
I20260709 12:19:42.428791 13883 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:42.432858 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:42.435194 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 81934.7us
I20260709 12:19:42.436317 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:42.443326 13132 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:19:42.445912 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:42.391178 15637 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:42.453186 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 58440.3us
I20260709 12:19:42.491761 15637 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:42.493376 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.451845 15583 raft_consensus.cc:697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:19:42.494545 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 48727.5us
I20260709 12:19:42.456848 15589 consensus_queue.cc:237] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.452551 15551 raft_consensus.cc:3055] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:42.514490 15551 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:42.515940 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:42.516815 13209 raft_consensus.cc:2393] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:42.495651 15511 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:42.519632 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.520879 15492 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.468709 15616 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:42.413081 15665 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.452479 15463 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:19:42.436815 15499 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.446417 15532 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.432492 15303 consensus_queue.cc:1059] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:19:42.544679 15303 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:42.544167 15500 consensus_queue.cc:1059] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:42.545064 15303 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:42.545773 15532 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:42.546099 15303 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.546926 15492 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:42.428041 15118 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:19:42.474022 13128 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:42.475514 15484 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:42.476475 13083 auto_rebalancer.cc:893] Removing replace marker failed: Replica a99436c294734e5cbc3657b2517cefca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:19:42.477711 13131 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:42.478186 13177 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:42.478718 15524 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:42.481813 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.488934 15631 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:42.484053 15345 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:42.419471 15326 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:42.486358 15603 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:42.489187 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 128450us
I20260709 12:19:42.488934 15652 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:42.497958 13840 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:42.556656 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:42.502246 13129 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:42.495575 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:42.575711 13134 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:42.506949 13135 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
W20260709 12:19:42.509274 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54313.9us
I20260709 12:19:42.495102 15583 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.510815 15414 consensus_queue.cc:1059] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:42.513970 15651 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:42.525557 13209 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:42.584295 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:42.534773 13277 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:42.539529 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:42.540264 15521 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:42.543586 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:42.640815 13212 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:42.553468 13083 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for f042aff5e3084d5e8bd6fcb5335160f5 already in progress
I20260709 12:19:42.569087 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:42.556941 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 78893.4us
I20260709 12:19:42.560388 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:42.588205 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.636149 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:42.636485 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:42.643076 13130 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:42.637760 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:42.547379 15303 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:42.644781 13129 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:42.558996 15529 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:42.648581 13206 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:42.648989 13883 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:42.553972 15554 raft_consensus.cc:2764] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:19:42.545794 15500 raft_consensus.cc:3055] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:42.552881 15665 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:42.651798 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:42.557202 15524 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:42.641716 13083 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f042aff5e3084d5e8bd6fcb5335160f5 already in progress
W20260709 12:19:42.652660 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 68485.6us
I20260709 12:19:42.566362 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:42.659986 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.660429 13283 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:42.660657 13886 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:42.561583 15368 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
W20260709 12:19:42.671475 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 176147us
I20260709 12:19:42.561738 15638 consensus_queue.cc:1059] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:19:42.650774 15661 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:42.709990 13100 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:42.697885 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.655225 15345 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:42.721144 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 79669.1us
I20260709 12:19:42.714989 13100 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:42.655053 15532 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:42.722155 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 79736.4us
I20260709 12:19:42.660821 15500 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:42.660974 15652 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.712955 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:42.663687 15643 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:42.673187 15524 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:42.721664 15414 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:42.551052 15551 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.708020 15661 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:42.719556 13881 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:42.641068 15326 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.734162 15591 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:42.752352 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 116630us
I20260709 12:19:42.752552 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:42.726271 13878 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:42.757757 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:42.758509 15661 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.761565 15501 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:42.664885 15521 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:42.724829 15463 consensus_queue.cc:1059] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:19:42.771570 13887 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:42.775198 15631 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:42.775279 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:42.776527 13133 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:42.742290 15652 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.747002 15244 consensus_queue.cc:1059] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:19:42.817602 13134 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:19:42.779220 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:42.779623 13883 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:42.772073 15589 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:42.779883 15521 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:42.721828 15704 consensus_queue.cc:1059] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:19:42.826406 13885 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:19:42.780836 15661 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:42.782063 13249 leader_election.cc:400] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:42.831564 13249 leader_election.cc:403] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:19:42.782640 15500 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.794991 15484 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:19:42.795639 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 57533us
I20260709 12:19:42.794389 15501 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:42.801417 15591 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.849010 15591 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:42.849603 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:42.831557 15368 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:19:42.812224 15644 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.853011 15644 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.854969 15644 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:42.855953 15636 raft_consensus.cc:3055] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:42.812772 15118 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:42.738631 15345 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.814425 15631 raft_consensus.cc:697] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:42.883730 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.884496 15631 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.814311 15499 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.817373 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:42.893057 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 177129us
I20260709 12:19:42.821147 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:42.822136 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 57301.6us
I20260709 12:19:42.823249 13136 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:19:42.823712 13886 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:42.814311 13882 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:42.832681 13205 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:42.836463 13100 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:42.835561 15589 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:42.839373 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 57469.7us
I20260709 12:19:42.843954 15500 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:42.844872 15501 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.846611 15637 raft_consensus.cc:3055] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:42.847077 15603 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 3. Current term is 4.
I20260709 12:19:42.857960 13838 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:42.860059 13212 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:42.864827 13883 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:42.856377 15636 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:42.870514 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:42.868382 15118 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:42.856616 13878 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 3 LEARNER]: Advancing to term 4
I20260709 12:19:42.875789 13177 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:42.877308 15652 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:42.936367 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 78594us
I20260709 12:19:42.937412 15589 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:42.937327 15636 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:42.938156 15463 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:42.938625 15636 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.938711 15463 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:42.934377 15118 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:42.939841 15463 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.940507 15499 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:42.940626 15118 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.941984 15118 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:42.943936 13203 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:42.945293 15326 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:42.928943 15637 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:42.946610 15637 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.947696 15637 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:42.882018 15345 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:42.903704 13208 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:42.948347 15616 raft_consensus.cc:3055] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:42.948789 15616 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:42.949604 15616 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.894977 15484 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:42.950642 15484 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:42.950798 15616 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:42.935122 15705 consensus_queue.cc:1059] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:19:42.952176 15345 raft_consensus.cc:3055] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:42.952324 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:42.952562 15345 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:42.953588 13249 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:42.919019 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 97934.7us
W20260709 12:19:42.953696 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 78017.1us
I20260709 12:19:42.954668 13177 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:42.954888 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:42.955621 15557 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:42.956277 15557 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:42.956612 15557 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:42.956971 15557 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:42.957508 13212 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:42.957556 15602 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:42.958362 15602 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:42.960177 13881 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:42.961141 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:42.922798 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:42.963922 13209 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:42.964219 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:42.925239 13207 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:19:42.927886 13840 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:42.964716 13207 pending_rounds.cc:85] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 1
I20260709 12:19:42.965034 13207 pending_rounds.cc:107] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:19:42.965333 13207 raft_consensus.cc:2889] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:42.965605 13840 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:42.967924 13249 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:42.929292 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 92975us
I20260709 12:19:42.969084 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:42.969455 13277 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:42.969668 13283 raft_consensus.cc:2376] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4. Re-sending same reply.
I20260709 12:19:42.969749 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:42.970461 13130 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
W20260709 12:19:42.970971 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.971329 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:42.928752 13206 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:19:42.922359 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:42.971864 13100 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:42.972086 13206 pending_rounds.cc:85] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 3
I20260709 12:19:42.953775 15603 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:42.961815 15484 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.968524 15602 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:42.971634 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:42.953316 15345 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.994879 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:42.967197 13838 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:42.960125 15511 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:42.976171 13209 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:42.833529 15643 raft_consensus.cc:697] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:42.928241 15638 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:42.984848 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:43.009298 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:42.988116 13206 pending_rounds.cc:107] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:19:42.983316 15532 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:42.988782 13175 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:42.982440 15521 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:43.029320 15499 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:43.029230 15521 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.029774 15499 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.030001 13878 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 4 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:43.030220 15499 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:42.989012 15661 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:43.031010 15661 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.031464 15521 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:42.984386 15664 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.032287 15664 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:43.033325 15661 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:42.993012 15665 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:43.034183 15665 raft_consensus.cc:697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:43.034786 15664 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:43.036401 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.998515 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:42.998960 15244 consensus_queue.cc:1059] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:42.970985 13128 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:19:43.005003 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:43.010154 13206 raft_consensus.cc:2889] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:42.987994 13211 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:43.010741 13283 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: [6.8-8.9]
W20260709 12:19:43.011514 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.991773 15662 consensus_queue.cc:1059] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:19:43.013855 13280 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:43.016131 15474 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:43.016510 15704 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:43.016738 15638 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:43.017115 15589 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
W20260709 12:19:43.017767 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 50658.8us
I20260709 12:19:43.019572 15633 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:43.020074 15238 consensus_queue.cc:1059] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:43.000938 15511 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:42.996980 15705 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:43.021929 15524 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:42.992646 15651 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:19:42.983006 15603 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:43.027945 15345 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:43.035297 15665 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.088510 15511 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.090154 15511 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:43.093291 15552 raft_consensus.cc:3055] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:43.092964 15643 consensus_queue.cc:237] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.093672 15552 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:43.038666 13278 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:43.039281 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:43.037955 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:43.038549 13132 raft_consensus.cc:1240] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:43.050426 15644 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.043197 13208 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:43.046015 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:43.050729 15704 raft_consensus.cc:697] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:43.109714 15704 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.047346 13838 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:43.111831 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 64603.3us
I20260709 12:19:43.113559 13838 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:43.039286 15551 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:43.050974 13177 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:43.059182 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 91343us
I20260709 12:19:43.023300 15500 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:19:43.043494 15474 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:43.071725 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:43.072513 13283 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:43.078152 15554 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:43.078323 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:43.038606 15602 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:19:43.079361 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:43.080209 13279 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:43.126300 15244 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:43.126751 15244 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.127105 15244 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:43.129705 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:43.130967 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:43.085140 15484 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:43.096810 13203 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:43.003237 15583 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:43.098237 15414 raft_consensus.cc:3055] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:43.099198 15552 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.100159 15633 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:43.076104 15603 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:43.157999 13280 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 2: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:43.101213 15303 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:43.101766 15238 consensus_queue.cc:1059] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:43.103335 15524 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:43.104660 15638 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.166005 13279 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:43.107112 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:43.076642 15705 raft_consensus.cc:697] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:43.108281 15644 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.111661 15501 consensus_queue.cc:1059] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:43.054742 13841 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:43.101223 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:43.183853 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.131034 15602 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:43.139532 15414 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:19:43.141997 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:43.148810 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:43.194705 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.158538 13103 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:43.165323 13281 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:43.177038 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 133301us
I20260709 12:19:43.200317 15463 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:43.200873 15463 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:43.201328 15463 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:43.201808 13203 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:19:43.216174 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 85265.2us
W20260709 12:19:43.184944 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.082492 15499 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.131836 15474 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:43.139578 15532 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:43.143786 15368 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:43.217928 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 163322us
I20260709 12:19:43.135797 15557 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:43.239630 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.244446 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:43.182978 15591 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:43.269582 13281 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:19:43.272843 13212 raft_consensus.cc:1240] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:43.226282 15532 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:43.253490 15633 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:43.287420 13283 raft_consensus.cc:2410] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:19:43.254062 15529 raft_consensus.cc:3055] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:19:43.290176 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 125361us
I20260709 12:19:43.298313 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:43.299181 13280 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:19:43.299629 13280 pending_rounds.cc:85] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 2
I20260709 12:19:43.299865 13280 pending_rounds.cc:107] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260709 12:19:43.300006 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.299870 13840 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:43.300721 13280 raft_consensus.cc:2889] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:43.302927 13249 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:43.269939 15735 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:43.303759 13884 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:43.279917 15718 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.279525 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:43.286137 15238 consensus_queue.cc:1243] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:19:43.288440 15532 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:43.253604 15303 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.311280 13282 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:19:43.318197 13282 pending_rounds.cc:85] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 3
I20260709 12:19:43.318472 13282 pending_rounds.cc:107] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:19:43.318758 13282 raft_consensus.cc:2889] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:43.289687 15633 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:43.319809 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:43.320353 15633 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.320794 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:43.321491 15633 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:43.292544 15529 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:43.323757 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:43.306886 15735 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.282184 15602 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:19:43.331243 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:43.312341 15326 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:43.314980 13878 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:43.272327 15414 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.357580 13278 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:19:43.358095 13278 pending_rounds.cc:85] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 3
I20260709 12:19:43.358390 13278 pending_rounds.cc:107] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:19:43.358700 13278 raft_consensus.cc:2889] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:43.361408 15727 log.cc:927] Time spent T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:19:43.362736 15726 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:19:43.324432 15238 consensus_queue.cc:1059] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:19:43.365307 15734 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:43.334141 15735 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:43.313637 15718 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.346592 15118 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.376529 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:43.383384 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:43.384122 13286 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:43.310094 15705 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.368530 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:43.378448 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:43.407683 13282 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
W20260709 12:19:43.409072 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 64321.3us
I20260709 12:19:43.409996 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:43.367821 15736 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.389328 15583 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.372473 15118 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.440277 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:43.440971 13282 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:43.390727 15414 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:43.403836 15557 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:43.437646 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:43.414403 13249 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:43.438488 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:43.450176 13278 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:43.446575 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 329299us
W20260709 12:19:43.456310 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.456712 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.459120 13838 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:43.368824 15529 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.465461 13278 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
W20260709 12:19:43.446357 15732 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:19:43.444105 15238 raft_consensus.cc:3055] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:43.442915 15524 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.473307 13282 raft_consensus.cc:1240] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:19:43.481161 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.477659 13102 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:43.478559 13208 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:43.466063 15637 consensus_meta.cc:287] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 12:19:43.485730 13878 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:43.489317 13102 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:43.491233 15738 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:19:43.491658 15521 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:43.494130 15725 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 12:19:43.496387 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 82092.6us
I20260709 12:19:43.532385 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:43.499104 13280 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:19:43.446563 15583 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:43.478619 15737 log.cc:927] Time spent T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:19:43.469019 15602 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:43.520397 13282 raft_consensus.cc:1240] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:43.543998 13100 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:43.529910 13137 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:43.520071 15747 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:43.547271 13249 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.489352 15552 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:43.526386 15474 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:19:43.537945 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 169677us
I20260709 12:19:43.479662 15238 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:43.539647 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:43.512712 15529 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:43.552649 13208 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:43.553936 13135 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:43.548972 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 89930.5us
I20260709 12:19:43.555867 15244 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.553479 15521 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:43.561019 15521 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.542776 15484 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.563925 15484 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:43.566530 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 77355.9us
W20260709 12:19:43.566820 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.543000 15602 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.567528 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:43.567930 15602 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:43.568233 15368 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:43.568992 15557 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:43.571372 13207 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:43.549084 15500 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:43.504397 15524 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.541101 15303 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:43.542640 15665 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:43.463215 15736 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.599290 15736 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:43.585052 15661 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:43.600528 15524 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:43.601830 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 43937.5us
I20260709 12:19:43.581396 15662 consensus_queue.cc:1059] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:19:43.604671 15662 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:43.605070 15662 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:43.556898 13131 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:43.547603 15554 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.579063 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:43.606935 13132 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:43.579625 15499 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:43.595508 15521 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:43.608050 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 75722.8us
I20260709 12:19:43.556953 15326 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:43.548369 15748 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:43.609095 13286 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:43.618127 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:43.627205 13137 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:43.621181 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.621356 13209 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:43.631230 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.622897 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:43.632788 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:43.632705 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:43.633656 13129 raft_consensus.cc:2376] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4. Re-sending same reply.
I20260709 12:19:43.633849 13134 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:43.635162 13208 raft_consensus.cc:2410] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:43.580500 15118 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:43.586145 15500 raft_consensus.cc:697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:43.615530 15667 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:43.661712 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 53572.6us
I20260709 12:19:43.666759 13884 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:43.669031 13133 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:43.635309 15521 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.670095 13100 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:43.576527 15749 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 12:19:43.637573 15718 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:43.678602 15551 consensus_meta.cc:287] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.002s
I20260709 12:19:43.669291 15667 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.678941 15500 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.679768 15521 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:43.685323 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.691324 13878 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:43.686154 15492 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:43.694908 15602 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.678989 15326 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:19:43.616859 15662 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.708033 15602 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:43.708746 15662 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:43.658569 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:43.699402 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.710971 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:43.700102 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.700644 13208 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:19:43.711690 13208 pending_rounds.cc:85] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:19:43.711954 13208 pending_rounds.cc:107] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:19:43.702504 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:43.703567 15345 consensus_meta.cc:287] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.000s
I20260709 12:19:43.712231 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:43.704679 15521 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:43.654441 15554 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.712188 13208 raft_consensus.cc:2889] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:43.713753 15718 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:43.714530 15718 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:43.714983 13209 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:43.715152 15554 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:43.715899 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:43.668100 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:43.716540 13211 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:43.717971 13175 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:43.736732 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:43.712131 15734 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:43.734648 15667 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:43.733425 15492 raft_consensus.cc:697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:19:43.742798 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 126174us
I20260709 12:19:43.743162 15492 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.743681 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:43.745713 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:43.747448 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:43.748250 13208 raft_consensus.cc:2393] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:43.716835 15303 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:43.687146 15753 consensus_queue.cc:1059] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:19:43.747083 15551 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:43.749315 15603 consensus_meta.cc:287] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.000s
I20260709 12:19:43.754400 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:43.699625 15463 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.753207 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:43.762252 13211 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:43.755633 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:43.762665 13884 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:43.749529 15761 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:43.738574 15749 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:19:43.756130 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.763263 13134 raft_consensus.cc:2410] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:43.754848 13249 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.766633 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:43.764804 13103 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:43.746712 15631 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:19:43.756888 15474 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:43.770521 13103 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:43.763507 15326 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:43.759001 15589 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:19:43.766379 13878 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:43.752696 15665 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:19:43.780933 15463 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:43.781318 13132 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:43.781239 15667 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:43.762492 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:43.763935 15500 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:19:43.775708 15326 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:43.783957 15326 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:43.784866 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:43.787487 15414 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:19:43.789675 15755 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:19:43.794091 13203 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:43.759068 15551 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.773257 15524 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:43.759271 15603 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.807559 15761 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:43.778412 15583 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:43.790272 15664 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:43.816514 15603 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:43.795795 15749 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.817912 13249 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.807282 15524 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.839529 13177 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.776441 15753 consensus_queue.cc:1059] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:19:43.820327 13131 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:43.821772 15551 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:43.822297 15616 raft_consensus.cc:3055] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:43.818315 13103 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:43.827044 15749 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.827752 15661 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:43.828233 15718 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:43.831856 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:43.860822 13883 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:43.836747 15736 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:43.840744 13177 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:43.825588 13249 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.843228 13881 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:43.824735 15589 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:43.844834 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:43.869292 13283 raft_consensus.cc:2393] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:43.845584 15667 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:19:43.846094 15532 consensus_meta.cc:287] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.000s
I20260709 12:19:43.847568 15631 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:43.876299 15631 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:43.876112 15532 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.876713 15631 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:43.878314 15532 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:43.850981 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:43.879771 13282 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:43.851630 15524 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:43.852123 13281 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:43.853029 13284 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: [6.8-8.9]
W20260709 12:19:43.862027 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 43855.4us
I20260709 12:19:43.885202 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:43.819793 15664 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.866828 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.873172 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.859400 15616 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:43.909260 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:43.909809 15616 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:43.910542 15735 consensus_meta.cc:287] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 12:19:43.910970 15616 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:43.860181 15591 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.911850 15591 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.912766 15326 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.914188 15591 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:43.901727 13285 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:43.901803 15667 raft_consensus.cc:3055] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:43.903148 15749 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:43.903647 15718 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:43.893959 15499 consensus_queue.cc:1059] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:19:43.908085 13207 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:43.914927 15326 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:43.867753 15551 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:43.916361 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 49652.1us
I20260709 12:19:43.895038 15664 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:43.894737 15492 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:43.925248 13203 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:43.929298 13284 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:43.930470 13282 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:19:43.871793 15651 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:43.868304 15583 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:43.871074 15736 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.942695 15644 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:43.937588 13103 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:43.918757 15667 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:43.921506 15589 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:43.936597 15718 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:43.932314 15557 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:43.933851 15551 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.931026 15603 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:43.933506 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.943598 15492 raft_consensus.cc:697] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:43.944762 15736 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:43.964248 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:43.930619 15749 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:43.956692 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:43.935563 15414 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:43.910986 15735 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.958334 15636 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:43.967252 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.934958 15661 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:19:43.964710 15551 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:43.968930 15753 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:43.976850 15633 raft_consensus.cc:3055] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:43.977022 13131 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:19:43.977322 15633 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:43.978245 15633 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.979584 15500 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.980140 15500 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.967634 15603 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:43.982293 15500 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:43.962172 15532 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:19:43.983965 15603 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:43.987830 15667 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.991539 15244 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:43.951515 15651 raft_consensus.cc:697] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:43.971853 13249 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.968763 15749 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.969957 15492 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:43.968775 15414 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.965088 15557 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:44.003036 13882 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:43.997918 15636 raft_consensus.cc:697] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:44.004474 15414 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:44.004915 15746 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.429s	user 0.004s	sys 0.000s
I20260709 12:19:44.005134 15636 consensus_queue.cc:237] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:44.005079 15557 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:43.998934 15753 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:44.002978 15532 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:19:44.008831 15753 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.010035 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:44.007266 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:44.000835 15589 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:44.012488 15602 raft_consensus.cc:3055] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:44.012902 15602 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:44.013444 15749 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:43.972808 15718 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:43.973266 15736 consensus_queue.cc:1059] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:43.974639 15591 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:43.974886 15326 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:43.995223 13132 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:43.996778 15651 consensus_queue.cc:237] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:43.999936 13249 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:43.998606 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:44.028313 13203 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
W20260709 12:19:44.017819 15769 log.cc:927] Time spent T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:19:44.020634 15735 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:44.021222 15664 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.022066 15484 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:44.023631 13100 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:44.001981 15633 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:44.041651 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.043120 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:44.024967 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:44.013713 15602 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.027267 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:44.031132 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:44.046476 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:44.048324 13879 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:44.046624 13205 raft_consensus.cc:2393] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:44.031500 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:44.009688 15238 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:44.047334 13102 leader_election.cc:336] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.621s (SENT)
I20260709 12:19:44.049839 15238 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:44.045526 13208 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:44.036612 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.038745 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.052542 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.044936 13281 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:44.053623 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.053864 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:44.053714 15736 consensus_queue.cc:1175] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b190224a708b4f068a6dda4006c3a133" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:44.054738 13278 raft_consensus.cc:2410] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:19:44.055053 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.055542 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.055823 13280 raft_consensus.cc:2410] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:19:44.046172 15524 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.056521 15552 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:44.057092 15552 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:44.058125 15664 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:44.058017 15552 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.058624 15602 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:44.059684 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:44.063187 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.066272 13285 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:44.066217 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:44.039338 13282 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:44.071666 13131 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:44.067883 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:44.075654 13205 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:44.036335 15603 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:44.061973 15500 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:44.058163 15524 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:44.099380 15326 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.102001 15326 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.104151 15326 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:44.105611 15740 raft_consensus.cc:3055] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:44.106056 15740 raft_consensus.cc:740] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:44.102018 15730 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.721s	user 0.003s	sys 0.000s
I20260709 12:19:44.108033 13136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1681) took 1140 ms. Trace:
I20260709 12:19:44.108392 13136 rpcz_store.cc:276] 0709 12:19:42.968104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.973116 (+  5012us) service_pool.cc:224] Handling call
0709 12:19:42.995836 (+ 22720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:43.067900 (+ 72064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:43.067937 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:43.068407 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:19:43.226581 (+158174us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:43.226622 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:43.961920 (+735298us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b54001f36d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:43.961965 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:44.101424 (+139459us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:44.107801 (+  6377us) raft_consensus.cc:1685] finished
0709 12:19:44.107822 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:44.107953 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13930,"raft.queue_time_us":29364,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":19424,"spinlock_wait_cycles":107878016,"thread_start_us":157780,"threads_started":1,"wal-append.queue_time_us":275018}
I20260709 12:19:44.110634 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.111323 13278 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:44.111378 15118 raft_consensus.cc:3055] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:44.044454 15589 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 12:19:44.060740 15303 consensus_queue.cc:1175] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "af3f42f0797349058724e0cb2e637d24" responder_term: 6 status { last_received { term: 6 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:44.072147 15664 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:44.112314 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:44.112944 13102 leader_election.cc:336] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.662s (SENT)
I20260709 12:19:44.126183 13208 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:44.115029 13282 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:44.121687 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:44.123356 13205 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:44.111901 15118 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:44.088852 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:44.090301 15500 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:44.146313 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:44.151403 13102 leader_election.cc:336] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.676s (SENT)
I20260709 12:19:44.129062 15664 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.133152 15529 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:44.157124 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:44.157871 13277 raft_consensus.cc:2376] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3. Re-sending same reply.
I20260709 12:19:44.106938 15740 consensus_queue.cc:260] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.142184 15524 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.160701 13102 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:44.124496 15749 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:19:44.146919 15500 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:44.149660 13881 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:44.156066 15664 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:44.178128 13277 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:44.160248 15529 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:44.169662 15749 consensus_queue.cc:1243] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:19:44.173386 15661 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:44.211694 13277 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:19:44.191346 15740 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:44.190119 15529 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:44.170125 15524 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.246889 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.248704 13279 raft_consensus.cc:2393] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:44.251379 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.255251 13277 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:44.280236 13280 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:44.281365 13132 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:44.283351 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:44.284072 13887 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:44.286311 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:44.286727 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:44.287539 13879 raft_consensus.cc:2410] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:44.287701 13277 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:44.289508 13132 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:44.290345 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:44.292790 13137 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:44.296181 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.296797 13283 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:19:44.297152 13283 pending_rounds.cc:85] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 3
I20260709 12:19:44.297381 13283 pending_rounds.cc:107] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:19:44.297638 13283 raft_consensus.cc:2889] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:44.283380 13841 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:44.299074 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.204085 15631 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:44.300868 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.301420 13103 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:44.303447 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:44.304622 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:44.309181 15644 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:44.309749 15644 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.310195 15644 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:44.311932 13277 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:44.312141 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:44.314174 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:44.315507 13279 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:44.316792 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:44.317730 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.318322 13175 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:44.280954 15753 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:44.294945 15557 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.320387 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:44.324000 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.331045 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.324937 15484 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:44.321480 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:44.325407 15661 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.333164 15661 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:44.333710 15777 log.cc:927] Time spent T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:19:44.327610 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:44.335731 13883 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:44.338014 13883 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:44.337796 15753 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.330142 13212 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:44.335752 15637 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:44.340037 15753 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:44.340533 15637 raft_consensus.cc:697] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:44.340721 13884 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:44.341432 15637 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:44.342034 15631 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:44.233016 15118 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:44.311950 15771 log.cc:927] Time spent T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:19:44.332746 13284 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:44.339346 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:44.317189 15734 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:19:44.362661 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.360247 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:44.364007 13129 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:44.351305 15557 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.375494 15557 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:44.377662 15551 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:44.379828 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:44.380604 13128 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:44.384373 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:44.385156 13284 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:44.385897 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:44.386548 13284 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:44.387269 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.388047 13284 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:44.388841 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:44.335388 15661 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:44.379766 13880 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:44.393301 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:44.394071 13880 raft_consensus.cc:2393] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:44.393963 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.395340 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.398571 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:44.399406 13285 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:44.399827 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.402868 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.403661 13279 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:44.396153 13879 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:44.396673 13282 raft_consensus.cc:2410] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:19:44.397099 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 47172us
I20260709 12:19:44.410669 13887 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
W20260709 12:19:44.412961 13102 leader_election.cc:336] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.858s (SENT)
I20260709 12:19:44.414446 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.404788 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:44.415092 13884 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:19:44.419814 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 56477.6us
I20260709 12:19:44.395115 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:44.420197 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:45.297973 13278 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:44.441650 15753 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.446762 13279 raft_consensus.cc:3055] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:19:44.483927 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.299840 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2569) took 1270 ms. Trace:
I20260709 12:19:45.300590 13880 raft_consensus.cc:2410] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:19:44.348286 15554 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.302289 15554 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:45.303331 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 890311us
W20260709 12:19:44.658360 15785 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
W20260709 12:19:45.304214 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.304551 15551 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.304915 15554 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:44.601460 13203 raft_consensus.cc:1240] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:44.548463 15602 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.395105 15529 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.306123 15602 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.014672 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 1693) took 1020 ms. Trace:
I20260709 12:19:45.307413 13131 rpcz_store.cc:276] 0709 12:19:43.994005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.995611 (+  1606us) service_pool.cc:224] Handling call
0709 12:19:45.014359 (+1018748us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b54001f4ad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:45.014583 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113571712}
I20260709 12:19:45.307924 15529 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:44.352087 15484 raft_consensus.cc:697] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:45.308447 15602 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:44.464053 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:45.309093 15753 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:45.322119 15664 consensus_meta.cc:287] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.131s	user 0.012s	sys 0.000s
I20260709 12:19:45.322981 13879 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:45.322675 15664 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.567253 13284 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:45.299499 13279 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:45.309341 15484 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.325368 15664 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.299487 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 800) took 1017 ms. Trace:
I20260709 12:19:45.296938 15667 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:45.326390 13887 rpcz_store.cc:276] 0709 12:19:44.282298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.283131 (+   833us) service_pool.cc:224] Handling call
0709 12:19:45.299410 (+1016279us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:44.556799 15238 consensus_meta.cc:287] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 12:19:44.584266 15589 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:45.130923 15644 consensus_meta.cc:287] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.820s	user 0.011s	sys 0.000s
I20260709 12:19:45.332844 15753 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:45.332612 15644 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:45.333655 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 926324us
W20260709 12:19:45.054306 15787 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.468s	user 0.000s	sys 0.001s
W20260709 12:19:44.728693 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:45.337815 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.337707 15662 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:19:45.339847 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:45.340453 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:45.342106 15776 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 1.042s	user 0.000s	sys 0.010s
W20260709 12:19:45.344578 15772 log.cc:927] Time spent T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.984s	user 0.008s	sys 0.005s
I20260709 12:19:45.331859 15589 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.346293 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:45.347180 13881 raft_consensus.cc:2410] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:45.349480 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.349718 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:45.350200 13208 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:45.350327 13205 raft_consensus.cc:2410] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:19:45.351418 13882 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
W20260709 12:19:44.428011 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 111795us
I20260709 12:19:45.353591 15589 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:44.552719 15638 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.601768 15524 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:44.546751 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.354533 15638 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.387369 15500 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.356510 13208 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:45.356849 15500 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:44.425521 15734 raft_consensus.cc:697] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:45.358065 15734 consensus_queue.cc:237] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.359073 15631 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:45.360674 15631 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:45.313220 15754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.025s	sys 0.017s
W20260709 12:19:45.361436 15754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.025s	sys 0.018s
I20260709 12:19:45.361076 15800 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:19:45.364624 13175 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:45.365538 15789 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:45.316475 15798 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.366381 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:45.366453 15798 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.300520 13204 rpcz_store.cc:276] 0709 12:19:44.029464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.029630 (+   166us) service_pool.cc:224] Handling call
0709 12:19:44.030476 (+   846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:44.037043 (+  6567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:44.037072 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:44.196796 (+159724us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b2c0000e5c8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:19:44.197211 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 12:19:44.288170 (+ 90959us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:44.288224 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.288317 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:45.299500 (+1011183us) raft_consensus.cc:1685] finished
0709 12:19:45.299521 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:45.299772 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6262,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":17370,"spinlock_wait_cycles":11263360,"thread_start_us":90548,"threads_started":1,"wal-append.queue_time_us":243129}
I20260709 12:19:45.368726 15798 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:45.324332 13279 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:44.483569 13209 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:45.370055 15631 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.370383 15789 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:19:45.326040 13883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.000s	sys 0.008s
I20260709 12:19:45.356607 15638 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.365402 15754 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:19:45.374085 13883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.000s	sys 0.008s
I20260709 12:19:44.663780 13280 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:19:45.370612 15631 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.377216 15631 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.371420 15557 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:45.372385 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:45.378013 15557 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.374962 13883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 552) took 1030 ms. Trace:
I20260709 12:19:45.370260 13279 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:45.380191 15557 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.380750 15557 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:45.381086 15557 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:45.381443 15557 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:45.371119 15789 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.383509 13883 rpcz_store.cc:276] 0709 12:19:44.344174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.353947 (+  9773us) service_pool.cc:224] Handling call
0709 12:19:44.354292 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:44.401737 (+ 47445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:44.401766 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:44.402344 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 12:19:44.649021 (+246677us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b1800325720. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1 00007f70f4e48a0f
0709 12:19:45.374529 (+725508us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:45.374566 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.374628 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:45.374664 (+    36us) raft_consensus.cc:1685] finished
0709 12:19:45.374674 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:45.374897 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":772,"raft.queue_time_us":51524,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":20700,"spinlock_wait_cycles":3023232,"thread_start_us":725321,"threads_started":1,"wal-append.queue_time_us":897156}
I20260709 12:19:45.385151 15789 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.375350 13280 pending_rounds.cc:85] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 5
I20260709 12:19:45.386082 13280 pending_rounds.cc:107] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:19:45.386408 13280 raft_consensus.cc:2889] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:45.386418 13133 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:45.388038 13279 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:19:45.411090 13279 pending_rounds.cc:85] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 6
I20260709 12:19:45.411562 13279 pending_rounds.cc:107] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:19:45.411968 13279 raft_consensus.cc:2889] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:45.313331 15740 consensus_meta.cc:287] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 1.066s	user 0.009s	sys 0.000s
I20260709 12:19:45.396246 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.400314 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:45.402185 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 87394.5us
I20260709 12:19:45.407612 15244 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.391767 15633 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:45.340085 15662 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:19:45.391939 15521 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.429216 13205 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:19:45.401443 15492 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.408349 15345 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:45.430289 15492 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.432940 15492 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.398479 15474 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.433923 15474 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.335104 15644 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.436745 15474 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.409230 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.424660 15631 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.438900 15631 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.441751 15631 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.388306 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 451) took 1042 ms. Trace:
I20260709 12:19:45.389325 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2561) took 1484 ms. Trace:
I20260709 12:19:45.412971 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2547) took 1025 ms. Trace:
I20260709 12:19:45.413843 13206 raft_consensus.cc:2410] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:45.388236 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2534) took 1004 ms. Trace:
I20260709 12:19:45.428274 15633 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.424806 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 608) took 1142 ms. Trace:
I20260709 12:19:45.448217 13212 rpcz_store.cc:276] 0709 12:19:43.904731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.908547 (+  3816us) service_pool.cc:224] Handling call
0709 12:19:43.908827 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:44.339670 (+430843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.389052 (+1049382us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54002157d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:45.389259 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968432000}
I20260709 12:19:45.447327 13133 rpcz_store.cc:276] 0709 12:19:44.346070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.347324 (+  1254us) service_pool.cc:224] Handling call
0709 12:19:45.386022 (+1038698us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b5800001298. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e66fc0 00007f70f9e51929 00007f70f9e513d2 00007f70f33c8bd4
0709 12:19:45.386259 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:45.388095 (+  1836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.388256 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40382848}
I20260709 12:19:45.449148 13279 rpcz_store.cc:276] 0709 12:19:44.387219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.404190 (+ 16971us) service_pool.cc:224] Handling call
0709 12:19:44.446594 (+ 42404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:45.412751 (+966157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.412919 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:45.449747 13280 rpcz_store.cc:276] 0709 12:19:44.383540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.391726 (+  8186us) service_pool.cc:224] Handling call
0709 12:19:44.663140 (+271414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:45.386913 (+723773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.388061 (+  1148us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54000e5e50. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:45.388183 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623347968}
I20260709 12:19:45.454000 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:45.460953 13207 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:45.420519 15602 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:45.478039 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.449940 15238 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.424141 15244 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.445945 15463 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.474189 15616 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.475586 15764 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.517131 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:45.517969 13883 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:45.515458 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:45.520529 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:45.475824 15792 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:45.457715 15665 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:45.528049 13102 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.549s (SENT) [suppressed 24 similar messages]
I20260709 12:19:45.528414 15665 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.529621 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:45.531355 15665 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.531656 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:45.532527 13131 raft_consensus.cc:2393] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:45.532267 15792 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.534776 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:45.458242 15631 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.544684 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:45.545282 13879 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:19:45.545521 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 132101us
I20260709 12:19:45.546437 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:45.513276 15589 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:45.484282 15740 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:45.446369 15521 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.553632 13132 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:45.557878 13886 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:45.541033 15661 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:45.544092 15474 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.483976 15602 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.540585 15792 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.553925 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:45.561928 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:45.458122 13881 rpcz_store.cc:276] 0709 12:19:44.267101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.284218 (+ 17117us) service_pool.cc:224] Handling call
0709 12:19:45.346140 (+1061922us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:45.409856 (+ 63716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14415104}
I20260709 12:19:45.544344 15801 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:45.574306 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:45.574888 13132 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:45.575085 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:45.515667 15616 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.515404 15463 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.552098 15345 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:45.566814 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:45.579949 13130 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:45.522966 15764 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.516023 15238 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.566666 15798 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:45.603996 15238 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:45.606596 15463 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.572199 15662 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.608011 15633 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.607939 15662 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.564613 15661 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.566836 15474 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.560760 15804 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.548377 15631 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.576045 13135 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:45.621927 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:45.630056 13130 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:19:45.611995 13133 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:45.633540 13207 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:45.555599 15589 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.592548 15244 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:45.601814 15780 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 1.332s	user 0.000s	sys 0.011s
W20260709 12:19:45.602555 13022 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a99436c294734e5cbc3657b2517cefca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:45.640173 13879 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:45.577297 15644 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:45.643889 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 115856us
I20260709 12:19:45.559580 15740 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.645422 13103 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:45.656621 13102 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.564s (SENT)
I20260709 12:19:45.613263 15764 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.575723 15552 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.648614 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:45.590894 13129 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:45.652259 15244 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:45.653376 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 76533us
I20260709 12:19:45.614807 15521 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.651120 13130 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:19:45.657639 13102 leader_election.cc:336] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.566s (SENT)
I20260709 12:19:45.574888 15637 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.635303 13128 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:19:45.611367 15661 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.612809 15557 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:45.653779 13882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 607) took 1387 ms (client timeout 1826 ms). Trace:
I20260709 12:19:45.663123 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:45.662648 13132 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:45.664824 13129 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:45.646438 15303 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:45.692648 15589 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:45.660229 15644 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.693405 15589 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:45.580432 15801 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.694176 15589 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.654305 15734 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.696023 15644 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.641511 15484 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:45.696632 15740 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:45.696741 15484 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.698640 15631 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.683898 15492 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:45.679973 15616 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:45.674841 13131 raft_consensus.cc:2410] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:19:45.662734 15812 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:45.683491 15791 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.703589 15801 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.673321 15244 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.704152 15791 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:45.706554 15244 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:45.708164 15808 log.cc:927] Time spent T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:19:45.674930 15637 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.684525 13135 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:19:45.656625 13022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 54239.3us
I20260709 12:19:45.690161 15557 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:45.685716 13882 rpcz_store.cc:269] 0709 12:19:44.266680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.270798 (+  4118us) service_pool.cc:224] Handling call
0709 12:19:45.653551 (+1382753us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b5400675f54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:45.653703 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286807424}
I20260709 12:19:45.665939 15552 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.721468 15801 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.746363 15801 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.693274 15303 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.748457 15801 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.748926 15303 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.749508 15303 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.749966 15303 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.695684 15734 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.751927 15492 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.752429 15492 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.753369 15734 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.636837 15662 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.754115 15662 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:45.754478 15662 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:45.755285 15662 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.756435 15662 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:45.698724 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 612) took 1430 ms. Trace:
W20260709 12:19:45.760782 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 103144us
I20260709 12:19:45.762455 15812 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:19:45.763027 13102 leader_election.cc:336] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 2.072s (SENT)
I20260709 12:19:45.763643 13102 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:45.763418 15812 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.650030 15793 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:19:45.768199 15484 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.747254 15552 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.723328 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:45.774075 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:45.774374 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:45.774983 13279 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:45.724689 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 547) took 1455 ms. Trace:
I20260709 12:19:45.734401 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 458) took 1457 ms. Trace:
I20260709 12:19:45.735757 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:45.743351 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:45.775897 13886 rpcz_store.cc:276] 0709 12:19:44.268937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.290111 (+ 21174us) service_pool.cc:224] Handling call
0709 12:19:45.724448 (+1434337us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540015f4d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:45.724607 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2603713920}
I20260709 12:19:45.776088 13203 rpcz_store.cc:276] 0709 12:19:44.277435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.277883 (+   448us) service_pool.cc:224] Handling call
0709 12:19:44.278284 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:45.305711 (+1027427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.734037 (+428326us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540041c8d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:45.734311 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742696192}
W20260709 12:19:45.776775 13277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2548) took 1389 ms (client timeout 1795 ms). Trace:
I20260709 12:19:45.776932 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:45.777266 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:45.777210 13277 rpcz_store.cc:269] 0709 12:19:44.411250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.743042 (+1331792us) service_pool.cc:224] Handling call
0709 12:19:45.776723 (+ 33681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:45.777545 13286 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
W20260709 12:19:45.743464 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 228058us
I20260709 12:19:45.744642 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:45.778323 13249 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:45.759588 13878 rpcz_store.cc:276] 0709 12:19:44.268561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.270030 (+  1469us) service_pool.cc:224] Handling call
0709 12:19:45.386776 (+1116746us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e66fc0 00007f70f9e51929 00007f70f9e513d2 00007f70f33c8bd4
0709 12:19:45.386951 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:45.387173 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:45.546765 (+159592us) log.cc:844] Serialized 14 byte log entry
0709 12:19:45.673643 (+126878us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:45.676816 (+  3173us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:45.698291 (+ 21475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:45.698382 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:45.698662 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19,"prepare.queue_time_us":175103,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":11022,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10370,"spinlock_wait_cycles":25108864,"thread_start_us":231390,"threads_started":2,"wal-append.queue_time_us":207292}
I20260709 12:19:45.683297 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:45.645855 15804 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:45.783391 13283 raft_consensus.cc:2393] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:45.786124 13249 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:45.788002 13134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 453) took 1429 ms. Trace:
I20260709 12:19:45.789398 13278 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:19:45.791603 13885 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 801) took 1509 ms (client timeout 1697 ms). Trace:
I20260709 12:19:45.788398 13134 rpcz_store.cc:276] 0709 12:19:44.346735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.347248 (+   513us) service_pool.cc:224] Handling call
0709 12:19:45.735552 (+1388304us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800001298. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:45.776389 (+ 40837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2701696}
I20260709 12:19:45.808168 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:45.808893 13282 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:45.721601 15244 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:45.809948 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 126738us
I20260709 12:19:45.672415 15664 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
W20260709 12:19:45.792061 13885 rpcz_store.cc:269] 0709 12:19:44.282588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.294460 (+ 11872us) service_pool.cc:224] Handling call
0709 12:19:45.773895 (+1479435us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:45.791545 (+ 17650us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4140928}
I20260709 12:19:45.819468 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.772796 15637 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.823589 13279 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:45.771185 15602 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.707180 15791 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:19:45.828047 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.829908 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.832966 13209 raft_consensus.cc:2410] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:19:45.833555 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 264317us
I20260709 12:19:45.834133 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:45.788378 15807 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:45.836629 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:45.843281 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:45.788146 15636 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:45.848953 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.846035 13209 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:45.849586 13208 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:19:45.846671 13840 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:45.843201 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:45.851293 13282 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:45.853159 13203 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:45.832026 15764 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:45.835769 15602 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.843672 15734 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:45.828393 15665 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:19:45.875321 13840 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:45.893232 13277 pending_rounds.cc:85] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 2
I20260709 12:19:45.893534 13277 pending_rounds.cc:107] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:19:45.893805 13277 raft_consensus.cc:2889] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:45.876549 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.877321 15734 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:45.876037 15824 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:45.848789 15238 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:45.896867 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.916334 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.935716 13203 raft_consensus.cc:2393] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:45.854100 15811 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:19:45.937570 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.938220 13212 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:45.938843 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.918345 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:45.869578 15753 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:45.891378 15551 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.935555 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:45.948778 13283 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:45.849449 15740 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.950764 13137 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
W20260709 12:19:45.952448 13137 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 452) took 1605 ms (client timeout 2035 ms). Trace:
I20260709 12:19:45.955312 15616 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:45.955603 15821 log.cc:927] Time spent T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:19:45.955799 15616 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.856304 15807 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:19:45.956701 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:45.930699 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.832638 15244 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.872452 15303 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.832197 15661 consensus_queue.cc:1059] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:19:45.934754 15734 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:45.940299 13278 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:45.849565 15810 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.921052 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:45.957634 13208 raft_consensus.cc:2410] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:45.892112 15764 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:45.869493 15633 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:19:45.875131 15817 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:45.916939 15552 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:45.946762 15753 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.891911 15602 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.963145 15551 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.996910 15809 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.997468 15809 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.997737 15552 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:45.998745 15551 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:45.964697 15740 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.001230 15740 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:45.949011 15824 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:46.004062 15764 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.004995 15824 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:46.005542 15824 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.005999 15824 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:46.007330 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:46.013983 13134 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:19:45.966593 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 129353us
W20260709 12:19:45.953984 13137 rpcz_store.cc:269] 0709 12:19:44.346422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.347392 (+   970us) service_pool.cc:224] Handling call
0709 12:19:45.723125 (+1375733us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5800001298. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:45.952101 (+228976us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39723392}
I20260709 12:19:45.937700 15811 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.956192 15616 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:45.986510 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:45.931849 15823 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:45.940627 15238 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:45.963976 13203 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:45.995257 15753 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:46.019778 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:45.979647 15303 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:46.021456 13278 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:46.028055 13279 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:45.947324 15524 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:46.000926 15552 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:46.031699 13137 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
W20260709 12:19:46.028539 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 153281us
I20260709 12:19:46.032516 13102 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:46.052771 13177 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.063925 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.064734 13278 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:46.069187 13177 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.072264 13102 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:46.007195 15810 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.066205 15501 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:46.029343 15823 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:46.073827 15823 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:46.029066 15589 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:46.073912 15524 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:46.074981 15810 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:46.076117 15524 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:46.033169 15798 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:46.029276 15811 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.082542 15811 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:46.085098 15637 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:46.085844 15637 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.087662 15801 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:46.088119 15801 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:46.088506 15801 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:46.088953 15602 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:46.034731 15809 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:46.089294 15789 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:46.089852 15789 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.090883 15589 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.062158 15303 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:46.093215 15303 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:46.091378 15589 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:46.096148 15589 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:46.096726 15801 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:46.030820 15238 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:46.099289 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:46.101668 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.102233 13278 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:19:46.106884 15789 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:46.107072 15804 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:46.107628 15789 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:46.108502 15244 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:46.108301 15789 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.109541 15734 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.117170 13129 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:46.115809 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:46.120150 13134 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:46.056994 15661 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:19:46.099598 15832 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:46.129232 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.130577 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.130837 15823 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.134819 15823 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:46.111265 15789 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:46.122139 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.122426 15824 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:46.137882 15667 raft_consensus.cc:3055] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:46.118530 15734 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:46.142930 13134 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:46.149257 13283 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:19:46.151149 13285 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
W20260709 12:19:46.150208 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 364140us
W20260709 12:19:46.153144 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 80964.2us
I20260709 12:19:46.153869 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.154700 13285 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:46.157042 13886 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:19:46.160712 13887 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:46.160699 13203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:36352
W20260709 12:19:46.162784 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:46.162899 13203 raft_consensus.cc:606] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:19:46.163950 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:46.164832 13885 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 2: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:46.162631 13840 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:46.168092 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:46.169742 13102 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:46.171491 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:46.173005 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.174595 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.175264 13130 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:46.177179 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.177882 13279 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:46.181355 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:46.185096 15817 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.186121 15817 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:46.189096 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.188237 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.191195 13283 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:46.191370 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:46.152360 15667 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:46.155943 15244 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.196491 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:46.206887 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.206050 13249 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:46.198866 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.208755 13102 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:46.196955 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.209777 13134 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:46.210702 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.211513 13134 raft_consensus.cc:2410] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:46.209136 13283 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:46.212814 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.213451 13284 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:46.213814 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.214668 13283 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:46.208125 13279 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:46.155933 15661 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:46.130913 15753 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.226692 13102 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:46.230340 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.230583 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:46.188235 15832 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:46.187698 15764 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:46.233943 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.231732 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.231791 13886 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:46.231702 13885 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:46.240577 13883 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:46.198083 15500 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:46.235577 13283 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:46.245463 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.246173 13284 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:46.246330 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:46.246850 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.235908 13102 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.233786 13249 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.206449 15524 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:46.244267 13840 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:46.299958 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 55847.9us
I20260709 12:19:46.300576 13284 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:46.295368 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:46.232726 15662 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:46.300933 13840 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:46.232546 15734 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.230907 15834 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:46.313446 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:46.319670 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 85947.3us
I20260709 12:19:46.354681 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.313190 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.302280 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.335119 13840 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:46.315666 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:46.239450 15823 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:46.238971 15414 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:46.269167 15551 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:46.224599 15244 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.350193 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:46.239180 15665 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:46.251104 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.300004 13886 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:46.228788 15616 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.249132 15501 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:46.387586 15644 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:46.388159 15501 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:46.389191 15644 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:46.307408 15643 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.358932 13879 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:46.313992 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.312431 13882 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:46.396680 15643 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.397725 15616 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:46.398536 15813 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:46.398885 15643 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:46.359719 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:46.399641 15813 raft_consensus.cc:3055] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:46.400053 15813 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:46.400713 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.400826 15813 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.401669 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.402137 15813 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:46.402415 15589 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:46.402979 13249 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:46.341575 15735 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:46.408376 15735 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:46.408550 13034 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42064 (request call id 320) took 12377 ms (client timeout 15000 ms). Trace:
W20260709 12:19:46.408727 15848 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:19:46.312745 15667 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:46.338358 15834 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.409675 15834 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:46.409932 15667 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:46.341216 15631 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:46.410952 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.341037 15804 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:46.411741 15804 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:46.412103 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:46.320032 15840 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:46.337247 15838 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:46.412678 15840 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.413108 15840 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:46.412855 15838 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:46.415045 15838 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:46.376070 13883 raft_consensus.cc:2393] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:46.239678 15809 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:19:46.383217 15789 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:19:46.357585 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 44240.9us
I20260709 12:19:46.371060 15811 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:46.371392 15633 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:46.403374 15589 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:46.403965 15846 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:46.407820 15643 raft_consensus.cc:1064] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:46.408797 15735 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:46.246438 15636 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:19:46.412266 15804 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:46.409971 13033 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 4 to 5, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 5 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:46.417423 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:46.422150 13129 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:46.380942 13133 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:46.245939 15824 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:19:46.370325 15551 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.370163 15602 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:46.362259 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:46.449018 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.351912 15734 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.459590 15854 raft_consensus.cc:2764] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:19:46.460093 15474 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:46.461936 15238 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.463054 15589 raft_consensus.cc:697] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:46.445515 15811 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.369599 15852 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 12:19:46.450452 15616 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:19:46.464551 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.450277 15633 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:46.473433 15857 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.083s	user 0.000s	sys 0.002s
W20260709 12:19:46.416805 13034 rpcz_store.cc:269] 0709 12:19:34.069517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.069828 (+   311us) service_pool.cc:224] Handling call
0709 12:19:46.408437 (+12338609us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:42.371338 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:42.372095 (+   757us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:42.372146 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:19:42.372187 (+    41us) tablet.cc:662] Decoding operations
0709 12:19:42.372959 (+   772us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:42.373061 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:42.373096 (+    35us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:19:42.375095 (+  1999us) tablet.cc:701] Row locks acquired
0709 12:19:42.375239 (+   144us) write_op.cc:260] PREPARE: finished
0709 12:19:42.375399 (+   160us) write_op.cc:270] Start()
0709 12:19:42.375562 (+   163us) write_op.cc:276] Timestamp: P: 1783599582375338 usec, L: 0
0709 12:19:42.375585 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:19:42.469979 (+ 94394us) log.cc:844] Serialized 2064 byte log entry
0709 12:19:42.999972 (+529993us) op_driver.cc:464] REPLICATION: finished
0709 12:19:43.311261 (+311289us) write_op.cc:301] APPLY: starting
0709 12:19:43.311386 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:43.323975 (+ 12589us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:43.370798 (+ 46823us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:43.511366 (+140568us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:43.511701 (+   335us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:19:43.511749 (+    48us) write_op.cc:312] APPLY: finished
0709 12:19:43.519987 (+  8238us) log.cc:844] Serialized 47 byte log entry
0709 12:19:43.523657 (+  3670us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:43.523777 (+   120us) write_op.cc:454] Released schema lock
0709 12:19:43.523844 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:43.524398 (+   554us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:43.524435 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32802,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":302055,"apply.run_cpu_time_us":4253,"apply.run_wall_time_us":221945,"num_ops":5,"prepare.queue_time_us":172876,"prepare.run_cpu_time_us":19802,"prepare.run_wall_time_us":334256,"raft.queue_time_us":213369,"raft.run_cpu_time_us":23358,"raft.run_wall_time_us":245834,"replication_time_us":624206,"thread_start_us":583806,"threads_started":4,"wal-append.queue_time_us":313686,"wal-append.run_cpu_time_us":36813,"wal-append.run_wall_time_us":1854943}]]}
I20260709 12:19:46.480075 15661 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:46.481576 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:46.481786 15846 raft_consensus.cc:697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:46.482931 15753 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:46.478991 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.663405 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.722126 13033 catalog_manager.cc:5697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.722404 15846 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.723012 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.723802 13277 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:19:46.724320 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.724826 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:46.771883 13277 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:46.725505 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.725747 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.726765 13887 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:46.726902 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.727947 15551 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:46.728024 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.728734 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.728947 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.729439 15602 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:46.784751 13879 raft_consensus.cc:2368] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5.
I20260709 12:19:46.784785 13884 raft_consensus.cc:2393] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:46.729730 15589 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.728890 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:46.732188 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:46.789990 13283 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:46.705308 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 55220.8us
I20260709 12:19:46.672971 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.791936 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.792568 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.733438 13281 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:46.734120 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.795166 13136 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 2.
I20260709 12:19:46.664747 15492 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:46.734601 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.796434 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.796648 13130 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:46.734722 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.797151 13212 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:46.673394 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.468010 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.797900 13207 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:46.798012 13132 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:46.436852 15801 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:46.448720 15810 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.288s
I20260709 12:19:46.736127 15118 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:46.735383 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.736528 15633 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:46.737282 15238 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:46.737403 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.788048 15602 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:46.821664 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.483883 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:46.738662 15734 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:46.675333 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.483553 15637 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:46.721027 15244 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:46.744640 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 156771us
I20260709 12:19:46.826086 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.826726 13136 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:46.829440 13102 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:46.723743 13033 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.748937 15643 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.750837 15844 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.753485 15753 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:46.753703 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.754766 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:46.758039 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:46.848939 13249 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:46.758564 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.760331 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.762094 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.751703 15735 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.725557 13284 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:46.851179 13205 raft_consensus.cc:2410] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:19:46.796787 13882 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:46.851809 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.852612 13284 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:46.853751 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.854635 13284 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:46.727491 15811 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:46.779347 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.779506 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.779408 13883 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:46.860947 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.861171 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.861665 13883 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:46.862486 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.862610 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.863057 13883 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:46.778625 13285 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:46.730110 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.688468 13209 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:46.589514 15834 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.795639 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.814574 13282 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:46.834630 15807 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 12:19:46.815973 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:46.816311 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:46.816311 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.817734 13137 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:46.904688 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:46.899493 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.905084 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.905393 13282 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:46.906134 13206 raft_consensus.cc:2410] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:46.822959 13210 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:19:46.823230 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:46.824261 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.832919 13033 catalog_manager.cc:5697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.835886 13100 leader_election.cc:400] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5.
I20260709 12:19:46.837774 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:46.907249 13100 leader_election.cc:403] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:46.847083 13283 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:46.877672 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:46.908588 13133 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:46.870790 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:46.909629 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 73948.2us
W20260709 12:19:46.907514 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 84358.4us
I20260709 12:19:46.910115 13281 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:46.910678 13100 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:46.911109 13279 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:46.906810 13210 pending_rounds.cc:85] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 7
I20260709 12:19:46.911826 13210 pending_rounds.cc:107] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:19:46.901535 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.912282 13210 raft_consensus.cc:2889] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:46.865945 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.913199 13207 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:46.913662 13840 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:46.863914 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.911374 13103 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:46.914816 13135 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:46.839717 15824 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.915859 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:46.916409 13135 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:46.847996 15500 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:46.881361 15840 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.879217 13881 raft_consensus.cc:2368] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6.
I20260709 12:19:46.920452 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 810) took 1342 ms. Trace:
I20260709 12:19:46.876421 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.921000 13881 rpcz_store.cc:276] 0709 12:19:45.578156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.483576 (+905420us) service_pool.cc:224] Handling call
0709 12:19:46.920389 (+436813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:46.863324 13885 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:19:46.922969 13887 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:46.923666 15832 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:46.908296 13033 catalog_manager.cc:5697] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 4, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 4 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.871241 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:46.925827 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.926563 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.915946 15824 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:46.866222 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.898650 13841 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:46.865926 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.906520 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:46.942994 13100 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:46.943964 13206 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:46.944193 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:46.927088 13033 catalog_manager.cc:5697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 3 to 4, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 4 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.945072 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.945240 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:46.912609 13205 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:46.945621 13033 catalog_manager.cc:5697] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 2 to 4, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 4 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.946731 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.927188 13212 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:46.927126 13280 raft_consensus.cc:2393] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:46.941756 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.948913 13033 catalog_manager.cc:5697] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 4 to 5, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 5 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.929370 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.952841 13177 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:46.953745 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 55186.9us
I20260709 12:19:46.955051 13205 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:46.953768 13177 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.935395 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.958051 13285 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:46.958688 13209 raft_consensus.cc:2393] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:46.935187 13282 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:19:46.957742 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.960223 13285 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:19:46.960656 15718 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:46.961217 15718 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:46.962148 15718 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:46.965202 13177 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.937016 13135 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:46.967585 15644 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:46.968114 15644 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.968573 15644 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:46.972620 13177 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:46.974469 15851 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:46.974901 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.984155 15851 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:46.984580 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.984696 15851 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.985535 13135 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:46.985702 15851 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:46.986697 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:46.980705 13033 catalog_manager.cc:5697] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.987421 13135 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:46.927488 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:47.009980 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:47.011598 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:47.010138 13284 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:19:47.011986 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:47.012687 13283 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
W20260709 12:19:47.015663 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 71582.8us
W20260709 12:19:47.016077 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 104760us
I20260709 12:19:47.016374 13100 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:47.017033 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:47.021471 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:47.021966 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:47.022079 13211 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:47.023171 13841 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:47.020879 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:47.024093 13284 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:47.025044 13135 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:47.029605 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:47.029398 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:47.030570 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.888770 13882 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 5 LEARNER]: Advancing to term 6
I20260709 12:19:47.029605 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:47.034116 13281 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:47.030797 13210 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:47.036795 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:47.037810 13879 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 3: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:47.038311 13277 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:19:46.877641 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:47.045091 13281 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:19:46.942466 15664 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:46.942870 15616 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:47.061012 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:46.941977 15789 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:46.927407 15636 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:19:47.061784 13884 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:47.057402 13137 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:47.065533 13100 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:47.026726 15501 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:47.026402 15791 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:46.926920 15842 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:47.066949 13100 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:47.029644 15832 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:47.025924 15852 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:46.860940 15844 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:47.026882 15753 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:47.060324 13279 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:47.029354 15524 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:47.029984 15836 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:47.174898 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:47.037029 15662 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:47.169495 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:47.186887 13252 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:47.062002 13880 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:19:47.246043 13886 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.009s	sys 0.025s
W20260709 12:19:47.158623 15862 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 12:19:47.110287 13129 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:47.037307 15484 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:47.103149 13133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:19:47.302947 13133 raft_consensus.cc:606] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:47.303563 13133 raft_consensus.cc:614] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:47.263794 15846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.012s	sys 0.007s
I20260709 12:19:47.251684 13840 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:47.066383 15792 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.193s
I20260709 12:19:47.259207 13882 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:47.172901 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:47.233589 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:47.251646 13279 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:47.073493 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 304439us
I20260709 12:19:47.260900 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:47.049459 15238 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:47.029551 15463 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:47.267109 13135 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:47.277019 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:47.325070 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 48140.8us
I20260709 12:19:47.101895 15813 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.233s
W20260709 12:19:47.272655 13286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.020s	sys 0.014s
I20260709 12:19:47.162011 15811 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:47.159857 15856 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:19:47.256811 13212 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:47.067951 15664 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:47.291173 13886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.009s	sys 0.025s
W20260709 12:19:47.291364 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 224479us
W20260709 12:19:47.292145 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 105391us
I20260709 12:19:47.072247 15807 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:47.070832 15501 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.234203 15557 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.056022 15734 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.203s
I20260709 12:19:47.255875 15832 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:47.398661 15643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.013s	sys 0.032s
I20260709 12:19:47.260207 15524 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.075270 15521 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:19:47.306708 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 55125.6us
I20260709 12:19:47.424245 13840 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:47.307413 15836 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:47.317273 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:47.318123 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:47.066545 15809 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.236s
I20260709 12:19:47.319080 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:47.255627 15753 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:47.292773 15662 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.264976 15852 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.326731 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:47.277479 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:47.331255 13286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.021s	sys 0.014s
W20260709 12:19:47.305408 15846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.012s	sys 0.008s
I20260709 12:19:47.332402 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:47.405611 15854 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:47.074731 15789 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:47.164906 15804 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:47.297745 15118 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:19:47.321368 15834 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:47.303148 15823 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:47.305572 15474 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:47.403342 13100 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:47.380231 15633 consensus_meta.cc:287] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.001s
I20260709 12:19:47.415859 13137 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:47.383741 15801 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:47.434705 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:47.405417 15664 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:47.433462 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:47.463905 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 60652.5us
I20260709 12:19:47.464484 13879 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:47.305106 15484 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:47.435038 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:47.441975 15836 raft_consensus.cc:697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:47.427332 15644 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:47.468680 15484 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:47.455732 15474 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.456728 15823 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:47.460531 15801 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:47.438849 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 112209us
I20260709 12:19:47.439733 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:47.427031 15643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.013s	sys 0.032s
I20260709 12:19:47.462953 15824 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:47.426808 15832 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:47.447388 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 606034us
I20260709 12:19:47.508174 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:47.429787 15524 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:47.449597 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 457960us
I20260709 12:19:47.434806 15662 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:47.455865 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:47.410645 15843 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:19:47.431284 15753 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:47.434969 15852 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:47.400300 15791 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.459231 13209 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 2.
I20260709 12:19:47.418943 15557 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:47.465044 13100 leader_election.cc:400] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6.
I20260709 12:19:47.525835 13100 leader_election.cc:403] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:19:47.526458 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 61609.7us
I20260709 12:19:47.412338 15501 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:47.535672 15492 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6.
I20260709 12:19:47.536635 15500 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:47.538486 15500 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:47.467659 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:47.540563 13879 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:47.450722 15793 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:47.442291 15463 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 12:19:47.439054 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 445928us
I20260709 12:19:47.479791 15823 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:47.421829 15244 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.007s	sys 0.017s
I20260709 12:19:47.492822 13205 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:47.493496 15801 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:47.473148 15616 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:47.478946 15474 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:47.468788 13882 raft_consensus.cc:2376] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5. Re-sending same reply.
I20260709 12:19:47.460438 15633 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:47.445770 15854 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:47.469390 15812 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:47.493642 13277 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:47.491711 15861 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:19:47.514720 13102 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:47.555998 15865 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:19:47.519237 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:47.577426 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 58313.9us
W20260709 12:19:47.558701 15244 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.008s	sys 0.018s
I20260709 12:19:47.562026 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:47.581918 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 67292.2us
I20260709 12:19:47.582782 13129 raft_consensus.cc:2410] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:19:47.516601 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:47.565836 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:47.568315 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 161631us
I20260709 12:19:47.541533 15793 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.583932 13102 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:47.580022 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:47.544658 15791 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:47.586516 13175 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:47.545589 15881 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:47.565256 15851 consensus_meta.cc:287] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.002s
W20260709 12:19:47.636148 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 52298.9us
I20260709 12:19:47.630046 13252 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:47.557852 15118 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:19:47.656821 13204 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.010s	sys 0.014s
I20260709 12:19:47.659495 13252 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:47.577039 15844 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:47.564846 15878 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:47.589180 15811 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:47.590165 15793 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:47.676348 13277 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 3.
I20260709 12:19:47.669579 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:47.685398 13102 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:47.687814 13102 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:47.672139 15789 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:47.649904 15521 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:47.656839 15834 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.629979 15817 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:47.650861 15661 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:47.697094 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:47.680457 13878 raft_consensus.cc:2368] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6.
I20260709 12:19:47.664912 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:47.664518 15589 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:47.725660 15804 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:47.671073 13204 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.013s	sys 0.015s
I20260709 12:19:47.746994 15891 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:47.695377 15812 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:47.704385 15554 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:47.668388 15851 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:47.576113 15836 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:47.724771 15500 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:19:47.720839 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1711) took 1565 ms. Trace:
I20260709 12:19:47.716791 15881 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:47.722491 15843 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:47.696818 13249 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:47.723603 15789 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:47.777319 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:47.691817 15883 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.780659 13840 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:47.793569 13177 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:47.676968 15118 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:47.795871 15644 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:47.710835 15616 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:47.784612 15661 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:47.808331 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 111885us
I20260709 12:19:47.780294 15834 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:47.843144 13249 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:47.808051 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:47.810017 13283 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:47.846657 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:47.847256 13283 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:19:47.847882 15834 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:47.849548 15118 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:47.834370 15881 consensus_queue.cc:1059] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:19:47.813158 15665 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:47.851344 15881 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:47.851594 15665 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:47.851783 15881 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:47.729223 15521 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:19:47.852629 15881 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:47.854514 15870 log.cc:927] Time spent T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 12:19:47.856340 15892 log.cc:927] Time spent T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:19:47.857362 15866 log.cc:927] Time spent T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.478s	user 0.004s	sys 0.001s
I20260709 12:19:47.813875 15804 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:47.857954 15804 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:47.858417 15804 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:47.858764 15817 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:47.859269 15817 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:47.859664 15817 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:47.864180 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1190) took 1405 ms. Trace:
I20260709 12:19:47.864566 15851 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:47.864619 13137 rpcz_store.cc:276] 0709 12:19:46.458866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.147840 (+688974us) service_pool.cc:224] Handling call
0709 12:19:47.148229 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:47.456357 (+308128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:47.863909 (+407552us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400061154. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:47.864099 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615027584}
I20260709 12:19:47.829965 13207 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:47.774784 15643 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:47.835316 15889 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:19:47.796792 15891 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:47.809829 15867 log.cc:927] Time spent T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 12:19:47.801415 15554 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.799105 15812 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:47.816367 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 88201.3us
I20260709 12:19:47.835086 13177 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:47.844887 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:47.873929 13283 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:47.832297 15345 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:47.813989 15633 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:47.907089 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 814) took 1178 ms. Trace:
I20260709 12:19:47.832158 15884 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.938191 15884 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:47.874775 13277 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:47.798460 15589 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:47.829205 15903 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:47.845626 15602 consensus_meta.cc:287] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.005s	user 0.012s	sys 0.000s
W20260709 12:19:47.912675 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 67858us
I20260709 12:19:47.913515 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:47.956909 13283 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:47.914415 13840 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:47.931975 15869 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
W20260709 12:19:47.932889 15888 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 12:19:47.933656 15876 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:19:47.935597 15345 raft_consensus.cc:697] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:47.936630 15500 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:47.937614 15807 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:47.845817 15661 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:47.926079 13886 rpcz_store.cc:276] 0709 12:19:46.728316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.729347 (+  1031us) service_pool.cc:224] Handling call
0709 12:19:46.729655 (+   308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:46.730020 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:46.730048 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:46.730584 (+   536us) log.cc:844] Serialized 52 byte log entry
0709 12:19:47.404366 (+673782us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:47.404428 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:47.404523 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:47.856623 (+452100us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:47.869341 (+ 12718us) raft_consensus.cc:1685] finished
0709 12:19:47.869372 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:47.907019 (+ 37647us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4687,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":40338816,"thread_start_us":673311,"threads_started":1,"wal-append.queue_time_us":569040}
I20260709 12:19:47.916764 15812 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:47.865662 15877 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:19:47.916875 15554 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:47.947304 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 112282us
I20260709 12:19:47.912071 15891 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:47.908684 15643 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:19:47.961277 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 46971.7us
I20260709 12:19:47.954509 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:48.014853 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 60429.7us
I20260709 12:19:47.909168 15118 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.964458 15910 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.967638 15902 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:47.917812 13281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.029s	sys 0.050s
W20260709 12:19:48.033294 13281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.030s	sys 0.050s
I20260709 12:19:47.947350 15851 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:47.926749 15789 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:47.959100 15667 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:48.048653 13210 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:47.829496 15883 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.015815 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:48.020071 13840 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:48.029076 15879 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
W20260709 12:19:48.029826 15897 log.cc:927] Time spent T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:19:48.030125 15899 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:47.998602 15807 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:47.988245 15633 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:47.910432 15881 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:48.008054 15636 consensus_meta.cc:287] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.902s	user 0.009s	sys 0.002s
I20260709 12:19:48.061161 15636 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5.
I20260709 12:19:47.951063 15484 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:48.032258 15903 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:19:48.055517 15899 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.066377 15345 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.067020 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2575) took 1224 ms. Trace:
I20260709 12:19:48.067857 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:48.033218 15902 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:48.044101 15904 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:48.044140 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 457674us
I20260709 12:19:48.045596 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1715) took 1689 ms. Trace:
I20260709 12:19:48.045790 13886 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:48.050696 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:48.071100 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 825) took 1001 ms. Trace:
I20260709 12:19:48.076198 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:48.066967 15899 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:48.075353 13130 rpcz_store.cc:276] 0709 12:19:46.356066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.057737 (+701671us) service_pool.cc:224] Handling call
0709 12:19:47.058026 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:47.058349 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:47.058385 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:47.068921 (+ 10536us) log.cc:844] Serialized 26 byte log entry
0709 12:19:47.458794 (+389873us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:47.580699 (+121905us) log.cc:844] Serialized 14 byte log entry
0709 12:19:47.636860 (+ 56161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:47.636967 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:48.045346 (+408379us) raft_consensus.cc:1685] finished
0709 12:19:48.045365 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:48.045517 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50259,"prepare.queue_time_us":289880,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":8443,"raft.queue_time_us":53044,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":23804,"thread_start_us":396352,"threads_started":2,"wal-append.queue_time_us":413256}
I20260709 12:19:48.032021 15843 raft_consensus.cc:2764] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:19:47.969897 15602 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.019912 15643 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:48.057809 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 400) took 1847 ms. Trace:
I20260709 12:19:48.060577 15882 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:48.070866 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2567) took 1646 ms. Trace:
I20260709 12:19:48.071380 13132 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:48.067526 13281 rpcz_store.cc:276] 0709 12:19:46.842997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.072468 (+229471us) service_pool.cc:224] Handling call
0709 12:19:47.072899 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:47.095346 (+ 22447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:47.095396 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:47.096096 (+   700us) log.cc:844] Serialized 26 byte log entry
0709 12:19:48.043036 (+946940us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:48.053786 (+ 10750us) log.cc:844] Serialized 14 byte log entry
0709 12:19:48.054018 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:48.054085 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:48.066796 (+ 12711us) raft_consensus.cc:1685] finished
0709 12:19:48.066817 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:48.066954 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21813,"prepare.queue_time_us":10567,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":6108,"raft.queue_time_us":23759,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":48322,"thread_start_us":937272,"threads_started":1,"wal-append.queue_time_us":900021}
I20260709 12:19:48.041442 15854 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:48.053520 15824 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:48.082302 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:48.042214 15878 raft_consensus.cc:697] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:48.043727 13277 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:48.084894 15484 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.085476 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:48.053241 15851 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:48.005004 15817 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:48.072192 15501 consensus_meta.cc:287] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.000s
I20260709 12:19:48.041879 15118 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.108672 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:48.077512 15902 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:48.078223 15633 raft_consensus.cc:697] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:47.806042 13131 rpcz_store.cc:276] 0709 12:19:46.152310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.155782 (+  3472us) service_pool.cc:224] Handling call
0709 12:19:46.229190 (+ 73408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:46.304064 (+ 74874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:46.335716 (+ 31652us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:46.415940 (+ 80224us) log.cc:844] Serialized 26 byte log entry
0709 12:19:47.031220 (+615280us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:47.050087 (+ 18867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:47.060967 (+ 10880us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:47.695005 (+634038us) raft_consensus.cc:1685] finished
0709 12:19:47.695025 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:47.717958 (+ 22933us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25408,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":44797,"thread_start_us":490993,"threads_started":1,"wal-append.queue_time_us":707954}
I20260709 12:19:48.077438 15644 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:48.075847 13885 rpcz_store.cc:276] 0709 12:19:47.069400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.102243 (+ 32843us) service_pool.cc:224] Handling call
0709 12:19:47.102685 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:47.102992 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:47.455614 (+352622us) log.cc:844] Serialized 14 byte log entry
0709 12:19:48.070537 (+614923us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b18003f79c0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f4a354bc 00007f70f1d8348b 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d23a
0709 12:19:48.070764 (+   227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:48.070812 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:48.070859 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:48.070935 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:48.071047 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":406470,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":3500,"spinlock_wait_cycles":13455616,"thread_start_us":404852,"threads_started":2,"wal-append.queue_time_us":470797}
I20260709 12:19:48.053473 15667 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:48.041401 15910 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:48.159089 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:48.122476 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:48.221614 13278 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:48.301965 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 247768us
I20260709 12:19:48.337653 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:48.341200 13177 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:48.117573 13286 rpcz_store.cc:276] 0709 12:19:46.206482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.750117 (+543635us) service_pool.cc:224] Handling call
0709 12:19:46.750595 (+   478us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:46.751049 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:46.751075 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:46.751709 (+   634us) log.cc:844] Serialized 52 byte log entry
0709 12:19:47.433151 (+681442us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:47.433206 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:47.433298 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:48.054045 (+620747us) raft_consensus.cc:1685] finished
0709 12:19:48.054066 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:48.054177 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":681013,"threads_started":1,"wal-append.queue_time_us":699453}
I20260709 12:19:48.341572 13281 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
W20260709 12:19:48.351732 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 229372us
I20260709 12:19:48.351790 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:48.354359 13277 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:48.356374 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 232968us
I20260709 12:19:48.077522 15884 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.365006 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:48.328560 15735 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.374517 13212 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:19:48.319680 15753 consensus_meta.cc:287] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.004s
W20260709 12:19:48.317207 15551 consensus_meta.cc:287] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.520s	user 0.013s	sys 0.001s
I20260709 12:19:48.372933 13130 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:48.337634 13285 rpcz_store.cc:276] 0709 12:19:46.424269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.961574 (+537305us) service_pool.cc:224] Handling call
0709 12:19:46.961942 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:46.962602 (+   660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:46.962746 (+   144us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:46.963255 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:19:47.414871 (+451616us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:47.577508 (+162637us) log.cc:844] Serialized 14 byte log entry
0709 12:19:47.774286 (+196778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:47.774413 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:48.070616 (+296203us) raft_consensus.cc:1685] finished
0709 12:19:48.070634 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:48.070803 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":394462,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":134722,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":10604,"thread_start_us":783837,"threads_started":3,"wal-append.queue_time_us":624885}
I20260709 12:19:48.373262 15616 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.380566 15616 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.377532 13277 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:19:48.353588 15644 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.103029 15904 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:48.280342 13882 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:48.383399 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:48.365473 15804 consensus_meta.cc:287] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.507s	user 0.013s	sys 0.001s
I20260709 12:19:48.337786 15824 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.364174 15854 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:48.370865 15882 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.378113 15589 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:48.382582 15901 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:19:48.393558 15832 consensus_meta.cc:287] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.868s	user 0.015s	sys 0.000s
W20260709 12:19:48.457106 15801 consensus_meta.cc:287] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.892s	user 0.016s	sys 0.007s
I20260709 12:19:48.353835 15501 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.479413 15894 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:48.479933 15894 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:48.480296 15894 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:48.453920 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:48.480500 15851 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:48.492465 15817 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:48.255517 15789 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.386025 15551 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.391410 15804 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:48.386224 15753 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.469410 15883 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:48.476432 15633 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.484375 15801 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.474407 15832 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.497506 15878 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.595105 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:48.665191 13277 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:19:48.633414 13129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.009s	sys 0.031s
W20260709 12:19:48.666885 13129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.010s	sys 0.032s
I20260709 12:19:48.526851 13887 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:48.501024 15602 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:48.392064 15824 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:48.514431 15501 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:48.604424 15915 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 12:19:48.534224 15930 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:19:48.694885 13134 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:19:48.535738 13128 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:48.595492 15840 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.556141 15644 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:48.459733 15882 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:48.555754 15484 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:48.721839 15484 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:48.723793 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:48.724094 15484 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.724572 13277 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:48.700953 15753 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.681493 15118 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:48.724613 15840 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:48.715073 15920 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 12:19:48.703049 15474 consensus_meta.cc:287] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.128s	user 0.008s	sys 0.013s
W20260709 12:19:48.712002 15664 consensus_meta.cc:287] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.241s	user 0.010s	sys 0.003s
I20260709 12:19:48.384136 15918 consensus_queue.cc:1059] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.625s
I20260709 12:19:48.729079 15840 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.710022 15667 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.690760 15904 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:48.739980 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:48.730566 15812 consensus_meta.cc:287] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.713s	user 0.012s	sys 0.000s
I20260709 12:19:48.724640 15484 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:48.746197 15812 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:48.748590 15840 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.750202 15812 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:48.758468 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 389418us
I20260709 12:19:48.759070 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:48.761360 13249 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:19:48.749948 15793 consensus_meta.cc:287] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 1.039s	user 0.008s	sys 0.003s
I20260709 12:19:48.750020 15484 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:48.729796 15910 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.740291 15664 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:48.771924 15345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.022s	sys 0.080s
I20260709 12:19:48.758333 15804 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:48.738468 15474 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.738730 15616 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:48.838083 15662 consensus_meta.cc:287] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.280s	user 0.011s	sys 0.003s
I20260709 12:19:48.838554 15662 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.787576 15904 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:19:48.855542 15899 consensus_meta.cc:287] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.005s
W20260709 12:19:48.856936 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 95650.4us
I20260709 12:19:48.857275 13136 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:48.857782 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:48.829250 15602 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:48.860335 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2594) took 2410 ms. Trace:
I20260709 12:19:48.864544 13203 rpcz_store.cc:276] 0709 12:19:46.449730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.450509 (+   779us) service_pool.cc:224] Handling call
0709 12:19:46.459818 (+  9309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:46.484366 (+ 24548us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:46.960095 (+475729us) log.cc:844] Serialized 14 byte log entry
0709 12:19:47.408596 (+448501us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:47.408666 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:47.408730 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:48.860020 (+1451290us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b54002ee854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:48.860085 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:48.860256 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1024,"prepare.queue_time_us":674364,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":9885,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8116,"spinlock_wait_cycles":55902464,"thread_start_us":923510,"threads_started":2,"wal-append.queue_time_us":829696,"wal-append.run_cpu_time_us":1174,"wal-append.run_wall_time_us":1061421}
I20260709 12:19:48.868809 13277 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:19:48.877830 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:48.885385 13130 consensus_meta.cc:287] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.000s
I20260709 12:19:48.885898 13130 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:19:48.886667 13286 raft_consensus.cc:2393] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 4: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:48.860344 15904 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:48.773131 15793 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.891471 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:48.856143 15899 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:48.892269 15524 consensus_meta.cc:287] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.346s	user 0.005s	sys 0.008s
I20260709 12:19:48.892199 15474 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:48.877156 15804 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:48.908720 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:48.907611 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:48.910233 13286 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:48.909603 13285 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:48.913009 13211 raft_consensus.cc:606] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:48.913534 13211 raft_consensus.cc:614] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:48.906672 15524 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.916916 15524 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:48.920192 15662 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:48.867561 15602 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:48.894981 15791 consensus_meta.cc:287] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 1.245s	user 0.009s	sys 0.004s
I20260709 12:19:48.869798 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:48.922015 15823 consensus_meta.cc:287] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.345s	user 0.011s	sys 0.002s
W20260709 12:19:48.922500 15554 consensus_meta.cc:287] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.890s	user 0.012s	sys 0.005s
W20260709 12:19:48.902989 15852 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 1.340s	user 0.010s	sys 0.003s
W20260709 12:19:48.946762 15891 consensus_meta.cc:287] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.899s	user 0.006s	sys 0.005s
I20260709 12:19:48.946834 15557 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.947367 15904 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.948364 15602 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:48.949110 15793 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.921466 15484 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:48.955770 15836 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:48.966930 13841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.005s	sys 0.024s
W20260709 12:19:48.967671 15873 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 1.504s	user 0.007s	sys 0.010s
W20260709 12:19:48.968274 13841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.006s	sys 0.024s
I20260709 12:19:48.930851 15791 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:48.957484 15662 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:48.973320 13885 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.025s	sys 0.024s
W20260709 12:19:48.975381 13885 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.026s	sys 0.025s
I20260709 12:19:48.987416 13286 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:19:48.991779 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:48.934623 15824 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:48.994081 13286 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:48.930922 15894 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.956264 15823 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.966076 15832 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:48.965958 15801 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:48.971307 13881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.006s	sys 0.023s
I20260709 12:19:48.962831 15554 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:49.013783 13282 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:48.999326 15484 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.970989 15345 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:49.006296 13206 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:19:48.963773 15891 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:49.023818 13279 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:48.968988 15836 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:48.998785 15662 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:49.014572 13881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.006s	sys 0.028s
I20260709 12:19:49.014214 15929 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.016011 15664 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:49.023558 15807 consensus_meta.cc:287] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.949s	user 0.012s	sys 0.005s
W20260709 12:19:49.042336 13838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.040s	sys 0.079s
W20260709 12:19:49.044977 13838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.040s	sys 0.080s
I20260709 12:19:48.963750 15852 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:19:49.046435 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 688781us
I20260709 12:19:49.031332 15891 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:49.023624 15484 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:49.026337 15345 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:49.077945 13209 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:19:49.062232 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:49.047467 15832 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.088498 13286 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:19:49.090989 13286 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:19:49.054560 15922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.026s	sys 0.038s
I20260709 12:19:49.092538 15662 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:49.053112 15929 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:49.093724 13878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 618) took 2920 ms (client timeout 1619 ms). Trace:
I20260709 12:19:49.093912 13136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1205) took 1582 ms. Trace:
I20260709 12:19:49.094242 15832 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:49.096030 15661 consensus_meta.cc:287] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.078s	user 0.015s	sys 0.008s
I20260709 12:19:49.097674 15484 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:49.097882 15931 log.cc:927] Time spent T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:19:49.099681 15345 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:49.100281 15554 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:49.101858 15891 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.102496 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2605) took 1054 ms. Trace:
I20260709 12:19:49.102650 15936 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:49.052714 15899 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:49.122797 13884 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.001s	sys 0.037s
W20260709 12:19:49.123150 13884 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.001s	sys 0.037s
I20260709 12:19:49.120784 13206 rpcz_store.cc:276] 0709 12:19:48.048357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.052872 (+  4515us) service_pool.cc:224] Handling call
0709 12:19:48.053193 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.020104 (+966911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.102242 (+ 82138us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54002a26d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:49.102430 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2191313792}
W20260709 12:19:49.103463 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 49882us
I20260709 12:19:49.071959 15664 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:49.108902 15852 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
W20260709 12:19:49.050444 15851 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.011s	sys 0.061s
W20260709 12:19:49.103299 15902 consensus_meta.cc:287] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.000s
I20260709 12:19:49.110217 13286 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:49.070613 15836 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:49.112195 13136 rpcz_store.cc:276] 0709 12:19:47.514562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.516301 (+  1739us) service_pool.cc:224] Handling call
0709 12:19:49.093719 (+1577418us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002b4b54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:49.093851 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2929443072}
I20260709 12:19:49.148346 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:49.115056 15661 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:49.121666 13839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.008s	sys 0.025s
I20260709 12:19:49.179858 15929 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:49.115260 15922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.029s	sys 0.042s
W20260709 12:19:49.121650 15643 consensus_meta.cc:287] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.931s	user 0.013s	sys 0.000s
I20260709 12:19:49.153934 15891 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:49.226842 15643 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:49.049124 15807 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:49.225906 13839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.008s	sys 0.025s
W20260709 12:19:49.216043 13883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 621) took 1898 ms (client timeout 2388 ms). Trace:
W20260709 12:19:49.221135 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 321076us
W20260709 12:19:49.112090 13878 rpcz_store.cc:269] 0709 12:19:46.172911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.188960 (+ 16049us) service_pool.cc:224] Handling call
0709 12:19:49.093488 (+2904528us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54005f0fd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:49.093644 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2865837824}
I20260709 12:19:49.220115 13879 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
W20260709 12:19:49.231669 13205 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36412 (request call id 482) took 1998 ms (client timeout 1780 ms). Trace:
I20260709 12:19:49.217633 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 409) took 2320 ms. Trace:
W20260709 12:19:49.232108 13205 rpcz_store.cc:269] 0709 12:19:47.232971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.233255 (+   284us) service_pool.cc:224] Handling call
0709 12:19:49.231199 (+1997944us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400215cd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:49.231389 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405718272}
I20260709 12:19:49.218690 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2602) took 1174 ms. Trace:
I20260709 12:19:49.233645 13209 rpcz_store.cc:276] 0709 12:19:48.044466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.044643 (+   177us) service_pool.cc:224] Handling call
0709 12:19:48.045036 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.089200 (+1044164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.218441 (+129241us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540032bed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:49.218628 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2374626176}
W20260709 12:19:49.219631 13887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 568) took 1834 ms (client timeout 2070 ms). Trace:
W20260709 12:19:49.234920 13887 rpcz_store.cc:269] 0709 12:19:47.384967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.434795 (+ 49828us) service_pool.cc:224] Handling call
0709 12:19:49.219352 (+1784557us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540060e0d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:49.219548 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436945664}
W20260709 12:19:49.224565 13101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.009s	sys 0.002s
W20260709 12:19:49.216737 13132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1193) took 2711 ms (client timeout 2388 ms). Trace:
W20260709 12:19:49.236541 13101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.009s	sys 0.003s
W20260709 12:19:49.229357 13883 rpcz_store.cc:269] 0709 12:19:47.317633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.317783 (+   150us) service_pool.cc:224] Handling call
0709 12:19:49.215821 (+1898038us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54007ae4d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:49.215973 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2141568768}
W20260709 12:19:49.236644 13132 rpcz_store.cc:269] 0709 12:19:46.505455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.941880 (+436425us) service_pool.cc:224] Handling call
0709 12:19:49.216552 (+2274672us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540010d6d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:49.216663 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2364530432}
I20260709 12:19:49.221201 13134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1717) took 2832 ms. Trace:
I20260709 12:19:49.237504 13134 rpcz_store.cc:276] 0709 12:19:46.388846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.055905 (+667059us) service_pool.cc:224] Handling call
0709 12:19:47.056205 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:48.704153 (+1647948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.220930 (+516777us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54003ac5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:49.221140 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3767863552}
I20260709 12:19:49.229605 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1781) took 1522 ms. Trace:
I20260709 12:19:49.232688 13278 rpcz_store.cc:276] 0709 12:19:46.896888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.166743 (+269855us) service_pool.cc:224] Handling call
0709 12:19:47.167088 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:48.340441 (+1173353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.217385 (+876944us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540023c654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:49.217568 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2422673792}
I20260709 12:19:49.239174 13280 rpcz_store.cc:276] 0709 12:19:47.707596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.708415 (+   819us) service_pool.cc:224] Handling call
0709 12:19:47.720888 (+ 12473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:48.002258 (+281370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:48.002304 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:48.002364 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:48.002415 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.229374 (+1226959us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b540029dbd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:49.229421 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:49.229553 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646472064}
W20260709 12:19:49.162286 13133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.012s	sys 0.039s
I20260709 12:19:49.203256 15894 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:49.186980 15824 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:49.252074 13286 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:49.272507 13102 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:49.268453 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:49.262953 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 114734us
W20260709 12:19:49.163971 15851 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.012s	sys 0.061s
W20260709 12:19:49.282188 13133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.014s	sys 0.041s
W20260709 12:19:49.222915 13880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 566) took 2909 ms (client timeout 2278 ms). Trace:
I20260709 12:19:49.215058 15884 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:19:49.280576 13882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.022s	sys 0.034s
I20260709 12:19:49.273671 15484 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:49.237950 15554 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.266726 15902 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:49.264253 15836 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.196112 15823 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:49.163614 15664 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:49.288415 15661 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:49.288967 15891 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:49.277242 15840 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:49.274374 15662 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:49.303936 13838 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:49.307600 13210 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:49.915598 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2578) took 1047 ms. Trace:
I20260709 12:19:49.916599 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 475) took 1833 ms. Trace:
I20260709 12:19:49.307260 15884 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:49.304021 13880 rpcz_store.cc:269] 0709 12:19:46.313071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.313642 (+   571us) service_pool.cc:224] Handling call
0709 12:19:49.222627 (+2908985us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54007602d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:49.222844 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214841600}
I20260709 12:19:49.918640 15823 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:49.405956 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 828) took 1040 ms. Trace:
I20260709 12:19:49.918880 15643 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:49.399509 15946 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:19:49.492697 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:49.592886 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 1.25166e+06us
I20260709 12:19:49.921433 13278 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:49.922015 13177 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:49.592288 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 1.47039e+06us
I20260709 12:19:49.923285 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2579) took 1054 ms. Trace:
W20260709 12:19:49.412073 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 289416us
I20260709 12:19:49.924230 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:49.926004 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:49.926759 13209 raft_consensus.cc:2393] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:49.927838 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:49.928515 13205 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
W20260709 12:19:49.472805 13252 leader_election.cc:336] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.619s (SENT)
I20260709 12:19:49.919660 13885 rpcz_store.cc:276] 0709 12:19:48.365496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.366312 (+   816us) service_pool.cc:224] Handling call
0709 12:19:48.366578 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:48.975825 (+609247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:48.975867 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:48.976427 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:19:49.214654 (+238227us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:49.214902 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.215006 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:49.405739 (+190733us) raft_consensus.cc:1685] finished
0709 12:19:49.405762 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:49.405895 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19394,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":60598,"thread_start_us":846274,"threads_started":2,"wal-append.queue_time_us":315949}
W20260709 12:19:49.932505 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 459733us
I20260709 12:19:49.923856 13277 rpcz_store.cc:276] 0709 12:19:48.868876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.954986 (+ 86110us) service_pool.cc:224] Handling call
0709 12:19:48.970478 (+ 15492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.014795 (+ 44317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:49.014841 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:49.015414 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:19:49.223074 (+207660us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:49.223135 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.223240 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:49.374969 (+151729us) raft_consensus.cc:1685] finished
0709 12:19:49.374999 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:49.923223 (+548224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42776,"raft.queue_time_us":43704,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":8389,"thread_start_us":191505,"threads_started":1,"wal-append.queue_time_us":348862}
I20260709 12:19:49.460160 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2603) took 1413 ms. Trace:
W20260709 12:19:49.464082 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:49.461287 13207 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36412 (request call id 481) took 2228 ms (client timeout 1523 ms). Trace:
W20260709 12:19:49.458115 15927 log.cc:927] Time spent T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
W20260709 12:19:49.373486 15939 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 12:19:49.378739 15882 consensus_meta.cc:287] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.642s	user 0.003s	sys 0.008s
I20260709 12:19:49.941502 15882 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:49.943974 13886 raft_consensus.cc:2368] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6.
I20260709 12:19:49.306077 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:49.917232 13133 rpcz_store.cc:276] 0709 12:19:48.082909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.393464 (+310555us) service_pool.cc:224] Handling call
0709 12:19:48.451154 (+ 57690us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:48.451585 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:48.451618 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:48.475929 (+ 24311us) log.cc:844] Serialized 52 byte log entry
0709 12:19:49.301427 (+825498us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:49.301487 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.301586 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:49.487715 (+186129us) raft_consensus.cc:1685] finished
0709 12:19:49.487748 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:49.916532 (+428784us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1518,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3191,"thread_start_us":793722,"threads_started":1,"wal-append.queue_time_us":719119}
I20260709 12:19:49.456508 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:49.976035 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:49.976289 13280 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:49.934963 13212 rpcz_store.cc:276] 0709 12:19:48.046592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.046730 (+   138us) service_pool.cc:224] Handling call
0709 12:19:48.047043 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:48.375006 (+327963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.459789 (+1084783us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54001c4654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:49.460075 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752312704}
I20260709 12:19:49.977283 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:49.978905 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 57029.8us
I20260709 12:19:49.981971 13278 raft_consensus.cc:2393] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:49.982152 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:49.983261 13206 raft_consensus.cc:2410] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:19:49.983582 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:49.937439 13207 rpcz_store.cc:269] 0709 12:19:47.232632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.233808 (+  1176us) service_pool.cc:224] Handling call
0709 12:19:49.461002 (+2227194us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54002f0dd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:49.461188 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914583808}
I20260709 12:19:49.980118 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:49.973227 15554 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:49.987461 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:49.985344 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:49.988982 13134 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:49.986891 13209 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:49.990142 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 684493us
W20260709 12:19:49.990805 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 686935us
W20260709 12:19:49.402559 15881 consensus_meta.cc:287] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.328s	user 0.011s	sys 0.004s
I20260709 12:19:49.987730 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36352 (request call id 24) took 1917 ms. Trace:
I20260709 12:19:49.992892 13133 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:49.993237 13283 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:49.993139 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 69733.1us
I20260709 12:19:49.919653 15662 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:49.614698 15955 log.cc:927] Time spent T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:19:49.392308 15941 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:19:49.379566 13131 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:19:49.996301 13101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.006s	sys 0.011s
I20260709 12:19:49.593168 15923 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.041728 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:49.971451 15904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.004s	sys 0.005s
I20260709 12:19:49.916242 13285 rpcz_store.cc:276] 0709 12:19:48.868617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.922655 (+ 54038us) service_pool.cc:224] Handling call
0709 12:19:48.942493 (+ 19838us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:48.957040 (+ 14547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:48.957124 (+    84us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:48.962012 (+  4888us) log.cc:844] Serialized 52 byte log entry
0709 12:19:49.225127 (+263115us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:49.225187 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.225295 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:49.377599 (+152304us) raft_consensus.cc:1685] finished
0709 12:19:49.377628 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:49.915525 (+537897us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11811,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4296,"thread_start_us":222256,"threads_started":1,"wal-append.queue_time_us":405921}
I20260709 12:19:49.998524 13206 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:49.999939 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:49.606962 15910 raft_consensus.cc:3055] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:19:49.922551 13882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.031s	sys 0.059s
I20260709 12:19:50.005676 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:49.365902 15832 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:49.917771 15664 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:50.031517 13101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.006s	sys 0.011s
W20260709 12:19:49.987561 15872 log.cc:927] Time spent T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 2.471s	user 0.011s	sys 0.014s
I20260709 12:19:50.070006 15662 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:50.070696 15557 consensus_queue.cc:1059] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:50.072057 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 575) took 1991 ms. Trace:
I20260709 12:19:49.994947 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:50.073447 15945 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.694s	user 0.004s	sys 0.020s
I20260709 12:19:50.072491 13884 rpcz_store.cc:276] 0709 12:19:48.080630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.345504 (+264874us) service_pool.cc:224] Handling call
0709 12:19:48.345963 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:48.376793 (+ 30830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:48.376836 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:48.456839 (+ 80003us) log.cc:844] Serialized 26 byte log entry
0709 12:19:48.917586 (+460747us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b48000600d8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f9db6aa1 00007f70f9dadb37 00007f70f9dad9ca 00007f70f9ea526f 00007f70f9ea4f37 00007f70f9eb955c 00007f70f9eb9508 00007f70f9eb9488 00007f70f9eb9443 00007f70f9eb86ec 00007f70f8de2a96
0709 12:19:49.161312 (+243726us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:49.161359 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.161449 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.071712 (+910263us) raft_consensus.cc:1685] finished
0709 12:19:50.071732 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.071991 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4491,"raft.run_cpu_time_us":13626,"raft.run_wall_time_us":566830,"spinlock_wait_cycles":9909504,"thread_start_us":623281,"threads_started":1,"wal-append.queue_time_us":757623}
I20260709 12:19:50.032214 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 473) took 1949 ms. Trace:
I20260709 12:19:49.919216 15823 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.075637 13129 rpcz_store.cc:276] 0709 12:19:48.082231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.082355 (+   124us) service_pool.cc:224] Handling call
0709 12:19:48.084789 (+  2434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:48.085156 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:48.085184 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:48.085661 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:19:48.667414 (+581753us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:48.667493 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:48.667586 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:49.457278 (+789692us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:49.990983 (+533705us) raft_consensus.cc:1685] finished
0709 12:19:49.991006 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.031386 (+ 40380us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44839,"raft.queue_time_us":2510,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":11526,"spinlock_wait_cycles":46887168,"thread_start_us":581322,"threads_started":1,"wal-append.queue_time_us":929938}
I20260709 12:19:50.077322 15823 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:50.077796 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:50.078510 13129 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:50.079459 13278 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:50.080793 15934 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:49.305886 15949 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:50.081732 15949 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:50.082196 15949 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:49.993613 15792 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.997931 15918 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:49.997272 15643 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.083719 15792 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.084228 15643 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.085448 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 414) took 2269 ms. Trace:
I20260709 12:19:50.086061 15792 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:50.086395 15643 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:50.087118 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:50.031214 15881 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:50.087466 15554 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:50.087924 15881 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.088447 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:50.089063 13281 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:19:50.089138 15791 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:49.994692 13211 rpcz_store.cc:276] 0709 12:19:48.056059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.085322 (+ 29263us) service_pool.cc:224] Handling call
0709 12:19:49.973452 (+1888130us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400072bd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e87853 00007f70f9e5560a 00007f70f33db7d4 00007f70f33db762 00007f70f33db691 00007f70f33db60c 00007f70f33da8c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:49.973594 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301750528}
I20260709 12:19:50.090263 15881 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:50.060249 15910 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:50.094398 15884 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:50.094568 15521 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.094954 13135 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:50.043141 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.095129 15521 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.095733 13133 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:49.592423 15912 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.469s
I20260709 12:19:50.096661 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.096972 15664 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.621524 15636 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:50.097383 15521 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:50.098048 15521 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.924124 15840 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.097924 15636 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:49.593289 15905 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:50.098500 15902 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:50.098944 15905 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:50.098989 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:50.099563 15905 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:50.099783 13211 raft_consensus.cc:606] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
W20260709 12:19:50.050943 15904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.005s	sys 0.005s
I20260709 12:19:50.055773 13137 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:50.056391 13209 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:19:50.004403 15734 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:49.988183 15824 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:49.974756 15484 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.065924 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:50.067008 15665 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.046310 15118 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:19:50.097568 15664 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.049613 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:50.039412 13175 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:50.100255 13211 raft_consensus.cc:614] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:50.100742 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:49.947788 15807 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:50.085832 13279 rpcz_store.cc:276] 0709 12:19:47.815779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.815920 (+   141us) service_pool.cc:224] Handling call
0709 12:19:47.816193 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.024317 (+1208124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.085190 (+1060873us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540026fa54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:50.085363 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2776762752}
I20260709 12:19:50.102345 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:50.102432 13136 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:50.074868 15463 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:50.098569 15840 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:50.034328 15851 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:19:50.097448 13133 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:50.115724 13278 raft_consensus.cc:2410] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:19:50.021982 15882 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:50.117295 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:50.118690 13280 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:19:49.979241 15836 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.026332 15914 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:50.144634 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:50.137589 13132 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:50.075178 13882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 829) took 1709 ms. Trace:
I20260709 12:19:50.138094 13134 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:50.104278 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 422) took 1612 ms. Trace:
I20260709 12:19:50.147481 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:50.147694 13282 rpcz_store.cc:276] 0709 12:19:48.491727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.499856 (+  8129us) service_pool.cc:224] Handling call
0709 12:19:48.500172 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.017163 (+516991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.104035 (+1086872us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54002756d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:50.104225 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180686080}
I20260709 12:19:50.149677 13285 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:50.149911 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:50.138868 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:50.151301 13281 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:50.152837 13102 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:50.156242 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:50.157342 13281 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:50.158109 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:50.158742 13279 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:19:50.119330 15636 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:50.163282 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:50.155545 15665 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:50.142033 15859 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:50.119243 15521 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.061206 15923 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.166544 13279 raft_consensus.cc:2368] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
I20260709 12:19:50.168134 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:50.168138 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:50.169067 15118 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:50.169443 13102 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:50.174350 15118 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.174770 15118 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:50.174778 13280 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:50.176470 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:50.176965 13886 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 574) took 2101 ms (client timeout 2014 ms). Trace:
I20260709 12:19:50.177049 13280 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
W20260709 12:19:50.177495 13886 rpcz_store.cc:269] 0709 12:19:48.075265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.075967 (+   702us) service_pool.cc:224] Handling call
0709 12:19:50.176768 (+2100801us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b5400675f54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:50.176899 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4292920704}
I20260709 12:19:50.178030 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:50.170248 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 67960.7us
W20260709 12:19:50.170372 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 131088us
I20260709 12:19:50.136734 15824 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.181670 13132 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:19:50.181679 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:50.190761 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:50.190905 13102 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:50.183076 13177 leader_election.cc:400] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
I20260709 12:19:50.184303 13137 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:50.192414 13177 leader_election.cc:403] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:50.185056 13129 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:19:50.185204 15118 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.187851 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:50.166837 15414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.027s	sys 0.039s
I20260709 12:19:50.201681 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:50.172518 15792 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:50.197810 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:50.197911 13102 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:50.208530 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:50.171028 15918 raft_consensus.cc:697] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:50.204909 15118 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:50.168069 15859 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:50.209645 13279 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:50.171557 15914 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:50.212410 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:36352
W20260709 12:19:50.214407 15957 log.cc:927] Time spent T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:19:50.197690 13175 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:50.201300 15414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.028s	sys 0.039s
W20260709 12:19:50.232197 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 138646us
I20260709 12:19:50.199965 15852 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:50.248632 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.215184 15962 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:50.234556 15118 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:50.200781 15718 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:50.200572 15554 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:50.214816 15521 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:50.236267 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:50.236527 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:50.215659 15463 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:50.206054 15924 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:19:50.203070 15881 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:50.261826 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 480) took 3332 ms. Trace:
W20260709 12:19:50.242340 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 170426us
I20260709 12:19:50.240350 15904 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:50.244626 15859 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.245460 13134 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:50.246125 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.248958 13129 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8. Ops: [4.6-7.8]
I20260709 12:19:50.267612 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.200146 15801 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:19:50.269994 13134 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:50.220397 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:50.252645 13133 raft_consensus.cc:2368] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
W20260709 12:19:50.254418 13249 leader_election.cc:336] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.619s (SENT)
I20260709 12:19:50.271528 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2607) took 2222 ms. Trace:
I20260709 12:19:50.271930 13249 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:50.271977 13210 rpcz_store.cc:276] 0709 12:19:48.048942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.049473 (+   531us) service_pool.cc:224] Handling call
0709 12:19:48.049730 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.916000 (+1866270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.271287 (+355287us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002f08d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:50.271471 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2892362624}
I20260709 12:19:50.256232 13285 raft_consensus.cc:2393] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:50.275188 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:50.275930 15836 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:50.261766 15557 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:50.276551 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:50.277325 13277 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:50.277472 15843 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:50.278029 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 430) took 1233 ms. Trace:
I20260709 12:19:50.253151 15962 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.255975 13840 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:50.259738 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.202877 15789 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:19:50.238265 15792 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:19:50.267889 15886 log.cc:927] Time spent T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 2.543s	user 0.009s	sys 0.008s
I20260709 12:19:50.257527 15463 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:50.265182 15935 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.277315 13285 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:50.250771 15852 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:50.278447 13277 rpcz_store.cc:276] 0709 12:19:49.044451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.276661 (+1232210us) service_pool.cc:224] Handling call
0709 12:19:50.276997 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:50.277764 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.277973 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:50.256850 13279 raft_consensus.cc:2410] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:19:50.249431 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 257778us
I20260709 12:19:50.246951 15851 consensus_queue.cc:1059] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:19:50.255038 15554 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:50.261600 15881 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.290822 15463 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:50.291703 15484 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:50.291800 15551 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:50.297642 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:50.334870 15840 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.335956 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:50.337142 15840 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:50.337272 15924 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
I20260709 12:19:50.337597 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:50.301090 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2576) took 3457 ms. Trace:
I20260709 12:19:50.334893 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.304157 15935 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.304883 15891 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.305162 15664 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:50.305400 15823 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:50.305891 15910 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.262267 13204 rpcz_store.cc:276] 0709 12:19:46.929472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.009241 (+ 79769us) service_pool.cc:224] Handling call
0709 12:19:47.009545 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:47.792763 (+783218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:47.792794 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:47.806570 (+ 13776us) log.cc:844] Serialized 52 byte log entry
0709 12:19:48.087875 (+281305us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:48.175338 (+ 87463us) log.cc:844] Serialized 14 byte log entry
0709 12:19:49.885539 (+1710201us) log.cc:844] Serialized 14 byte log entry
0709 12:19:50.260150 (+374611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.261543 (+  1393us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.261593 (+    50us) raft_consensus.cc:1685] finished
0709 12:19:50.261606 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.261763 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1489637,"prepare.queue_time_us":495534,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":21580,"raft.queue_time_us":1602842,"raft.run_cpu_time_us":434,"raft.run_wall_time_us":60746,"thread_start_us":1627223,"threads_started":4,"wal-append.queue_time_us":1256910,"wal-append.run_cpu_time_us":3100,"wal-append.run_wall_time_us":1079072}
I20260709 12:19:50.308306 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 826) took 2768 ms. Trace:
I20260709 12:19:50.310271 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:50.285508 15918 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.312217 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:50.313410 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:50.313907 13838 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:50.327078 13211 raft_consensus.cc:606] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:19:50.321784 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2590) took 1051 ms. Trace:
I20260709 12:19:50.335238 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:50.299331 15949 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.338565 13284 rpcz_store.cc:276] 0709 12:19:46.843377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.069724 (+226347us) service_pool.cc:224] Handling call
0709 12:19:47.070141 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:47.072809 (+  2668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:47.072861 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:47.082651 (+  9790us) log.cc:844] Serialized 26 byte log entry
0709 12:19:47.466545 (+383894us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:47.466586 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:47.467694 (+  1108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.262782 (+2795088us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:50.300738 (+ 37956us) raft_consensus.cc:1685] finished
0709 12:19:50.300762 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.301011 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3383,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":37230,"spinlock_wait_cycles":4626688,"thread_start_us":307527,"threads_started":1,"wal-append.queue_time_us":530524}
I20260709 12:19:50.311885 15662 consensus_queue.cc:1059] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 12:19:50.290390 15414 consensus_queue.cc:1059] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.123s
I20260709 12:19:50.346189 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:50.612198 13175 connection.cc:256] RPC call timeout handler was delayed by -2.7893837510000594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2278s for a response
I20260709 12:19:50.283998 15962 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:50.417758 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.282066 15904 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.556099 13280 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:19:50.397526 13136 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:50.631487 15935 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:50.632460 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:50.633548 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.634941 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:50.635918 13134 raft_consensus.cc:2376] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5. Re-sending same reply.
I20260709 12:19:50.636226 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:50.637421 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:50.638947 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:50.639392 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.614562 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:50.642231 13175 connection.cc:256] RPC call timeout handler was delayed by -1.9973612730000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 12:19:50.642711 13175 connection.cc:256] RPC call timeout handler was delayed by -1.2545154040001307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
I20260709 12:19:50.637559 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:50.644824 13134 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:50.645876 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.646878 13134 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:50.639964 13133 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:50.648658 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.316390 15852 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:50.500576 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 175479us
W20260709 12:19:50.552533 13311 heartbeater.cc:646] Failed to heartbeat to 127.11.163.62:33937 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.11.163.62:33937 timed out after 15.000s (SENT)
I20260709 12:19:50.615631 13279 rpcz_store.cc:276] 0709 12:19:49.270209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.234745 (+964536us) service_pool.cc:224] Handling call
0709 12:19:50.321667 (+ 86922us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:50.530505 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 229634us
W20260709 12:19:50.653100 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.652580 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:50.542433 13281 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:50.654381 15118 raft_consensus.cc:3055] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:50.614964 13207 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:19:50.531515 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 275610us
W20260709 12:19:50.575043 13252 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.654s (SENT) [suppressed 29 similar messages]
I20260709 12:19:50.613639 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:50.313508 15859 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:50.616640 13879 rpcz_store.cc:276] 0709 12:19:47.539886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.597268 (+ 57382us) service_pool.cc:224] Handling call
0709 12:19:49.219833 (+1622565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.239562 (+ 19729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.308072 (+1068510us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540060e0d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:50.308214 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3730397440}
W20260709 12:19:50.572316 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.656397 13209 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:50.150866 13882 rpcz_store.cc:276] 0709 12:19:48.365857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.496147 (+130290us) service_pool.cc:224] Handling call
0709 12:19:48.549173 (+ 53026us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:48.674818 (+125645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:48.674859 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:48.680738 (+  5879us) log.cc:844] Serialized 52 byte log entry
0709 12:19:50.072847 (+1392109us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:50.074590 (+  1743us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:50.074653 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.074738 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.074795 (+    57us) raft_consensus.cc:1685] finished
0709 12:19:50.074815 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.075109 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85993,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":13127040,"thread_start_us":1381553,"threads_started":1,"wal-append.queue_time_us":596044}
I20260709 12:19:50.539989 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:50.501281 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 830) took 1529 ms. Trace:
I20260709 12:19:50.547000 15589 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.621587 15923 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:50.622455 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1206) took 3107 ms. Trace:
I20260709 12:19:50.623008 15949 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:50.283747 15914 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.626247 13282 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:19:50.627040 15905 consensus_meta.cc:287] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.504s	user 0.003s	sys 0.003s
I20260709 12:19:50.320194 15554 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:50.327962 15881 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:50.686476 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 418) took 2609 ms. Trace:
I20260709 12:19:50.686947 13283 rpcz_store.cc:276] 0709 12:19:48.076968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.077085 (+   117us) service_pool.cc:224] Handling call
0709 12:19:48.077361 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.995754 (+1918393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.686222 (+690468us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54002314d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:50.686412 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4405571456}
I20260709 12:19:50.688416 13283 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:50.689626 13283 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:50.627616 15789 raft_consensus.cc:3055] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:50.691349 15789 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:50.692211 15789 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.693403 15789 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:50.668335 13128 rpcz_store.cc:276] 0709 12:19:47.514896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.521834 (+  6938us) service_pool.cc:224] Handling call
0709 12:19:47.649134 (+127300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:48.738872 (+1089738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.622198 (+1883326us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54000c21d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:50.622386 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008096000}
I20260709 12:19:50.694689 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.656032 15902 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:50.695822 15902 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:50.697695 13280 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:50.697855 15902 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:50.666431 15963 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:50.628219 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:50.698987 13212 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:50.699837 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:50.700925 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:50.628701 15891 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:50.629310 13131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 476) took 2546 ms (client timeout 2067 ms). Trace:
W20260709 12:19:50.703711 13131 rpcz_store.cc:269] 0709 12:19:48.083208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.364495 (+281287us) service_pool.cc:224] Handling call
0709 12:19:50.629048 (+2264553us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b540027d654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:50.629235 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1851027200}
I20260709 12:19:50.629431 13284 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:50.629840 15924 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:50.706491 15924 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.635026 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.649632 13134 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:50.650672 13210 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:50.654975 15118 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:50.538528 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:50.709698 13130 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:50.710728 13136 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:50.653872 13249 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:50.660108 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 85120.3us
I20260709 12:19:50.701864 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:50.657625 13887 rpcz_store.cc:276] 0709 12:19:48.972293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.235894 (+263601us) service_pool.cc:224] Handling call
0709 12:19:49.236225 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:49.236515 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:49.294673 (+ 58158us) log.cc:844] Serialized 14 byte log entry
0709 12:19:50.297834 (+1003161us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b1800446e00. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d1ac0a 00007f70fb45a219 00007f70f1da2a40 00007f70f1d9d4e4 00007f70f1d9d455 00007f70f88853c7 00007f70f4e979a7 00007f70f4ea70bf 00007f70f4ea7038
0709 12:19:50.298055 (+   221us) log.cc:844] Serialized 14 byte log entry
0709 12:19:50.500779 (+202724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:50.500850 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:50.500905 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.501008 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.501199 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":233856,"prepare.queue_time_us":976641,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":48116,"raft.queue_time_us":263001,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":4863,"spinlock_wait_cycles":122388352,"thread_start_us":107633,"threads_started":2,"wal-append.queue_time_us":769058}
I20260709 12:19:50.516172 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:50.662724 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:50.633451 15904 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:50.531842 15840 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:50.665223 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 351403us
I20260709 12:19:50.501381 15843 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.168s
I20260709 12:19:50.313606 15521 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.341s
I20260709 12:19:50.676609 13282 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:19:50.676983 15905 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.537009 15463 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.678467 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:50.679849 15735 consensus_queue.cc:1059] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:50.680262 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:50.719699 13277 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:50.726233 13209 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:19:50.718437 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:50.658648 15910 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:50.728652 13838 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:50.667573 13133 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:50.727458 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:50.752655 13207 raft_consensus.cc:2368] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6.
I20260709 12:19:50.732537 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:50.736868 15118 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:50.744163 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:50.751075 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 97275us
I20260709 12:19:50.753772 13204 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:50.754246 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:50.719729 15662 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:50.756969 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:50.759330 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 79125.5us
I20260709 12:19:50.760602 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:50.535738 15792 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.761744 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:50.762178 15810 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:50.744864 13128 raft_consensus.cc:2410] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:19:50.729100 15967 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:50.758934 13130 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:50.737874 15823 consensus_queue.cc:1243] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:19:50.764601 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:50.735100 15832 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.762626 15810 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.673898 15589 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:50.785630 15884 consensus_queue.cc:1059] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:50.786350 15934 consensus_queue.cc:1059] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:50.750604 15902 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:50.751005 15840 raft_consensus.cc:697] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:50.881765 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 200872us
I20260709 12:19:50.787727 13249 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:50.955252 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 167602us
I20260709 12:19:50.955945 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:50.836537 15810 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:50.949646 15734 raft_consensus.cc:3055] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:50.954421 15834 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:51.009855 15718 consensus_queue.cc:1059] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:19:51.021513 15636 raft_consensus.cc:3055] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:51.022083 15891 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:51.063004 15636 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:51.063647 13284 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:51.063959 15636 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:51.065182 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:51.065884 15718 raft_consensus.cc:3055] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:51.066450 15718 raft_consensus.cc:740] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:51.067781 15718 consensus_queue.cc:260] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.070463 15884 consensus_queue.cc:1059] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:51.071699 15735 raft_consensus.cc:3055] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:51.072069 15735 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:51.073084 15735 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.074661 15735 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:51.084318 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 119847us
I20260709 12:19:51.085155 13249 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:51.022290 13175 leader_election.cc:400] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
W20260709 12:19:51.022734 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 294136us
I20260709 12:19:51.061914 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:51.092491 13282 raft_consensus.cc:2376] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7. Re-sending same reply.
I20260709 12:19:51.094820 13277 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:19:51.095875 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:51.097371 15884 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:51.097626 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:51.098315 13282 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
W20260709 12:19:51.092515 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 70344us
I20260709 12:19:51.099634 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:51.100695 15637 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:51.100977 13284 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:51.101060 15637 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:51.101514 15637 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:50.950726 15753 consensus_queue.cc:1059] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:19:50.824292 15832 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.110908 13249 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:51.111455 13838 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:51.107065 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:51.140991 13175 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:51.142590 13175 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:51.013198 15843 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:50.924521 15963 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.238s
I20260709 12:19:51.018797 15965 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:51.020227 15734 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:51.155511 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 44182.8us
I20260709 12:19:51.157760 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:51.120419 13840 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:50.972163 15902 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.029307 15834 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:51.107986 15807 raft_consensus.cc:3055] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:51.146924 15791 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:51.146797 15879 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:51.118287 15935 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:51.138089 15891 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:51.192349 15987 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.187914 15718 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:51.290933 15824 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:51.184898 15840 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.197520 15665 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:51.195081 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 74546.3us
I20260709 12:19:51.180523 15753 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:51.137223 15912 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:51.319783 15912 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.147331 15851 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:51.148232 15843 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:51.254041 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.198243 15735 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:51.188577 15924 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:51.268760 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2602) took 1020 ms. Trace:
I20260709 12:19:51.321929 15735 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:51.322463 15986 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:50.812984 15967 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.323086 15735 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:51.323796 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.293032 13286 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:51.324751 15967 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:51.288769 15987 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.293685 15734 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.294741 15463 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:51.234802 15807 raft_consensus.cc:740] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:19:51.258015 15962 consensus_meta.cc:287] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.621s	user 0.012s	sys 0.003s
I20260709 12:19:51.227490 15834 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:51.267195 15966 log.cc:927] Time spent T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.610s	user 0.000s	sys 0.017s
W20260709 12:19:51.295651 15554 consensus_meta.cc:287] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.616s	user 0.000s	sys 0.008s
I20260709 12:19:51.297137 15832 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:51.299790 15852 consensus_meta.cc:287] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
I20260709 12:19:51.196930 15934 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:51.204102 15904 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:51.258903 15881 consensus_meta.cc:287] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
W20260709 12:19:51.310452 13278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2591) took 2040 ms (client timeout 2123 ms). Trace:
W20260709 12:19:51.321784 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.323697 15989 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:19:51.301839 15789 consensus_meta.cc:287] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 12:19:51.314280 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:51.321659 13103 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:51.293166 15910 consensus_meta.cc:287] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260709 12:19:51.322422 13283 rpcz_store.cc:276] 0709 12:19:50.247786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.690272 (+442486us) service_pool.cc:224] Handling call
0709 12:19:50.690535 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:50.690729 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:19:51.023638 (+332909us) log.cc:844] Serialized 14 byte log entry
0709 12:19:51.267905 (+244267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:51.268033 (+   128us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:51.268111 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.268290 (+   179us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.268575 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":631162,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":63624,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":569587,"threads_started":2}
W20260709 12:19:51.333498 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.334806 13286 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:51.371770 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2580) took 2502 ms. Trace:
W20260709 12:19:51.372002 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 50408.6us
I20260709 12:19:51.372300 13286 rpcz_store.cc:276] 0709 12:19:48.869108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.090488 (+221380us) service_pool.cc:224] Handling call
0709 12:19:49.090852 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.292499 (+2201647us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b58005300d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4de90aa 00007f70f4e6b447 00007f70f4e83fe7 00007f70f4e857de 00007f70f4e8fb49 00007f70f4e90416 00007f70f4e8cd8f 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4
0709 12:19:51.371364 (+ 78865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.371683 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2852289280}
W20260709 12:19:51.373406 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 59243us
I20260709 12:19:51.336251 15965 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:51.350382 15891 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:19:51.352586 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:51.352353 13278 rpcz_store.cc:269] 0709 12:19:49.270561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.983227 (+712666us) service_pool.cc:224] Handling call
0709 12:19:51.310222 (+1326995us) spinlock_profiling.cc:243] Waited 95.1 ms on lock 0x7b5400230fd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:51.310382 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218765568}
W20260709 12:19:51.353394 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 195739us
W20260709 12:19:51.379966 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:51.354660 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 243832us
I20260709 12:19:51.343519 15905 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:51.343180 15823 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:51.348829 15734 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:51.321599 15843 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:51.331890 15665 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.347040 15852 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:51.384028 15859 consensus_meta.cc:287] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.722s	user 0.006s	sys 0.004s
I20260709 12:19:51.336517 15962 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.402927 13205 raft_consensus.cc:2410] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:19:51.385550 13278 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:51.388149 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1784) took 1387 ms. Trace:
I20260709 12:19:51.388422 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 494) took 1406 ms. Trace:
W20260709 12:19:51.379839 15844 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:19:51.355491 15934 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:51.376504 15989 raft_consensus.cc:697] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:51.395728 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:51.344040 15554 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.397500 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:51.381160 15963 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:19:51.381801 15753 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:51.404109 13285 rpcz_store.cc:276] 0709 12:19:50.000643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.339285 (+338642us) service_pool.cc:224] Handling call
0709 12:19:50.446098 (+106813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:50.446389 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:50.780395 (+334006us) log.cc:844] Serialized 14 byte log entry
0709 12:19:51.376424 (+596029us) log.cc:844] Serialized 14 byte log entry
0709 12:19:51.387779 (+ 11355us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:51.387830 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:51.387920 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.387984 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.388093 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11097,"prepare.queue_time_us":672943,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":137341,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"spinlock_wait_cycles":8540544,"thread_start_us":702485,"threads_started":3,"wal-append.queue_time_us":539677}
I20260709 12:19:51.349365 15810 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.355564 15904 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.421300 15118 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:51.377389 15832 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:51.431914 15589 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:51.469045 15665 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:51.419401 15982 raft_consensus.cc:2764] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:19:51.419679 15996 consensus_queue.cc:1059] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:19:51.446719 15753 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.498425 15753 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:51.498586 15996 raft_consensus.cc:3055] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:51.499078 15996 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:51.499989 15996 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.501361 15996 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:51.435740 15891 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.438351 15965 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.406500 15988 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.376303 15807 consensus_queue.cc:260] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.513168 15807 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:51.514017 15989 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:51.355736 15881 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.437373 15934 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.516549 15988 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:51.445863 15977 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:19:51.436131 15993 consensus_queue.cc:1059] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:51.518983 15993 raft_consensus.cc:3055] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:51.519513 15993 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:51.445191 15986 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:51.502965 15734 consensus_queue.cc:1059] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:19:51.497867 15983 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:19:51.516851 15987 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:51.513971 15637 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.520519 15993 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.378316 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:51.404295 13203 rpcz_store.cc:276] 0709 12:19:49.982082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.982345 (+   263us) service_pool.cc:224] Handling call
0709 12:19:50.005803 (+ 23458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:50.062323 (+ 56520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:50.062355 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:50.071701 (+  9346us) log.cc:844] Serialized 26 byte log entry
0709 12:19:50.287803 (+216102us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:50.287865 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.287967 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:51.388126 (+1100159us) raft_consensus.cc:1685] finished
0709 12:19:51.388154 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.388342 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69816,"raft.queue_time_us":95121,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":9599,"spinlock_wait_cycles":1745920,"thread_start_us":215655,"threads_started":1,"wal-append.queue_time_us":259954}
I20260709 12:19:51.684993 13137 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:51.678766 13132 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:19:51.787358 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:51.747087 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.853114 15484 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:51.678531 13131 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:19:51.706305 13209 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:51.707649 13212 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:51.782159 15118 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:51.736979 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1790) took 1734 ms. Trace:
I20260709 12:19:51.867532 15718 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:51.868039 15484 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.521124 15881 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:51.872246 15904 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:51.552598 15753 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.580868 15843 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.883605 15644 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:51.885265 15987 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.885196 15996 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:19:51.890255 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.613524 15244 raft_consensus.cc:3055] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:19:51.560442 15938 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 2.375s	user 0.022s	sys 0.044s
I20260709 12:19:51.885821 15986 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.563164 15636 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:51.443753 15902 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:51.916808 15753 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:51.919350 15718 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.919234 15644 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:51.883677 15810 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:51.612902 15929 raft_consensus.cc:3055] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:51.560230 15554 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:51.516322 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 110131us
W20260709 12:19:51.752851 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 372419us
W20260709 12:19:51.768342 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 1.08693e+06us
W20260709 12:19:51.927862 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.466799 15935 raft_consensus.cc:697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:51.469101 15962 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:51.737049 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:51.876583 15988 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:51.551605 15852 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:51.937897 15244 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:51.938321 15843 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:51.878748 13281 rpcz_store.cc:276] 0709 12:19:50.002283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.655960 (+653677us) service_pool.cc:224] Handling call
0709 12:19:50.656278 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:51.086000 (+429722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.086030 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:51.086829 (+   799us) log.cc:844] Serialized 26 byte log entry
0709 12:19:51.337087 (+250258us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:51.337154 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.337282 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:51.736138 (+398856us) raft_consensus.cc:1685] finished
0709 12:19:51.736193 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.736640 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67195,"raft.queue_time_us":95058,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":6814,"thread_start_us":615624,"threads_started":2,"wal-append.queue_time_us":327660}
I20260709 12:19:51.923842 15987 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.552893 15823 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:51.707818 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:51.948424 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1417) took 1255 ms. Trace:
I20260709 12:19:51.939201 15996 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:51.885233 15993 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:51.953845 15644 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:51.939635 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:51.997663 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.974834 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2614) took 1640 ms. Trace:
I20260709 12:19:51.953819 15718 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:51.996553 13209 rpcz_store.cc:276] 0709 12:19:50.676672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.395109 (+718437us) service_pool.cc:224] Handling call
0709 12:19:51.925338 (+530229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:51.955302 15118 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.018528 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.019755 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1421) took 1342 ms. Trace:
I20260709 12:19:52.008122 13208 rpcz_store.cc:276] 0709 12:19:50.323110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.638246 (+315136us) service_pool.cc:224] Handling call
0709 12:19:50.638552 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:50.649398 (+ 10846us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:50.658917 (+  9519us) log.cc:844] Serialized 14 byte log entry
0709 12:19:51.108555 (+449638us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:51.118299 (+  9744us) log.cc:844] Serialized 26 byte log entry
0709 12:19:51.118675 (+   376us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:51.118755 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.119015 (+   260us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:51.956196 (+837181us) raft_consensus.cc:1685] finished
0709 12:19:51.956233 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.963738 (+  7505us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12787,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"raft.queue_time_us":901,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":190,"thread_start_us":326693,"threads_started":1,"wal-append.queue_time_us":617070}
I20260709 12:19:52.020362 15881 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:52.020226 13209 rpcz_store.cc:276] 0709 12:19:50.677674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.018014 (+1340340us) service_pool.cc:224] Handling call
0709 12:19:52.019652 (+  1638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.021684 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.022481 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:52.022612 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1408) took 1375 ms. Trace:
I20260709 12:19:52.023114 13208 rpcz_store.cc:276] 0709 12:19:50.647864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.021188 (+1373324us) service_pool.cc:224] Handling call
0709 12:19:52.022558 (+  1370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.024271 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.024518 15987 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:52.024717 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.025735 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1418) took 1348 ms. Trace:
I20260709 12:19:52.026161 13206 rpcz_store.cc:276] 0709 12:19:50.676927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.024099 (+1347172us) service_pool.cc:224] Handling call
0709 12:19:52.025634 (+  1535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.028162 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1405) took 1381 ms. Trace:
I20260709 12:19:52.028594 13203 rpcz_store.cc:276] 0709 12:19:50.646236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.876671 (+1230435us) service_pool.cc:224] Handling call
0709 12:19:52.028069 (+151398us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.028445 15244 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:52.029603 13205 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2616) took 1705 ms (client timeout 1680 ms). Trace:
I20260709 12:19:52.029789 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:52.030086 13205 rpcz_store.cc:269] 0709 12:19:50.324196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.337334 (+ 13138us) service_pool.cc:224] Handling call
0709 12:19:52.029188 (+1691854us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002166d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:52.029407 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2447768832}
I20260709 12:19:52.030457 15244 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:52.032531 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.034104 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.036207 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:52.037186 15929 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:52.037509 15662 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.038137 15662 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:52.027186 13209 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:51.973097 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 569) took 3977 ms. Trace:
I20260709 12:19:52.026677 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.031107 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.042676 13278 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:52.047315 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2622) took 1394 ms. Trace:
I20260709 12:19:52.047838 13208 rpcz_store.cc:276] 0709 12:19:50.652923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.026239 (+1373316us) service_pool.cc:224] Handling call
0709 12:19:52.047202 (+ 20963us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.044436 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.068032 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.069442 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:52.069908 15980 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.689s	user 0.003s	sys 0.000s
I20260709 12:19:52.070959 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.077805 13209 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:52.078733 15484 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:52.079061 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:51.563235 15834 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:52.098695 15834 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:52.089608 13209 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:52.099979 13208 raft_consensus.cc:2393] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:52.100551 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:52.101105 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:52.101367 13209 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:52.102653 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:52.103906 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 725522us
I20260709 12:19:52.104705 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:52.105576 13281 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:19:52.107898 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.107939 15977 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:19:52.090123 15996 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:52.038949 13881 rpcz_store.cc:276] 0709 12:19:47.995516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.999651 (+  4135us) service_pool.cc:224] Handling call
0709 12:19:48.059547 (+ 59896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:48.158213 (+ 98666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:48.175525 (+ 17312us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:48.319239 (+143714us) log.cc:844] Serialized 26 byte log entry
0709 12:19:49.049609 (+730370us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:49.051686 (+  2077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.076916 (+ 25230us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:51.559813 (+2482897us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:51.972456 (+412643us) raft_consensus.cc:1685] finished
0709 12:19:51.972513 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.972820 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7271,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":17272,"spinlock_wait_cycles":22344448,"thread_start_us":662443,"threads_started":1,"wal-append.queue_time_us":776263}
W20260709 12:19:52.092571 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.115060 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.115687 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.116532 13102 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:52.120538 15935 consensus_queue.cc:237] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.112637 15823 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:52.096344 13210 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:52.130715 13205 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:52.138334 13209 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:52.141562 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1415) took 1465 ms. Trace:
I20260709 12:19:52.141975 13210 rpcz_store.cc:276] 0709 12:19:50.675933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.444569 (+768636us) service_pool.cc:224] Handling call
0709 12:19:52.139752 (+695183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:52.139757 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 166057us
W20260709 12:19:52.111411 13249 leader_election.cc:336] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 2.388s (SENT)
W20260709 12:19:52.148589 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.155129 13203 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:52.155936 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.156468 13209 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:52.157502 13102 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:52.158046 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1403) took 1512 ms. Trace:
I20260709 12:19:52.158488 13212 rpcz_store.cc:276] 0709 12:19:50.645637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.761494 (+115857us) service_pool.cc:224] Handling call
0709 12:19:52.157849 (+1396355us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54001c3754. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:52.157988 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2172636416}
I20260709 12:19:52.160979 13102 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:52.161528 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1733) took 1918 ms. Trace:
I20260709 12:19:52.161990 13137 rpcz_store.cc:276] 0709 12:19:50.243205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.249241 (+  6036us) service_pool.cc:224] Handling call
0709 12:19:50.249572 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.862094 (+1612522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.161071 (+298977us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540011d854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:52.161341 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3299448576}
W20260709 12:19:52.162654 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.164491 13206 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:52.165493 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1414) took 1491 ms. Trace:
I20260709 12:19:52.165828 13203 rpcz_store.cc:276] 0709 12:19:50.664621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.030748 (+1366127us) service_pool.cc:224] Handling call
0709 12:19:52.155684 (+124936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.175380 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:52.176335 13283 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:52.173377 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:52.182994 15807 consensus_meta.cc:287] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.011s
I20260709 12:19:52.188980 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.189754 13210 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:52.175251 15554 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:52.194967 15118 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:52.195242 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:52.197568 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.199846 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.205077 15999 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:52.205832 15999 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.208362 13286 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:52.208289 15664 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:19:52.209589 15664 consensus_queue.cc:1243] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:19:52.212795 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 101420us
I20260709 12:19:52.214996 13277 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:52.214564 15929 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:52.196353 15554 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.215420 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:52.215756 15554 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:52.216231 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:52.216818 15929 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:52.216569 13280 raft_consensus.cc:2393] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:52.217036 13277 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:19:52.219689 13203 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:52.220835 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.221527 13203 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:52.225689 15934 consensus_queue.cc:1059] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:19:52.226536 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.228135 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 83554.3us
I20260709 12:19:52.229951 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.232455 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.200492 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.235010 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.236321 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.236933 13879 raft_consensus.cc:2368] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6.
I20260709 12:19:52.240744 15637 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:52.240976 13887 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:19:52.243448 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36352 (request call id 26) took 2037 ms. Trace:
I20260709 12:19:52.243707 13881 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:52.243899 13211 rpcz_store.cc:276] 0709 12:19:50.206179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.206344 (+   165us) service_pool.cc:224] Handling call
0709 12:19:52.243002 (+2036658us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002a1cd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e87853 00007f70f9e5560a 00007f70f33db7d4 00007f70f33db762 00007f70f33db691 00007f70f33db60c 00007f70f33da8c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:52.243165 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262059776}
I20260709 12:19:52.245381 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.246249 13211 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:52.246731 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1412) took 1597 ms. Trace:
I20260709 12:19:52.249001 15912 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:52.249085 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.250489 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.251133 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.235682 13277 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:52.252573 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:52.253007 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1747) took 1940 ms. Trace:
I20260709 12:19:52.253388 13277 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:52.253476 13131 rpcz_store.cc:276] 0709 12:19:50.312219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.705051 (+392832us) service_pool.cc:224] Handling call
0709 12:19:50.705388 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:51.931638 (+1226250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.252690 (+321052us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54003ab1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:52.252925 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235834112}
W20260709 12:19:52.254441 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.254664 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:52.256461 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 150875us
W20260709 12:19:52.257640 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.251289 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1398) took 1607 ms. Trace:
I20260709 12:19:52.259503 15636 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:52.259603 13207 rpcz_store.cc:276] 0709 12:19:50.644138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.250076 (+1605938us) service_pool.cc:224] Handling call
0709 12:19:52.251236 (+  1160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.260797 13207 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9377aea669547028ee8449f654c60b7"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:52.261615 13280 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:52.264871 13205 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:19:52.265517 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1419) took 1588 ms. Trace:
I20260709 12:19:52.265930 13205 rpcz_store.cc:276] 0709 12:19:50.677171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.187346 (+1510175us) service_pool.cc:224] Handling call
0709 12:19:52.265463 (+ 78117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651520}
I20260709 12:19:52.266860 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1791) took 2264 ms. Trace:
W20260709 12:19:52.268141 15992 log.cc:927] Time spent T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.820s	user 0.003s	sys 0.000s
I20260709 12:19:52.267249 13279 rpcz_store.cc:276] 0709 12:19:50.002530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.656884 (+654354us) service_pool.cc:224] Handling call
0709 12:19:50.660769 (+  3885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:51.087691 (+426922us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:19:51.087744 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:51.088435 (+   691us) log.cc:844] Serialized 26 byte log entry
0709 12:19:51.339003 (+250568us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:51.339099 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.339199 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:52.265591 (+926392us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b240020c648. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1c269c4 00007f70f1c24acb 00007f70f1ddfdc9 00007f70f1ddfa55 00007f70f1ddefb0 00007f70f4a55488 00007f70f4a55be8 00007f70f4a2d398 00007f70f4a2876a 00007f70f4a27bb6
0709 12:19:52.266377 (+   786us) raft_consensus.cc:1685] finished
0709 12:19:52.266396 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.266665 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67173,"raft.queue_time_us":102056,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":48299,"spinlock_wait_cycles":8022912,"thread_start_us":601905,"threads_started":2,"wal-append.queue_time_us":312722}
I20260709 12:19:52.269490 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:52.270045 13279 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:52.270470 13132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 1741) took 1988 ms (client timeout 1608 ms). Trace:
W20260709 12:19:52.270874 13132 rpcz_store.cc:269] 0709 12:19:50.282026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.334631 (+ 52605us) service_pool.cc:224] Handling call
0709 12:19:52.270198 (+1935567us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54001383d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:52.270356 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3075263872}
I20260709 12:19:52.272200 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.274282 13135 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:52.274513 13881 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:52.276964 13135 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:52.278156 15636 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.278795 15636 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:52.281697 15636 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:52.283214 13135 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:52.272746 15884 raft_consensus.cc:3055] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:52.284361 15884 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:52.285462 15884 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:52.286729 15884 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:52.286996 13278 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:52.273650 13129 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:52.288074 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:52.288568 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:52.289467 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.289373 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 438) took 1189 ms. Trace:
I20260709 12:19:52.290602 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:52.290359 13282 rpcz_store.cc:276] 0709 12:19:51.099382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.099521 (+   139us) service_pool.cc:224] Handling call
0709 12:19:51.099848 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:51.240644 (+140796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.240690 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:51.241257 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:19:51.351047 (+109790us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:51.351099 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.288763 (+937664us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54001e96d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:52.288829 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:52.288899 (+    70us) raft_consensus.cc:1685] finished
0709 12:19:52.288912 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.289190 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322938624,"thread_start_us":99855,"threads_started":1,"wal-append.queue_time_us":168501}
I20260709 12:19:52.296911 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.298159 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1400) took 1653 ms. Trace:
I20260709 12:19:52.298539 13204 rpcz_store.cc:276] 0709 12:19:50.644762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.297086 (+1652324us) service_pool.cc:224] Handling call
0709 12:19:52.297445 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.297662 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:52.297686 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:52.297752 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:52.297789 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.297850 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.297978 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.261688 13207 raft_consensus.cc:606] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:52.302204 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:52.302320 13252 leader_election.cc:336] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.999s (SENT)
I20260709 12:19:52.302819 13252 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:52.303789 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:52.307559 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:52.307904 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:52.263062 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:52.257494 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:52.235667 13212 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:52.313141 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.247089 13211 rpcz_store.cc:276] 0709 12:19:50.649194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.245045 (+1595851us) service_pool.cc:224] Handling call
0709 12:19:52.246664 (+  1619us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.318274 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.267546 13205 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:52.308270 13207 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:19:52.323475 13886 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:19:52.329692 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2621) took 1862 ms. Trace:
I20260709 12:19:52.330163 13205 rpcz_store.cc:276] 0709 12:19:50.467494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.266830 (+1799336us) service_pool.cc:224] Handling call
0709 12:19:52.267206 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.329381 (+ 62175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.329598 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.307942 15999 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:52.332259 13281 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:52.335685 15912 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.336123 13177 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:52.336313 15912 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:52.338789 15912 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:52.339715 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:52.341085 13279 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:52.365532 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.367882 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:52.369462 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:52.365893 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:52.376106 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 215353us
I20260709 12:19:52.377764 13212 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:52.377957 13132 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:52.380517 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:52.381507 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:52.369606 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1397) took 1726 ms. Trace:
I20260709 12:19:52.383785 13887 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:52.383617 13206 rpcz_store.cc:276] 0709 12:19:50.643772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.203585 (+1559813us) service_pool.cc:224] Handling call
0709 12:19:52.369547 (+165962us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.384368 13203 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:52.383718 13204 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:52.388415 13879 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:52.389237 13886 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:52.390432 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:52.391731 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.383034 15637 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 12:19:52.396040 13249 leader_election.cc:336] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.838s (SENT)
I20260709 12:19:52.396219 13204 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:52.396731 13277 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:52.396932 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2634) took 1077 ms. Trace:
I20260709 12:19:52.397296 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:52.397348 13204 rpcz_store.cc:276] 0709 12:19:51.319871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.395687 (+1075816us) service_pool.cc:224] Handling call
0709 12:19:52.396049 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.396687 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.396860 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.398234 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:52.367838 15718 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:52.398880 13204 raft_consensus.cc:1240] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:52.399539 15636 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:52.400334 13210 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:19:52.400908 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1411) took 1752 ms. Trace:
I20260709 12:19:52.401211 13210 rpcz_store.cc:276] 0709 12:19:50.648888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.194071 (+1545183us) service_pool.cc:224] Handling call
0709 12:19:52.400854 (+206783us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:52.401796 13841 connection.cc:256] RPC call timeout handler was delayed by -2.0801359100000809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 12:19:52.402210 13841 connection.cc:256] RPC call timeout handler was delayed by -1.1567610889999287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260709 12:19:52.402416 13210 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:19:52.403007 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2636) took 1082 ms. Trace:
I20260709 12:19:52.385159 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:52.403313 13210 rpcz_store.cc:276] 0709 12:19:51.320422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.401869 (+1081447us) service_pool.cc:224] Handling call
0709 12:19:52.402207 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:52.402791 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.402962 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.404862 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:52.405205 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2637) took 1084 ms. Trace:
I20260709 12:19:52.405527 13210 rpcz_store.cc:276] 0709 12:19:51.320739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.404291 (+1083552us) service_pool.cc:224] Handling call
0709 12:19:52.404654 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.404858 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:52.404889 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:52.404966 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:52.405005 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.405062 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.405160 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.406823 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:52.408052 13278 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:52.409065 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:52.409451 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.410238 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:52.386497 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:52.399578 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 97428.7us
I20260709 12:19:52.400357 13206 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:52.387413 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:52.380517 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:52.402230 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:52.418013 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1435) took 1008 ms. Trace:
I20260709 12:19:52.418533 13203 rpcz_store.cc:276] 0709 12:19:51.409518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.223131 (+813613us) service_pool.cc:224] Handling call
0709 12:19:52.417936 (+194805us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.412415 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1423) took 1031 ms. Trace:
I20260709 12:19:52.407217 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1428) took 1025 ms. Trace:
I20260709 12:19:52.419530 13208 rpcz_store.cc:276] 0709 12:19:51.380721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.204076 (+823355us) service_pool.cc:224] Handling call
0709 12:19:52.412359 (+208283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27008}
I20260709 12:19:52.419759 13210 rpcz_store.cc:276] 0709 12:19:51.382085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.406435 (+1024350us) service_pool.cc:224] Handling call
0709 12:19:52.406715 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.406907 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:52.406931 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:52.406988 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:52.407023 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.407075 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.407173 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.423017 13280 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:52.424011 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2633) took 1093 ms. Trace:
I20260709 12:19:52.424405 13206 rpcz_store.cc:276] 0709 12:19:51.319595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.399810 (+1080215us) service_pool.cc:224] Handling call
0709 12:19:52.400178 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.413025 (+ 12847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.413193 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.425630 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2635) took 1092 ms. Trace:
I20260709 12:19:52.426100 13204 rpcz_store.cc:276] 0709 12:19:51.320151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.398374 (+1078223us) service_pool.cc:224] Handling call
0709 12:19:52.398710 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.399283 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.412738 (+ 13455us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.391173 13128 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
W20260709 12:19:52.428364 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 48255.3us
I20260709 12:19:52.433393 13283 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:52.398232 13134 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:52.437038 13209 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:52.442005 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:52.442754 13210 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:52.445037 13207 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:52.447067 15844 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:52.449182 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.452139 13205 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:52.454530 13210 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:52.454972 15735 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:52.455976 15823 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.456146 15735 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:52.456574 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:52.457469 13129 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:52.458230 15735 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:52.458561 13282 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:52.460027 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:52.460949 13128 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:52.461369 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:52.463639 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.464597 13887 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:52.467252 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.468201 13886 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:52.468500 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.469264 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:52.469446 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.470765 13879 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:52.470649 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.471184 15823 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:52.473230 15637 consensus_queue.cc:1059] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:52.468106 13252 leader_election.cc:336] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 2.026s (SENT)
I20260709 12:19:52.479141 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:52.480010 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 222671us
I20260709 12:19:52.481734 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:52.487286 13252 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:52.487310 13279 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:52.497390 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.502471 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:52.502565 13203 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:52.505030 13211 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:52.506966 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1420) took 1824 ms. Trace:
I20260709 12:19:52.507722 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:52.507946 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:52.508533 13130 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:52.508399 15118 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:52.507365 13205 rpcz_store.cc:276] 0709 12:19:50.677426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.331140 (+1653714us) service_pool.cc:224] Handling call
0709 12:19:52.446059 (+114919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.452572 (+  6513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.501592 (+ 49020us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002f12d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:52.501741 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263196416}
I20260709 12:19:52.522504 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1431) took 1125 ms. Trace:
I20260709 12:19:52.522897 13207 rpcz_store.cc:276] 0709 12:19:51.396832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.488504 (+1091672us) service_pool.cc:224] Handling call
0709 12:19:52.512207 (+ 23703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.522111 (+  9904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:52.522151 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:52.522202 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:52.522241 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.522320 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.522444 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:52.527294 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.530149 13204 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:52.491506 15914 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:52.504551 15844 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:52.524044 13885 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:52.543351 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:52.546820 13130 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:52.548280 15734 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:52.548977 15734 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:52.551905 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 47673us
I20260709 12:19:52.514918 15644 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:52.547253 13102 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:52.484562 15718 consensus_queue.cc:1059] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:19:52.532626 13206 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:19:52.552160 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 293077us
I20260709 12:19:52.516379 15934 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:52.553251 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 85192.2us
I20260709 12:19:52.556697 15718 raft_consensus.cc:3055] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:52.556875 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.557610 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1413) took 1900 ms. Trace:
I20260709 12:19:52.558167 13209 rpcz_store.cc:276] 0709 12:19:50.657694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.319859 (+1662165us) service_pool.cc:224] Handling call
0709 12:19:52.386515 (+ 66656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.437612 (+ 51097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.557327 (+119715us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b54000735d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:52.557546 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60039424}
I20260709 12:19:52.557135 15718 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:52.560237 15718 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.560639 15554 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.561455 15718 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:52.563010 15554 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:52.563705 15644 raft_consensus.cc:697] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:52.563835 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.564520 13885 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:52.564888 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.566826 15934 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:52.559249 13285 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 6. Ops: []
I20260709 12:19:52.542563 13283 pending_rounds.cc:85] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 2
W20260709 12:19:52.568275 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.571180 13129 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
W20260709 12:19:52.571635 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.525311 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:52.574823 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.579555 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 62014.6us
I20260709 12:19:52.582665 13137 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:19:52.568297 13283 pending_rounds.cc:107] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:19:52.584926 13283 raft_consensus.cc:2889] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:52.572368 15662 consensus_meta.cc:287] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.534s	user 0.003s	sys 0.011s
I20260709 12:19:52.551357 15734 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:52.586702 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.585786 13131 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:52.582899 13881 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.546171 15636 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:19:52.608819 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.610636 13280 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:52.602303 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.564836 15644 consensus_queue.cc:237] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.595635 15812 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:52.624054 15812 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.626163 15812 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:52.628638 15852 consensus_queue.cc:1059] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:52.629856 15852 raft_consensus.cc:3055] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:52.630184 15852 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:52.632202 15661 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:52.632236 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.645684 13278 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:52.648495 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.593030 15662 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:52.651263 13885 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:52.662433 13887 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:19:52.663919 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.665899 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.683239 13841 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:52.684507 16004 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:52.685446 15521 raft_consensus.cc:3055] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:52.686074 15521 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:52.687350 15521 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:52.689318 15521 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:52.690245 15244 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:52.690970 15244 consensus_queue.cc:1243] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:19:52.693771 15912 raft_consensus.cc:3055] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:52.694259 15912 raft_consensus.cc:740] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:52.694746 16015 log.cc:927] Time spent T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:19:52.696115 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.696869 13033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51922 (request call id 206) took 11204 ms. Trace:
I20260709 12:19:52.699880 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.675463 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.677376 13102 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:52.709106 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 51137.4us
I20260709 12:19:52.631049 15852 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.714730 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.715411 13887 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
W20260709 12:19:52.720366 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 100128us
I20260709 12:19:52.669812 15914 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.724377 13252 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:52.733592 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.707970 16004 raft_consensus.cc:697] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:52.707237 15929 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:19:52.739137 13102 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:52.695214 15912 consensus_queue.cc:260] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.771183 13203 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:52.739689 13841 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:52.755869 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.756090 16004 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:52.758785 13284 pending_rounds.cc:85] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 7
I20260709 12:19:52.764801 13885 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:52.832360 13284 pending_rounds.cc:107] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:19:52.832757 13284 raft_consensus.cc:2889] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:52.766670 15662 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:52.767464 15852 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:52.767864 15914 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:52.730624 15834 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:52.819941 13103 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:52.679596 15934 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:52.821168 15912 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:52.823242 15929 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:19:52.824891 16021 log.cc:927] Time spent T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.193s	user 0.003s	sys 0.001s
I20260709 12:19:52.863950 15834 raft_consensus.cc:697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:52.825578 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.826352 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.865239 15834 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:52.765267 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.865235 13883 raft_consensus.cc:2376] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6. Re-sending same reply.
I20260709 12:19:52.868611 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:52.869722 13131 raft_consensus.cc:2368] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5.
I20260709 12:19:52.856565 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:52.870174 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 154252us
I20260709 12:19:52.870633 13884 raft_consensus.cc:2376] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7. Re-sending same reply.
I20260709 12:19:52.857592 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.871181 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:52.872040 13137 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 3: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:52.872170 13841 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:52.872961 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:52.873063 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:52.873634 13130 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:52.874567 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:52.875782 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:52.858227 15914 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:52.858711 15734 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:52.697341 13033 rpcz_store.cc:276] 0709 12:19:41.491995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.492333 (+   338us) service_pool.cc:224] Handling call
0709 12:19:52.696582 (+11204249us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:47.589127 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:47.803690 (+214563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:47.807565 (+  3875us) write_op.cc:435] Acquired schema lock
0709 12:19:47.807584 (+    19us) tablet.cc:662] Decoding operations
0709 12:19:47.950051 (+142467us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:47.950135 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:47.950180 (+    45us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:19:47.951218 (+  1038us) tablet.cc:701] Row locks acquired
0709 12:19:47.951246 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:19:47.963601 (+ 12355us) write_op.cc:270] Start()
0709 12:19:47.987699 (+ 24098us) write_op.cc:276] Timestamp: P: 1783599587951404 usec, L: 0
0709 12:19:47.996018 (+  8319us) op_driver.cc:348] REPLICATION: starting
0709 12:19:48.060831 (+ 64813us) log.cc:844] Serialized 3574 byte log entry
0709 12:19:49.042725 (+981894us) op_driver.cc:464] REPLICATION: finished
0709 12:19:50.162581 (+1119856us) write_op.cc:301] APPLY: starting
0709 12:19:50.166391 (+  3810us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:50.197144 (+ 30753us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:50.237063 (+ 39919us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:50.624334 (+387271us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:50.624579 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:19:50.624622 (+    43us) write_op.cc:312] APPLY: finished
0709 12:19:50.624908 (+   286us) log.cc:844] Serialized 71 byte log entry
0709 12:19:50.949775 (+324867us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:50.972565 (+ 22790us) write_op.cc:454] Released schema lock
0709 12:19:51.004674 (+ 32109us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:51.159863 (+155189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:51.174456 (+ 14593us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1024260,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":1095035,"apply.run_cpu_time_us":32021,"apply.run_wall_time_us":952544,"num_ops":9,"prepare.queue_time_us":490612,"prepare.run_cpu_time_us":45992,"prepare.run_wall_time_us":798336,"raft.queue_time_us":645368,"raft.run_cpu_time_us":29961,"raft.run_wall_time_us":357185,"replication_time_us":1024770,"thread_start_us":1932001,"threads_started":5,"wal-append.queue_time_us":967157,"wal-append.run_cpu_time_us":75539,"wal-append.run_wall_time_us":2877635}]]}
I20260709 12:19:52.858824 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.859361 15521 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:52.868685 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.869568 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:52.891747 13882 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
W20260709 12:19:52.855185 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 123397us
I20260709 12:19:52.894579 15912 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:52.896543 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:52.896787 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 76968.7us
I20260709 12:19:52.897513 13103 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:19:52.899042 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.863745 15929 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:52.883765 15554 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:52.900174 15554 raft_consensus.cc:697] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:52.900527 15929 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:52.901124 15554 consensus_queue.cc:237] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.902197 15929 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:52.888401 15244 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:52.762995 15812 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.904740 13887 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:52.875957 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.858469 15962 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:52.876622 13128 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:52.906836 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:52.907613 13280 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:52.913244 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.914055 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.914422 13278 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:52.911664 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:52.916714 13129 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
W20260709 12:19:52.916769 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 165144us
I20260709 12:19:52.922823 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:52.925069 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:52.925496 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:52.905035 15521 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:52.925652 13883 raft_consensus.cc:2376] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8. Re-sending same reply.
W20260709 12:19:52.933683 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 424369us
I20260709 12:19:52.917145 15914 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:52.937091 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:52.918711 15662 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:52.939599 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:52.918500 15962 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:52.937340 13279 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:52.926270 15244 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:52.952121 13208 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:52.931236 15521 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:52.956446 13285 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:52.889362 16030 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:19:52.936805 15718 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:19:52.968953 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48748.8us
I20260709 12:19:52.967231 13280 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:19:52.971268 15484 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:52.971827 15484 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:52.938429 15914 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:19:52.979046 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.979725 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:52.985678 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 65728.6us
I20260709 12:19:52.986233 13102 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:19:52.991250 16041 log.cc:927] Time spent T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:19:52.992563 15884 consensus_meta.cc:287] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.005s
I20260709 12:19:52.957131 15662 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:52.994232 15662 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:52.995875 13878 raft_consensus.cc:2410] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:52.936549 15664 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:19:52.954495 15244 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:52.996917 13177 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:52.972226 15484 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:53.004966 13279 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:53.006218 13841 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:52.973392 15718 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:52.984870 15914 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:53.012058 15812 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:53.021903 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.022608 13128 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:53.022629 13885 raft_consensus.cc:2376] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5. Re-sending same reply.
I20260709 12:19:53.024175 13134 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:19:53.024863 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:53.024631 13035 catalog_manager.cc:5697] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 3 to 6, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 6 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:19:53.025432 13279 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:53.026962 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.028121 13135 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:19:53.025355 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:53.032437 13279 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:19:53.041220 13035 catalog_manager.cc:5697] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.042923 13131 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:53.049731 15962 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.001982 15244 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:53.002130 15807 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:53.042976 13035 catalog_manager.cc:5697] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 3 to 6, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 6 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.085632 13130 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:53.085465 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.089216 13129 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:19:53.091286 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 51956.3us
I20260709 12:19:53.093704 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.095942 16046 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:53.096433 16046 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:53.096340 15521 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.096972 16046 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:53.109413 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:53.110558 13885 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 4 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:19:53.110675 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:53.111420 16037 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:19:53.111645 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:53.112987 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:53.113420 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2629) took 1795 ms. Trace:
I20260709 12:19:53.113662 13885 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:53.114506 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:53.113798 13212 rpcz_store.cc:276] 0709 12:19:51.318422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.378941 (+1060519us) service_pool.cc:224] Handling call
0709 12:19:52.379339 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:52.398731 (+ 19392us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:52.609954 (+211223us) log.cc:844] Serialized 14 byte log entry
0709 12:19:52.985051 (+375097us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:53.003255 (+ 18204us) log.cc:844] Serialized 26 byte log entry
0709 12:19:53.005831 (+  2576us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:53.005880 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:53.005965 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:53.113181 (+107216us) raft_consensus.cc:1685] finished
0709 12:19:53.113200 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:53.113325 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33952,"prepare.queue_time_us":270172,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":85833,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":4776,"thread_start_us":513607,"threads_started":3,"wal-append.queue_time_us":293674}
I20260709 12:19:53.115752 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.116561 13880 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:53.003399 15644 consensus_queue.cc:1059] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:19:53.117607 13880 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 6. Ops: []
I20260709 12:19:53.118132 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.118947 13878 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:53.119577 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.119767 16043 raft_consensus.cc:3055] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:53.120198 16043 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:53.120314 13878 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:53.121261 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.121105 16043 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.122432 16043 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:53.122386 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:53.123986 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 137643us
I20260709 12:19:53.124356 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.117630 15644 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:19:53.118891 13880 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:53.082767 15884 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:53.129832 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 50590.7us
W20260709 12:19:53.132427 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 164301us
I20260709 12:19:53.098505 16045 raft_consensus.cc:3055] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:19:53.140614 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.097939 15807 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:53.142047 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.098624 13881 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3.
I20260709 12:19:53.145787 13878 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:53.131420 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:53.091506 16030 consensus_queue.cc:1059] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:19:53.135808 15753 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:19:53.161715 15521 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:53.162770 15664 consensus_queue.cc:1059] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:53.164054 15664 raft_consensus.cc:3055] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:53.164501 15664 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:53.163021 15521 consensus_queue.cc:1059] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:19:53.165007 16038 log.cc:927] Time spent T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:19:53.165512 15521 raft_consensus.cc:3055] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:53.166038 15521 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:19:53.166694 16042 log.cc:927] Time spent T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:19:53.155180 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:53.171298 13878 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:53.151831 13035 catalog_manager.cc:5697] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 3 to 4, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 4 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.139284 15884 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:53.083725 16034 consensus_queue.cc:1059] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:19:53.146121 16045 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:53.175931 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.167302 15521 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.203917 13100 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:53.214627 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.227185 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:53.152247 15852 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:19:53.139541 15718 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.200033 13880 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:53.245958 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:53.246905 13208 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
W20260709 12:19:53.257107 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.224241 15753 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:53.269380 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 92229.5us
W20260709 12:19:53.270608 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 81432.5us
I20260709 12:19:53.165634 15664 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.274041 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:53.274802 13203 raft_consensus.cc:2393] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:19:53.277789 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 115513us
I20260709 12:19:53.242256 15554 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:53.267242 13131 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:53.274081 13035 catalog_manager.cc:5697] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 6 to 7, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 7 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.290556 13841 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:53.242388 15912 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.267735 16053 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.273221 15521 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:53.316924 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.322968 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.305274 13210 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:53.324470 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.324827 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.325460 13879 raft_consensus.cc:2376] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 3. Re-sending same reply.
I20260709 12:19:53.279749 15753 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:53.328251 13279 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8. Ops: [6.4-7.5]
W20260709 12:19:53.329062 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.280368 16030 raft_consensus.cc:3055] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:53.283766 15844 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:53.332005 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2606) took 1118 ms. Trace:
I20260709 12:19:53.294591 15637 raft_consensus.cc:3055] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:53.327360 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.300276 15934 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:53.337893 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 193227us
I20260709 12:19:53.343726 16057 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:53.323359 15718 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:53.348719 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:53.358886 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 648887us
I20260709 12:19:53.360154 13035 catalog_manager.cc:5697] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.362318 15810 consensus_queue.cc:1059] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:53.363238 15734 raft_consensus.cc:3055] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:53.363777 15734 raft_consensus.cc:740] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:53.333880 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.331475 16030 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:53.367033 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.297330 16034 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:19:53.345582 15934 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:19:53.369168 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 90855.3us
I20260709 12:19:53.336187 15637 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:53.411705 15934 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:53.412209 13282 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:19:53.412320 13100 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:53.412581 15637 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.413882 15637 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:53.338114 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:53.414376 15662 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:53.414678 13880 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:53.335168 13286 rpcz_store.cc:276] 0709 12:19:52.213684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.237841 (+ 24157us) service_pool.cc:224] Handling call
0709 12:19:52.238258 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.238587 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:52.424679 (+186092us) log.cc:844] Serialized 14 byte log entry
0709 12:19:53.166087 (+741408us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:53.329270 (+163183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:53.329318 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:53.329362 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:53.329422 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:53.331949 (+  2527us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":388691,"prepare.queue_time_us":304634,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":5057,"raft.queue_time_us":395289,"spinlock_wait_cycles":18744576,"thread_start_us":584586,"threads_started":2,"wal-append.queue_time_us":489626}
I20260709 12:19:53.352202 15912 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.417435 15912 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:53.375052 15891 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.418084 15891 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.419101 13282 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:53.331660 16045 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.375625 13252 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:53.368697 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:53.382319 16050 log.cc:927] Time spent T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.082s	user 0.000s	sys 0.003s
W20260709 12:19:53.420600 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 45091.4us
I20260709 12:19:53.422384 13252 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:53.383735 15753 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.382198 15852 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.385083 16056 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:19:53.424049 13212 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:19:53.358445 15989 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:19:53.424695 13212 pending_rounds.cc:85] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 7
I20260709 12:19:53.424969 13212 pending_rounds.cc:107] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:19:53.331195 15884 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:53.395624 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 48536.8us
I20260709 12:19:53.395890 13884 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:19:53.396857 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2616) took 1132 ms. Trace:
I20260709 12:19:53.397586 16034 consensus_queue.cc:1243] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:19:53.397650 16030 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.400251 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:53.401000 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:53.402911 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:53.403842 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:53.405042 13207 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:53.413795 13100 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:53.424096 15935 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:53.326900 15807 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.389118 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:53.372174 13035 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 2 to 3, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 3 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:19:53.425235 13212 raft_consensus.cc:2889] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:53.425088 13252 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:53.437873 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:53.446046 13878 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:53.330080 16053 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.441134 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:53.450387 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:53.428830 13277 rpcz_store.cc:276] 0709 12:19:52.264170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.397423 (+133253us) service_pool.cc:224] Handling call
0709 12:19:52.397665 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.398001 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:52.657187 (+259186us) log.cc:844] Serialized 14 byte log entry
0709 12:19:53.381029 (+723842us) log.cc:844] Serialized 14 byte log entry
0709 12:19:53.396374 (+ 15345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:53.396423 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:53.396469 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:53.396532 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:53.396704 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":570443,"prepare.queue_time_us":297001,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":85,"raft.queue_time_us":441085,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":11795,"thread_start_us":439819,"threads_started":2,"wal-append.queue_time_us":184591}
I20260709 12:19:53.451074 13285 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:53.364962 15734 consensus_queue.cc:260] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.428092 15554 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.425216 15852 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:53.464053 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.459441 13035 catalog_manager.cc:5697] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 4 to 5, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 5 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.464953 13134 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:53.461184 13100 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.418988 15484 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.441458 15661 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.463521 16045 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:53.472555 15812 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:53.472980 15891 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:53.473879 15852 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:19:53.448263 13881 raft_consensus.cc:2376] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7. Re-sending same reply.
I20260709 12:19:53.473963 16046 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.475580 16030 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:53.476229 15734 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:53.476480 13209 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:53.441402 15914 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.477591 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:53.491761 15935 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:53.512625 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:53.517442 15935 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:53.517738 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 54214us
I20260709 12:19:53.517964 13133 raft_consensus.cc:2393] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:53.518875 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:53.493208 15812 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.472556 13130 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:53.445358 16059 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:53.493170 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.484354 15987 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:53.500649 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.548856 13129 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:53.492686 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.477145 16052 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:19:53.447926 15644 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:19:53.500532 15989 consensus_queue.cc:1059] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:19:53.516394 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:53.519371 13133 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:53.477730 13203 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:19:53.521798 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:53.478356 15554 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.508599 15664 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:53.526007 15662 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:53.526950 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:53.547415 15812 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:53.528322 15914 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:53.529395 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:53.518008 15935 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:53.530968 15244 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.518994 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:53.577118 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:53.553421 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 226824us
I20260709 12:19:53.578277 13175 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.579425 13175 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.525699 13208 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:53.510939 16062 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:53.503610 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:53.560211 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.557588 13132 raft_consensus.cc:2376] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5. Re-sending same reply.
I20260709 12:19:53.523371 13211 raft_consensus.cc:2410] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:19:53.516943 16053 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:53.558646 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.575081 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:53.509143 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 84128.5us
I20260709 12:19:53.502694 15661 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.555761 15987 raft_consensus.cc:697] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:53.589219 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:53.590365 13212 raft_consensus.cc:2410] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:19:53.591812 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 153945us
I20260709 12:19:53.594293 13132 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:53.597084 13135 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:53.597365 13129 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:53.581444 16062 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:53.585289 16043 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:53.598402 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.599026 13137 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:19:53.607514 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 146261us
I20260709 12:19:53.636816 13175 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.593039 15999 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:53.645169 13285 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:53.584452 15934 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.644325 13103 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.608716 16043 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:53.643265 13128 raft_consensus.cc:2410] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:53.661902 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:53.662444 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 143502us
I20260709 12:19:53.647408 15637 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:53.636457 15735 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:53.646893 15999 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.666689 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:53.663107 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.692663 13838 leader_election.cc:400] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5.
I20260709 12:19:53.693612 13838 leader_election.cc:403] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:19:53.692574 13136 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
W20260709 12:19:53.695520 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 60575us
I20260709 12:19:53.696373 13103 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.661069 16043 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:53.698017 15753 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:53.700474 15934 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:53.670811 15999 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:53.664431 15662 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:53.668963 15637 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:53.701812 13212 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:53.701192 15244 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:53.715188 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:53.715188 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 59858.2us
I20260709 12:19:53.717060 13100 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:53.728358 13252 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:53.718725 16000 raft_consensus.cc:3055] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:53.736593 16000 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:53.729924 16067 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:53.740845 16067 raft_consensus.cc:697] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:53.741859 16067 consensus_queue.cc:237] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.738119 16000 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.718554 15989 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:53.744774 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48468.9us
I20260709 12:19:53.660636 15987 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.719708 15637 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:53.756894 13103 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.728317 16059 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:53.759795 16077 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:53.710261 15484 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:53.763063 16053 consensus_queue.cc:1059] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:53.764261 13134 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
W20260709 12:19:53.764487 16069 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:19:53.765666 16046 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:53.697733 16062 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.767344 16062 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:53.756894 16071 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:19:53.750469 15812 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.772344 13131 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:53.772780 15244 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5.
I20260709 12:19:53.773211 15812 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:53.709995 15735 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.775584 15735 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:53.779681 13134 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:19:53.780260 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:53.781286 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 69400.2us
W20260709 12:19:53.782064 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 53779.1us
I20260709 12:19:53.782123 13100 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.782998 15521 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:53.783298 13252 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:53.783730 15521 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:53.784247 16068 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:53.784973 13100 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:53.787734 13205 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:53.792012 13133 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
W20260709 12:19:53.797117 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.727922 16063 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:53.798537 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 131894us
I20260709 12:19:53.784286 15521 raft_consensus.cc:697] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:53.778533 15637 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.796228 15812 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:19:53.808514 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.816314 13212 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:53.801195 16063 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:53.808063 16030 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:53.826992 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:53.828009 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:53.825021 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.823527 13212 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:19:53.825363 13100 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:53.830327 13212 pending_rounds.cc:85] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 2
I20260709 12:19:53.830896 13212 pending_rounds.cc:107] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:19:53.831264 13212 raft_consensus.cc:2889] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:53.828778 13207 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
W20260709 12:19:53.833837 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 168702us
I20260709 12:19:53.822566 16000 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:53.836408 13252 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:53.812089 15554 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:53.837654 13277 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:53.826457 16030 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:53.838704 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:53.827522 16063 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:53.851920 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 195630us
I20260709 12:19:53.852667 13206 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:53.854274 13280 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:53.835980 15989 raft_consensus.cc:697] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:53.856890 13134 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:53.864327 13282 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 12:19:53.867007 13281 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:19:53.862244 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:53.869434 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:53.869869 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:53.862787 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:53.871626 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:53.874116 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 229382us
I20260709 12:19:53.876706 13277 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
W20260709 12:19:53.880496 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 60293us
I20260709 12:19:53.880752 13838 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.881307 13100 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:53.881904 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:53.835770 16004 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:19:53.851500 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.880007 16053 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.896704 13136 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:19:53.886339 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.902691 13129 raft_consensus.cc:2410] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:53.887028 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:53.887872 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.853431 15812 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:53.885311 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.906853 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:53.908258 13249 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:53.909387 13283 raft_consensus.cc:2410] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:53.915874 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:53.916781 13280 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:53.925873 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:53.931133 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 49880.5us
I20260709 12:19:53.932202 13100 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:53.853097 15244 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 12:19:53.945013 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 91432.3us
I20260709 12:19:53.945843 13838 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.947275 13838 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:53.895929 15521 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.948490 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:53.952463 15753 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:53.883024 16046 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:19:53.953329 16046 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:53.953708 16046 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:53.954113 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 70219.4us
I20260709 12:19:53.895172 16053 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.958534 13282 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:53.959627 16070 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:53.940316 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:53.941149 15636 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:53.962611 15244 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:53.941391 13135 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:19:53.890663 16030 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.966559 16030 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:53.968250 16070 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:53.888684 15989 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:53.971939 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:53.943856 15995 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:53.943889 15735 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:53.944428 15914 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:53.960134 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.889758 15637 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:53.973726 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:53.954660 16046 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:53.996727 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:54.008016 13207 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
W20260709 12:19:54.008993 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 68796.3us
I20260709 12:19:54.010730 13102 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:53.994894 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:54.000645 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:54.014324 13210 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:53.885942 16091 raft_consensus.cc:2764] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:19:53.899682 16080 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:53.952023 16087 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:54.023833 16087 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.024364 16087 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:53.962248 16089 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:54.027885 16089 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:54.029202 16089 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.031783 16089 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:53.893801 16043 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:54.042160 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 68530.1us
I20260709 12:19:54.051725 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:54.052075 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:54.051793 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:53.959333 16053 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:54.052487 13135 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
W20260709 12:19:54.055446 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.032824 15636 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:54.052755 13129 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:54.065783 13280 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:54.045600 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:53.992903 15884 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:19:53.993057 15244 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:19:53.992625 16045 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:19:54.068269 13103 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:54.050177 15662 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:54.049507 16004 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:54.071555 16073 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:19:54.067495 15914 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:54.067131 16046 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:54.073160 13881 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 4 LEARNER]: Advancing to term 5
W20260709 12:19:54.073504 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 237151us
I20260709 12:19:54.073789 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:54.074332 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:54.113269 13879 raft_consensus.cc:2410] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:19:54.074245 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:54.113858 13884 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:54.075385 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:54.076838 13211 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:54.077253 15753 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:19:54.077600 16090 log.cc:927] Time spent T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
I20260709 12:19:54.080518 15661 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.086256 13281 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:19:54.095355 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49871us
W20260709 12:19:54.096993 16085 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.145s	user 0.004s	sys 0.000s
I20260709 12:19:54.000612 16062 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:19:54.032665 13131 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
W20260709 12:19:54.109511 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 209034us
I20260709 12:19:54.110709 13177 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:54.093888 15662 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:54.120486 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 188378us
I20260709 12:19:54.125670 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:54.107930 15810 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:54.142673 15810 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:54.143160 15810 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:54.128961 15753 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.150324 15753 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.151996 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:54.153862 16070 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:54.135995 16071 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:54.156224 16071 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:54.159698 13252 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:54.115048 15914 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:54.160480 13100 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:54.161659 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:54.162916 16063 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:54.138592 13210 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:54.165099 16063 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.139029 15662 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:54.166342 15807 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:54.166787 15807 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:54.167162 15807 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:54.139503 13204 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:54.172979 15484 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:54.173715 15484 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:19:54.174015 15664 consensus_meta.cc:287] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.003s
I20260709 12:19:54.162809 13100 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:54.176362 15962 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:54.161381 15914 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:54.181517 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:54.136860 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 72790.1us
I20260709 12:19:54.183058 16067 raft_consensus.cc:3055] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:54.183161 16053 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:54.182688 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:54.180622 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:19:54.184098 13175 connection.cc:256] RPC call timeout handler was delayed by -1.2073683579999397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25670000000000004s for a response
W20260709 12:19:54.204595 13175 connection.cc:256] RPC call timeout handler was delayed by -1.0408683580001252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2752s for a response
I20260709 12:19:54.196944 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:54.115597 16068 raft_consensus.cc:697] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:54.218711 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:54.223613 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:54.224362 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 98771.2us
I20260709 12:19:54.225682 13252 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:54.227516 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:54.227840 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:54.197611 15852 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.196909 16067 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:54.135640 15995 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:19:54.126312 15987 consensus_queue.cc:1059] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:19:54.234217 13103 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:54.174815 15484 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.197059 16092 raft_consensus.cc:2764] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:19:54.248055 13838 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:54.157094 16071 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:54.193054 15244 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:19:54.216946 16053 raft_consensus.cc:697] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:54.255077 13838 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:54.267891 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:54.296800 13100 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:54.258970 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:54.298628 13129 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:19:54.279014 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.198050 16052 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:19:54.296279 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:54.296941 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54769.6us
I20260709 12:19:54.295859 15962 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.238643 16059 consensus_queue.cc:1059] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:19:54.287927 16068 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.291728 15834 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:54.238875 15929 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:19:54.305670 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 45477.4us
W20260709 12:19:54.308422 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 240629us
I20260709 12:19:54.313640 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 452) took 1555 ms. Trace:
W20260709 12:19:54.315460 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 60475.7us
I20260709 12:19:54.316951 15891 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:54.306499 13128 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:54.294677 16067 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:54.297941 16080 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:54.326756 13135 raft_consensus.cc:2393] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:54.308465 15664 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:54.247380 15852 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:54.308094 15884 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.324813 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:54.323297 16004 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:54.325572 16093 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:54.348351 16073 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:19:54.360100 15935 consensus_meta.cc:287] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.773s	user 0.006s	sys 0.006s
I20260709 12:19:54.390817 13878 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:54.311167 16087 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.394987 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:54.412694 13136 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
W20260709 12:19:54.401506 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 76740.6us
I20260709 12:19:54.398618 13204 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:19:54.399056 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.362926 16092 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:54.375139 16045 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:54.364208 16043 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.407771 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:54.361138 13284 rpcz_store.cc:276] 0709 12:19:52.757848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.758018 (+   170us) service_pool.cc:224] Handling call
0709 12:19:52.758398 (+   380us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:53.296086 (+537688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:53.296124 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:53.322779 (+ 26655us) log.cc:844] Serialized 78 byte log entry
0709 12:19:53.396721 (+ 73942us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b48001a01d8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f9db6aa1 00007f70f9dadb37 00007f70f9dad9ca 00007f70f9ea526f 00007f70f9ea4f37 00007f70f9eb955c 00007f70f9eb9508 00007f70f9eb9488 00007f70f9eb9443 00007f70f9eb86ec 00007f70f8de2a96
0709 12:19:53.461374 (+ 64653us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:53.489816 (+ 28442us) log.cc:844] Serialized 14 byte log entry
0709 12:19:53.996814 (+506998us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b1800233e00. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d1ac0a 00007f70fb45a219 00007f70f1da2a40 00007f70f1d9d4e4 00007f70f1d9d455 00007f70f88853c7 00007f70f4e979a7 00007f70f4ea70bf 00007f70f4ea7038
0709 12:19:53.997052 (+   238us) log.cc:844] Serialized 14 byte log entry
0709 12:19:54.075610 (+ 78558us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b1800233e00. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:19:54.313306 (+237696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:54.313393 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:54.313433 (+    40us) raft_consensus.cc:1685] finished
0709 12:19:54.313443 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:54.313581 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":954359,"prepare.queue_time_us":540292,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":96,"raft.queue_time_us":539204,"raft.run_cpu_time_us":1183,"raft.run_wall_time_us":65355,"spinlock_wait_cycles":40099712,"thread_start_us":429005,"threads_started":2,"wal-append.queue_time_us":248875}
I20260709 12:19:54.389683 15664 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.419010 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:54.420279 13129 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:54.355949 16077 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:19:54.426476 16030 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:54.476042 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.397081 16063 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.500213 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:54.500502 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 92833.7us
I20260709 12:19:54.510636 13887 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:19:54.374430 15962 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:54.384353 16082 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:19:54.513845 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 88231.2us
I20260709 12:19:54.412210 16067 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:54.430152 16073 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.495375 15934 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.406116 16059 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.155s
I20260709 12:19:54.406683 15884 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.509760 15664 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:54.508107 16093 raft_consensus.cc:697] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:54.507891 16062 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.560413 16070 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:54.560168 15989 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:19:54.615002 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 397132us
I20260709 12:19:54.598753 15995 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:54.638862 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 72114.6us
W20260709 12:19:54.627262 16094 log.cc:927] Time spent T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
W20260709 12:19:54.720173 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 102603us
I20260709 12:19:54.632922 15735 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.573963 16030 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:54.636150 15636 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.012s	sys 0.031s
W20260709 12:19:54.725289 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 429071us
I20260709 12:19:54.641176 15734 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.738035 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:54.729162 15844 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:19:54.502822 16053 consensus_queue.cc:237] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:54.604766 16063 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:54.752345 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 370982us
W20260709 12:19:54.746331 16099 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 12:19:54.633307 16080 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 12:19:54.420825 15935 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.745481 15734 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.627908 15934 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.598619 16092 consensus_queue.cc:1059] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
W20260709 12:19:54.738428 16046 consensus_meta.cc:287] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.001s
W20260709 12:19:54.742802 13881 consensus_meta.cc:287] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.001s
I20260709 12:19:54.764081 16045 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.642092 16062 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:54.717659 16086 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:19:54.818899 15934 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.820118 13881 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 5 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:54.774286 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:54.821945 13283 raft_consensus.cc:2410] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:54.822880 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:54.625264 16073 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.731575 15735 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:54.824782 16111 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 12:19:54.825743 15735 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:54.737396 15636 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.013s	sys 0.031s
I20260709 12:19:54.826097 16073 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:54.826372 15636 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:19:54.827186 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 46136.9us
I20260709 12:19:54.827453 15636 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.828222 13252 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:54.829792 13252 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:19:54.778366 16089 consensus_meta.cc:287] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.727s	user 0.010s	sys 0.000s
I20260709 12:19:54.812259 13285 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:54.721295 15995 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.778168 15852 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.813938 15935 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:54.817205 16062 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:54.823927 16109 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:19:54.832501 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 457) took 1181 ms. Trace:
W20260709 12:19:54.813268 15662 consensus_meta.cc:287] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.647s	user 0.013s	sys 0.001s
I20260709 12:19:54.883760 15662 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.884500 16030 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:54.885870 16106 log.cc:927] Time spent T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:19:54.887800 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:54.890537 15999 consensus_meta.cc:287] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.150s	user 0.009s	sys 0.000s
I20260709 12:19:54.890779 15662 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:54.872256 16100 log.cc:927] Time spent T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:19:54.892093 16105 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 12:19:54.898985 15807 consensus_meta.cc:287] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.731s	user 0.003s	sys 0.004s
I20260709 12:19:54.901077 15995 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.902070 16113 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:54.904124 15521 raft_consensus.cc:3055] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:54.904665 15521 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:54.905670 15521 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:54.907125 15521 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:54.836514 16046 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.866694 15852 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:54.842092 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 107116us
I20260709 12:19:54.867038 13285 rpcz_store.cc:276] 0709 12:19:53.651563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:53.655370 (+  3807us) service_pool.cc:224] Handling call
0709 12:19:53.665812 (+ 10442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:54.831483 (+1165671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:54.832258 (+   775us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001adbd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:54.832439 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2636065536}
I20260709 12:19:54.873597 15734 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:54.947057 16102 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:19:54.921058 15962 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.921937 15884 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.922736 16104 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:54.837617 16045 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:54.949899 16045 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.875837 16087 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.872303 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:54.951167 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:54.930774 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 192820us
I20260709 12:19:54.951941 13285 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:54.952507 16063 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.952814 13249 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:54.953783 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:54.954874 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:54.951251 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 79063.7us
I20260709 12:19:54.956405 13252 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:54.919581 15989 raft_consensus.cc:3055] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:54.957091 15989 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:54.958039 15989 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:54.955456 15935 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:54.960177 15935 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:54.959995 16046 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:54.960610 15935 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:54.962239 16046 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:54.838502 16093 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:54.964236 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:54.964488 16000 raft_consensus.cc:3055] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:54.965005 16000 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:54.946693 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:19:54.985816 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 349755us
W20260709 12:19:54.931679 16110 log.cc:927] Time spent T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:19:54.992440 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:55.006696 13209 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
W20260709 12:19:54.955114 15810 consensus_meta.cc:287] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.780s	user 0.006s	sys 0.002s
W20260709 12:19:55.010483 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 63956.8us
I20260709 12:19:55.010987 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:55.010354 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:55.011883 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 428165us
I20260709 12:19:55.012750 13280 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:54.891059 15999 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.014318 13177 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:54.955190 16113 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:55.012363 13285 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:19:55.024900 13285 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:55.006245 15844 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:55.020926 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:55.021473 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:55.022845 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.042347 13177 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:55.006865 16046 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:55.019146 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:55.046849 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:55.047072 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 90752.8us
I20260709 12:19:55.051488 13878 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:54.933897 15807 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.014639 16063 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:55.072860 13279 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:19:55.081502 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:55.082345 13207 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:55.052009 16103 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:55.069303 13841 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:55.084918 13884 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:19:55.022622 16092 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:55.084635 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:54.991961 15852 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.075670 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:19:55.093701 13211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.006s	sys 0.009s
I20260709 12:19:55.040652 16030 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:55.094621 13206 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
W20260709 12:19:55.093879 13130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.004s	sys 0.008s
I20260709 12:19:55.024421 15987 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:55.096735 13130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.005s	sys 0.008s
W20260709 12:19:55.095415 13211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.006s	sys 0.009s
I20260709 12:19:55.085582 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:55.108292 13887 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:55.048066 15844 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:55.060848 16046 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:55.112155 13282 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.004s	sys 0.010s
W20260709 12:19:55.117826 13282 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.004s	sys 0.011s
W20260709 12:19:55.113600 13281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.014s
I20260709 12:19:55.083287 15989 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:55.119216 13281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.000s	sys 0.014s
I20260709 12:19:55.017364 15810 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.026145 16080 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:19:55.070889 16113 raft_consensus.cc:697] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:55.086232 16117 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:55.092162 16045 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:55.124854 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:55.129456 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:55.130836 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:55.132272 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 63249.8us
I20260709 12:19:55.111264 16030 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.118129 15844 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:55.144881 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:55.121997 16046 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:55.142709 13879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.000s	sys 0.022s
I20260709 12:19:55.114192 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:55.144830 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:55.113006 16086 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:55.141992 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.116611 15662 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.046870 16000 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:55.156563 13206 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:55.167553 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:55.160702 13137 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:55.169035 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:55.138185 16045 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:55.159825 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:55.172077 13286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.006s	sys 0.015s
W20260709 12:19:55.172626 13286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.007s	sys 0.015s
I20260709 12:19:55.143110 16030 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:55.181814 13207 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:19:55.182348 13207 pending_rounds.cc:85] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 4
I20260709 12:19:55.182660 13207 pending_rounds.cc:107] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:19:55.182945 13207 raft_consensus.cc:2889] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:55.173714 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1822) took 1310 ms. Trace:
I20260709 12:19:55.113317 15987 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:55.193459 13285 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:55.201229 13887 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:55.184507 13286 rpcz_store.cc:276] 0709 12:19:53.863782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:53.865994 (+  2212us) service_pool.cc:224] Handling call
0709 12:19:53.885039 (+ 19045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:53.885286 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:54.350482 (+465196us) log.cc:844] Serialized 14 byte log entry
0709 12:19:55.173219 (+822737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:55.173289 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:55.173360 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.173449 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:55.173657 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120564,"prepare.queue_time_us":223434,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":1055397,"threads_started":2}
I20260709 12:19:55.154881 15244 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:55.173628 15962 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.158522 16086 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.174613 16053 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:55.146560 15661 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:19:55.155299 16108 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.176025 16045 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:55.170423 13881 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:55.185621 16091 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:55.260576 13284 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:55.261786 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:55.262563 13136 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
W20260709 12:19:55.263159 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 78332.3us
W20260709 12:19:55.264074 13840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.003s	sys 0.019s
W20260709 12:19:55.264465 13840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.004s	sys 0.019s
I20260709 12:19:55.228193 15244 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.173961 15662 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:55.234125 16086 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:55.285528 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:55.315145 13838 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:55.185696 15636 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:19:55.185724 16103 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 12:19:55.367524 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 52488.6us
I20260709 12:19:55.371007 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:55.262377 15735 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:55.389637 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:55.369092 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:55.390493 13136 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
W20260709 12:19:55.405622 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 352087us
I20260709 12:19:55.405723 13838 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:55.407979 13135 raft_consensus.cc:2393] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:55.300827 15244 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:55.363521 16000 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:55.430787 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 258013us
I20260709 12:19:55.435235 13103 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:55.242100 15962 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.436905 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:19:55.445508 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 161893us
I20260709 12:19:55.388795 16087 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:55.402738 16067 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.403410 16053 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.412072 16063 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:55.410254 16097 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:55.284443 16108 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:55.413619 15999 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:55.432353 16104 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:55.373308 16052 consensus_queue.cc:1059] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 12:19:55.430536 15735 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.430296 16121 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.466339 16087 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.465991 16089 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:55.508176 13252 connection.cc:256] RPC call timeout handler was delayed by -1.4514508129998376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 12:19:55.529359 13252 connection.cc:256] RPC call timeout handler was delayed by -1.3821508129997255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 12:19:55.476234 16130 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:19:55.529667 13252 connection.cc:256] RPC call timeout handler was delayed by -1.3497508129999005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 12:19:55.530874 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 46922.8us
W20260709 12:19:55.542136 13252 connection.cc:256] RPC call timeout handler was delayed by -1.1454508129997976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
I20260709 12:19:55.286461 16113 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:55.482460 16053 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:55.477617 16067 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:55.531908 15995 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.540192 15810 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:55.539979 13131 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:55.528251 16080 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.539901 15852 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:55.607621 13136 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:55.532954 16087 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:55.527511 16063 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:19:55.603952 15735 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:55.603854 16125 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:55.541671 16121 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:55.604543 16155 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:19:55.605509 16127 log.cc:927] Time spent T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
W20260709 12:19:55.620445 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 77362.6us
W20260709 12:19:55.631114 13249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.002s	sys 0.001s
W20260709 12:19:55.606932 15521 consensus_meta.cc:287] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.000s
I20260709 12:19:55.607611 16154 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:55.608181 16139 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:55.608610 16122 log.cc:927] Time spent T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.423s	user 0.000s	sys 0.001s
I20260709 12:19:55.609107 16053 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:55.609404 15987 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:55.600426 15995 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.548942 16089 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:55.610821 16141 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:19:55.551793 16130 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.625511 15852 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:55.634382 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.606577 16067 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:55.661839 13249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.004s	sys 0.001s
I20260709 12:19:55.693490 13249 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:19:55.636623 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 164611us
I20260709 12:19:55.635603 13285 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:19:55.607614 15636 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.495219 16097 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:55.627229 13252 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.794s (SENT) [suppressed 42 similar messages]
I20260709 12:19:55.661940 16139 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:55.659337 16093 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.003s	sys 0.013s
I20260709 12:19:55.614900 16125 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.613440 13136 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:55.621932 16131 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:19:55.700464 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:19:55.702328 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 75261us
I20260709 12:19:55.717284 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:55.703035 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 497) took 1495 ms. Trace:
I20260709 12:19:55.720242 13137 rpcz_store.cc:276] 0709 12:19:54.208136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.208304 (+   168us) service_pool.cc:224] Handling call
0709 12:19:54.223268 (+ 14964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:55.170858 (+947590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.702770 (+531912us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b540010d6d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:55.702964 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155437312}
I20260709 12:19:55.623821 16155 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.661761 16080 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.722823 16068 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:55.697175 16126 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.424s	user 0.001s	sys 0.000s
I20260709 12:19:55.683760 15987 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:55.706128 16093 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.003s	sys 0.014s
I20260709 12:19:55.731473 13284 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:55.693032 16108 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:55.700709 15662 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:55.709383 16139 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:55.758337 16137 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:55.759629 15844 consensus_meta.cc:287] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.003s
I20260709 12:19:55.789901 16162 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:55.790105 15844 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:55.791100 16136 log.cc:927] Time spent T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 12:19:55.792047 16155 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:55.792695 15844 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:55.793356 15844 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:55.793406 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 527) took 1211 ms. Trace:
I20260709 12:19:55.793988 15844 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.794498 15844 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:55.759919 16053 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:55.795697 16162 raft_consensus.cc:697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:55.796607 16091 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:55.797159 16091 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:55.796824 16162 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.760102 13175 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:55.794044 13204 rpcz_store.cc:276] 0709 12:19:54.582164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.582375 (+   211us) service_pool.cc:224] Handling call
0709 12:19:54.610149 (+ 27774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:54.628863 (+ 18714us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:54.628909 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:54.660972 (+ 32063us) log.cc:844] Serialized 26 byte log entry
0709 12:19:55.143272 (+482300us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:55.143333 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.143495 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:55.793165 (+649670us) raft_consensus.cc:1685] finished
0709 12:19:55.793189 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:55.793340 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1630,"raft.queue_time_us":2161,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":82727,"thread_start_us":395385,"threads_started":1,"wal-append.queue_time_us":1061969}
I20260709 12:19:55.760987 15962 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:55.697441 15852 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:55.801901 16134 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 12:19:55.802209 16164 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:55.802763 15852 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:55.715974 16067 consensus_queue.cc:1059] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:19:55.803234 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 467) took 1641 ms. Trace:
I20260709 12:19:55.803835 16067 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:55.804364 16067 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:19:55.805645 16135 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.195s	user 0.000s	sys 0.002s
I20260709 12:19:55.805409 16067 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.806911 16067 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:55.762786 16116 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:55.808472 16116 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:55.737223 16068 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:55.809310 16143 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.304s	user 0.001s	sys 0.001s
I20260709 12:19:55.809439 16068 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:55.811513 16121 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:55.812101 16164 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.812587 16164 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:55.812696 16137 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.764381 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:55.814739 15664 consensus_meta.cc:287] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.088s	user 0.007s	sys 0.002s
I20260709 12:19:55.814715 16164 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:55.816926 16161 raft_consensus.cc:3055] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:55.803669 13281 rpcz_store.cc:276] 0709 12:19:54.162092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.185237 (+ 23145us) service_pool.cc:224] Handling call
0709 12:19:54.217460 (+ 32223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:54.421353 (+203893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:54.421396 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:54.507862 (+ 86466us) log.cc:844] Serialized 26 byte log entry
0709 12:19:55.120543 (+612681us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:55.120650 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.120911 (+   261us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:55.803040 (+682129us) raft_consensus.cc:1685] finished
0709 12:19:55.803059 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:55.803175 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25163,"raft.queue_time_us":149232,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3902,"thread_start_us":680201,"threads_started":2,"wal-append.queue_time_us":760148}
I20260709 12:19:55.817384 16161 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:55.818871 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.821468 15807 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:55.811681 15844 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:55.824054 15844 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:55.824635 15844 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.818476 16161 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.825784 16161 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:55.827387 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:55.828552 16127 log.cc:927] Time spent T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 12:19:55.746030 16153 log.cc:927] Time spent T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:19:55.715886 16125 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:55.670841 16154 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.732762 16103 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.733402 15834 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:55.800462 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:55.706399 15636 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:55.764849 16118 log.cc:927] Time spent T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.431s	user 0.001s	sys 0.000s
I20260709 12:19:55.728057 15999 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:19:55.829660 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1831) took 1614 ms. Trace:
I20260709 12:19:55.736349 15521 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.752221 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 506) took 1506 ms. Trace:
I20260709 12:19:55.785751 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:55.763554 16080 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:55.766593 16130 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:55.793288 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 503) took 1566 ms. Trace:
I20260709 12:19:55.846756 13284 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 12:19:55.834767 16045 consensus_meta.cc:287] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.001s
I20260709 12:19:55.814715 16137 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:55.825053 15844 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:55.869110 16126 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:19:55.870276 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 327549us
W20260709 12:19:55.963701 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 243521us
I20260709 12:19:55.956568 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:55.994621 13284 pending_rounds.cc:85] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 4
I20260709 12:19:56.063455 13284 pending_rounds.cc:107] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:19:56.063762 13284 raft_consensus.cc:2889] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:55.815021 16097 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:55.869930 16154 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:55.985234 13132 rpcz_store.cc:276] 0709 12:19:54.246220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.246358 (+   138us) service_pool.cc:224] Handling call
0709 12:19:54.303635 (+ 57277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:54.309398 (+  5763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:54.309445 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:54.323180 (+ 13735us) log.cc:844] Serialized 26 byte log entry
0709 12:19:54.757576 (+434396us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:54.757727 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:54.757931 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:55.751973 (+994042us) raft_consensus.cc:1685] finished
0709 12:19:55.751998 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:55.752150 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2293,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":15583,"thread_start_us":374656,"threads_started":1,"wal-append.queue_time_us":738151}
I20260709 12:19:55.831550 15734 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.222s
I20260709 12:19:55.869467 16128 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:55.998694 13129 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:19:55.945688 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.910645 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:55.865332 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:56.022970 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.076238 13281 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:55.751416 15987 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.085402 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:56.085769 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.086066 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:56.086580 13884 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:56.086992 16172 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:56.086704 15753 consensus_queue.cc:1059] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:56.087451 16172 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:56.087867 16172 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:56.090166 16097 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:55.994503 13130 rpcz_store.cc:276] 0709 12:19:54.227400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.227548 (+   148us) service_pool.cc:224] Handling call
0709 12:19:54.250559 (+ 23011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:54.259180 (+  8621us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:54.297558 (+ 38378us) log.cc:844] Serialized 14 byte log entry
0709 12:19:55.147934 (+850376us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:55.166555 (+ 18621us) log.cc:844] Serialized 26 byte log entry
0709 12:19:55.173887 (+  7332us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:55.174185 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 12:19:55.174410 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.174516 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:55.793082 (+618566us) raft_consensus.cc:1685] finished
0709 12:19:55.793101 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:55.793231 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50935,"prepare.queue_time_us":38292,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":18371,"raft.queue_time_us":153794,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":26817,"thread_start_us":799473,"threads_started":1,"wal-append.queue_time_us":1170687}
I20260709 12:19:56.093986 15987 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.094755 15987 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:56.095800 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.097179 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:56.097460 16150 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.353s	user 0.000s	sys 0.000s
I20260709 12:19:56.098227 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.098628 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 532) took 1087 ms. Trace:
I20260709 12:19:56.098970 13209 rpcz_store.cc:276] 0709 12:19:55.011166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.016413 (+  5247us) service_pool.cc:224] Handling call
0709 12:19:55.016768 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:55.017112 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:55.017137 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:55.025377 (+  8240us) log.cc:844] Serialized 26 byte log entry
0709 12:19:55.395785 (+370408us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:55.395889 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.395992 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.098434 (+702442us) raft_consensus.cc:1685] finished
0709 12:19:56.098452 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.098574 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12224,"raft.queue_time_us":5540,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":14723,"thread_start_us":300531,"threads_started":1,"wal-append.queue_time_us":593435}
I20260709 12:19:56.085824 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:56.103885 13878 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:55.992522 13277 rpcz_store.cc:276] 0709 12:19:54.215485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.215607 (+   122us) service_pool.cc:224] Handling call
0709 12:19:54.223623 (+  8016us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:54.506637 (+283014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:54.506682 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:54.576604 (+ 69922us) log.cc:844] Serialized 52 byte log entry
0709 12:19:55.027026 (+450422us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:55.087833 (+ 60807us) log.cc:844] Serialized 14 byte log entry
0709 12:19:55.424181 (+336348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.424308 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:55.829390 (+405082us) raft_consensus.cc:1685] finished
0709 12:19:55.829427 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:55.829590 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5181,"prepare.queue_time_us":62695,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3860,"raft.queue_time_us":159448,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5248,"spinlock_wait_cycles":19681024,"thread_start_us":971136,"threads_started":3,"wal-append.queue_time_us":612893}
W20260709 12:19:55.983604 16159 log.cc:927] Time spent T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:19:56.066020 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 469) took 1828 ms. Trace:
I20260709 12:19:56.110114 13282 rpcz_store.cc:276] 0709 12:19:54.238073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.238227 (+   154us) service_pool.cc:224] Handling call
0709 12:19:54.238633 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:55.118352 (+879719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:55.118397 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:55.126785 (+  8388us) log.cc:844] Serialized 26 byte log entry
0709 12:19:55.410073 (+283288us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:55.410118 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.411342 (+  1224us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.065796 (+654454us) raft_consensus.cc:1685] finished
0709 12:19:56.065815 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.065956 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70745,"raft.queue_time_us":170322,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":12136,"thread_start_us":1089549,"threads_started":2,"wal-append.queue_time_us":363776}
I20260709 12:19:55.850427 15664 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:56.111687 16177 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.112094 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:56.112243 16177 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:55.996502 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 528) took 1397 ms. Trace:
I20260709 12:19:55.844496 15852 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:56.063548 13286 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:56.114660 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2641) took 1012 ms. Trace:
I20260709 12:19:56.118309 13284 rpcz_store.cc:276] 0709 12:19:55.102072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.749980 (+647908us) service_pool.cc:224] Handling call
0709 12:19:55.831374 (+ 81394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:56.082654 (+251280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.114600 (+ 31946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:55.996248 16121 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:56.086484 13131 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:19:56.109390 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 461) took 2152 ms. Trace:
I20260709 12:19:56.120074 13132 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:19:56.115666 13210 rpcz_store.cc:276] 0709 12:19:54.598964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.599328 (+   364us) service_pool.cc:224] Handling call
0709 12:19:54.599778 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:54.628739 (+ 28961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:54.628782 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:54.640013 (+ 11231us) log.cc:844] Serialized 26 byte log entry
0709 12:19:55.052155 (+412142us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:55.052190 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.052245 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:55.991092 (+938847us) raft_consensus.cc:1685] finished
0709 12:19:55.991121 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:55.996432 (+  5311us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18652,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8858,"thread_start_us":320442,"threads_started":1,"wal-append.queue_time_us":538973}
I20260709 12:19:56.121646 13177 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:56.122120 13129 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:56.057188 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 256798us
I20260709 12:19:56.127189 13278 rpcz_store.cc:276] 0709 12:19:53.956577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:53.957071 (+   494us) service_pool.cc:224] Handling call
0709 12:19:53.957428 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:53.957782 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:54.516432 (+558650us) log.cc:844] Serialized 14 byte log entry
0709 12:19:55.072252 (+555820us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:55.075350 (+  3098us) log.cc:844] Serialized 26 byte log entry
0709 12:19:55.075654 (+   304us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:55.075701 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.075800 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.109102 (+1033302us) raft_consensus.cc:1685] finished
0709 12:19:56.109130 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.109294 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125601,"prepare.queue_time_us":202520,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":151063,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":56,"spinlock_wait_cycles":12807552,"thread_start_us":818316,"threads_started":2,"wal-append.queue_time_us":541867}
I20260709 12:19:56.137372 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:56.138111 13884 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:56.144364 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:56.145162 13277 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:19:56.090936 16097 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.058192 16045 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:56.053010 15834 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.150395 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:56.150220 13175 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:56.150874 13838 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:56.064956 15521 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.124197 16137 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:56.053586 16103 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:56.156635 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:56.128607 15852 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.146059 16053 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:56.163748 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:56.157696 16089 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:56.174732 15999 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:56.164599 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:56.165366 16137 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:56.119884 16128 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.227770 13137 raft_consensus.cc:2393] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:56.151947 15664 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.162472 15753 raft_consensus.cc:3055] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:19:56.257692 15989 consensus_meta.cc:287] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.130s	user 0.016s	sys 0.005s
I20260709 12:19:56.156993 15995 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:56.236680 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 80152.7us
W20260709 12:19:56.238519 15244 consensus_meta.cc:287] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.794s	user 0.015s	sys 0.001s
I20260709 12:19:56.243046 13881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:47544
W20260709 12:19:56.288565 16046 consensus_meta.cc:287] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 1.122s	user 0.010s	sys 0.001s
I20260709 12:19:56.253759 13130 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:56.254364 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 502) took 2037 ms. Trace:
I20260709 12:19:56.136660 16121 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:56.258744 15999 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.262707 16169 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:56.229326 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:56.254871 15935 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.294s	user 0.015s	sys 0.000s
I20260709 12:19:56.279219 15244 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.253414 15987 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:56.271803 16086 consensus_meta.cc:287] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.867s	user 0.004s	sys 0.007s
I20260709 12:19:56.282668 16097 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.283303 16154 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:56.286382 16030 consensus_meta.cc:287] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 1.077s	user 0.010s	sys 0.000s
I20260709 12:19:56.253194 16053 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.280395 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:56.262753 16089 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.290208 13133 rpcz_store.cc:276] 0709 12:19:54.217065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.217199 (+   134us) service_pool.cc:224] Handling call
0709 12:19:54.217582 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:54.217986 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:54.218027 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:54.222807 (+  4780us) log.cc:844] Serialized 26 byte log entry
0709 12:19:54.789233 (+566426us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:54.815791 (+ 26558us) log.cc:844] Serialized 14 byte log entry
0709 12:19:54.843921 (+ 28130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:54.844017 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.254126 (+1410109us) raft_consensus.cc:1685] finished
0709 12:19:56.254145 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.254282 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27821,"prepare.queue_time_us":25846,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":81010,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":16898,"thread_start_us":492476,"threads_started":1,"wal-append.queue_time_us":867680}
I20260709 12:19:56.258750 16149 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:19:56.326646 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 46328.8us
I20260709 12:19:56.289049 16046 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:56.270128 15753 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:56.338578 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:56.341813 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:56.259271 16068 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.303568 16169 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.297793 15844 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.305655 15999 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:56.327284 16053 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:56.341507 16149 raft_consensus.cc:697] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:56.370087 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:56.303023 16177 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.337692 16097 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:56.345371 16103 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.385392 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:56.373829 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:56.326535 15987 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:56.388552 16168 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:19:56.329913 16030 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:56.358228 16073 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.333297 16089 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.360323 15521 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.353803 16169 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:56.357954 15636 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.327142 15935 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:56.393890 13277 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 3. Current term is 4. Ops: []
W20260709 12:19:56.394511 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 254381us
I20260709 12:19:56.395293 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:56.398591 13283 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
W20260709 12:19:56.399518 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.326766 16086 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.402403 16073 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.431905 13212 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:19:56.429574 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:56.422231 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:56.442970 16193 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.443099 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.396765 16190 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.443297 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:56.452282 13286 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:56.456290 13130 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:19:56.457775 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.408069 16045 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:56.434672 16183 log.cc:927] Time spent T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 12:19:56.432272 16091 consensus_meta.cc:287] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.006s
I20260709 12:19:56.428543 16117 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:56.467710 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.467845 13207 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:19:56.465368 13879 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:56.445029 16139 consensus_meta.cc:287] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.005s
I20260709 12:19:56.402081 16149 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.468180 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.468787 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.468258 13207 pending_rounds.cc:85] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:19:56.433182 15834 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:56.494067 13207 pending_rounds.cc:107] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 6.7
W20260709 12:19:56.460892 16125 consensus_meta.cc:287] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
W20260709 12:19:56.460601 16161 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.001s
I20260709 12:19:56.494591 13207 raft_consensus.cc:2889] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:56.494954 13206 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:56.493690 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:56.459230 16162 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.476563 13203 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
W20260709 12:19:56.469832 16000 consensus_meta.cc:287] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.019s	user 0.013s	sys 0.000s
I20260709 12:19:56.504802 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:56.472446 16192 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 12:19:56.471402 16117 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:56.513646 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:56.515960 16147 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:19:56.518191 13286 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:19:56.472510 13881 raft_consensus.cc:606] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.493131 15636 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:56.510962 16142 log.cc:927] Time spent T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:19:56.430336 15753 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.539353 16086 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.525982 13881 raft_consensus.cc:614] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:56.526865 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.506592 15987 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:56.540455 15753 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:56.541146 13203 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:56.475145 16091 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.493685 16139 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.525244 16137 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:56.458844 16193 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:56.519655 16162 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.511849 16125 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:56.663826 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.548285 13280 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
W20260709 12:19:56.663081 13283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2629) took 1642 ms (client timeout 2016 ms). Trace:
I20260709 12:19:56.635155 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.666319 13203 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:19:56.664870 13283 rpcz_store.cc:269] 0709 12:19:55.020509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.020637 (+   128us) service_pool.cc:224] Handling call
0709 12:19:56.662857 (+1642220us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002288d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:56.662984 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2878897536}
I20260709 12:19:56.527864 16128 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.673750 13209 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:56.530475 16046 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.676659 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:56.531047 16121 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:56.634259 16156 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:19:56.545820 16073 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.667747 16068 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.529124 15636 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.681802 13278 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:19:56.676244 16163 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:19:56.682277 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.685076 13203 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:56.677879 16030 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.536801 16172 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.688501 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.678625 16089 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:56.694716 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:56.695346 13133 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:19:56.696923 13175 connection.cc:256] RPC call timeout handler was delayed by -1.3184148239997739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 12:19:56.697494 13175 connection.cc:256] RPC call timeout handler was delayed by -1.3121148239997638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 12:19:56.697860 13175 connection.cc:256] RPC call timeout handler was delayed by -1.3013148239999737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
I20260709 12:19:56.697964 16091 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:56.698243 13175 connection.cc:256] RPC call timeout handler was delayed by -1.2662148239999169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 12:19:56.698722 13175 connection.cc:256] RPC call timeout handler was delayed by -1.1789148239997758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 12:19:56.699384 13175 connection.cc:256] RPC call timeout handler was delayed by -1.0043148239999482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
I20260709 12:19:56.698698 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.700457 13129 raft_consensus.cc:2410] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:19:56.707772 13252 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:56.707620 16053 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:56.709137 13210 raft_consensus.cc:2368] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7.
I20260709 12:19:56.709834 13252 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:56.710443 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:56.710999 13210 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:56.712072 16067 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.712247 16119 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:56.712817 16119 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:56.712646 16067 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:56.713222 16119 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:56.714805 16067 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.715709 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:56.716462 16104 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:56.720355 13210 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
W20260709 12:19:56.718575 16087 consensus_meta.cc:287] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 1.076s	user 0.011s	sys 0.000s
I20260709 12:19:56.727846 16087 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.728379 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:56.728940 13136 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:56.730145 16087 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.735821 16067 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:56.716629 16053 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.739904 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.739689 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.741044 16087 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:56.741639 13129 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:56.742729 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.743155 13840 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.743531 13129 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:56.741070 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.744551 16087 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:56.744627 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.744906 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.745312 13129 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:19:56.746028 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.746166 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.746654 13133 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:56.747247 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.750746 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.716491 13131 raft_consensus.cc:2393] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:56.724118 16193 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:56.724818 16152 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 1.115s	user 0.000s	sys 0.003s
I20260709 12:19:56.724948 13175 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.751749 13203 raft_consensus.cc:2410] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:19:56.725967 16169 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.750845 13136 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:56.751312 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.753842 13175 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.721341 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.752089 13129 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:19:56.755031 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.754953 13210 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:56.735212 15999 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.843791 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2666) took 1776 ms. Trace:
I20260709 12:19:56.767882 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:56.848162 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.848790 13136 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:19:56.837437 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 82468.4us
I20260709 12:19:56.756409 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.822346 13129 raft_consensus.cc:1240] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:56.848354 13205 rpcz_store.cc:276] 0709 12:19:55.066981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.076341 (+  9360us) service_pool.cc:224] Handling call
0709 12:19:55.106874 (+ 30533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:55.107317 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:55.107358 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:55.113086 (+  5728us) log.cc:844] Serialized 26 byte log entry
0709 12:19:55.472390 (+359304us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:55.472431 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.472504 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.724138 (+1251634us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:56.835518 (+111380us) raft_consensus.cc:1685] finished
0709 12:19:56.835550 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.843689 (+  8139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6365,"spinlock_wait_cycles":6523264,"thread_start_us":331992,"threads_started":1,"wal-append.queue_time_us":433992}
I20260709 12:19:56.850574 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:56.851925 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:56.853317 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:56.752362 16162 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.752475 16030 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.757864 16139 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.758872 16125 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.829836 16172 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.755713 16193 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:56.857257 13252 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:56.855804 16116 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:56.866197 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:56.868122 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.807833 16199 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.867040 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.857699 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:56.879156 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.884199 13133 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 3.
I20260709 12:19:56.886669 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 514) took 1125 ms. Trace:
I20260709 12:19:56.886958 13137 rpcz_store.cc:276] 0709 12:19:55.761778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.764021 (+  2243us) service_pool.cc:224] Handling call
0709 12:19:56.886517 (+1122496us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540010d1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:56.886619 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948054784}
I20260709 12:19:56.879688 13175 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.831072 16169 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:56.889760 13210 raft_consensus.cc:2410] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:19:56.889700 13175 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.891070 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.892702 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:56.881860 16202 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:19:56.854597 16053 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:56.853615 16067 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:56.882822 13203 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:56.893409 13129 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:56.880343 13136 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:56.898195 13175 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.899144 13136 raft_consensus.cc:1240] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:19:56.882964 16104 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:56.900072 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:56.900729 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:56.897859 16162 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:56.899935 16189 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:56.883577 16116 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.888619 16071 raft_consensus.cc:3055] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:56.893675 13131 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:56.907891 16071 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:56.909521 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:56.894052 16172 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:56.908125 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:56.892346 16030 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:56.897727 16067 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:56.898675 16053 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:56.908672 13175 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:56.913527 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.881649 16119 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.914673 13203 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 3: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:56.916098 13175 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.916165 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1823) took 3052 ms. Trace:
I20260709 12:19:56.916832 13279 rpcz_store.cc:276] 0709 12:19:53.864135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:53.882624 (+ 18489us) service_pool.cc:224] Handling call
0709 12:19:53.882903 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:55.078966 (+1196063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.914645 (+1835679us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400332054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:56.916106 (+  1461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736015232}
I20260709 12:19:56.917618 13175 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:56.908718 16116 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:56.912456 16071 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.920043 16071 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:56.900571 16193 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:19:56.924134 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.903383 16117 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.925606 16093 raft_consensus.cc:3055] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:56.926789 13205 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:56.915076 16053 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:56.913406 16067 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:56.929111 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:56.928432 16093 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:19:56.930603 16124 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 1.528s	user 0.004s	sys 0.009s
I20260709 12:19:56.931318 16093 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.931843 16117 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.927654 16162 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:56.932729 16093 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:56.933123 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2664) took 2553 ms. Trace:
I20260709 12:19:56.932982 16162 consensus_queue.cc:1059] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:56.934005 16162 raft_consensus.cc:3055] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:56.934594 16162 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:56.915933 16189 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:56.930662 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:56.935748 13205 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:56.927744 16030 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:56.933555 13211 rpcz_store.cc:276] 0709 12:19:54.379232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.384858 (+  5626us) service_pool.cc:224] Handling call
0709 12:19:54.385235 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:54.385691 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:54.385733 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:54.390414 (+  4681us) log.cc:844] Serialized 26 byte log entry
0709 12:19:55.101002 (+710588us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:55.101044 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.101112 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.928323 (+1827211us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:56.932802 (+  4479us) raft_consensus.cc:1685] finished
0709 12:19:56.932823 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.933044 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5007,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":15802,"spinlock_wait_cycles":9671040,"thread_start_us":605519,"threads_started":1,"wal-append.queue_time_us":838175}
I20260709 12:19:56.939062 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.939177 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:56.939960 13203 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:56.937230 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:56.932731 16154 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:56.941788 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:56.942481 13208 raft_consensus.cc:2393] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:56.942865 16172 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:56.943570 16045 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:56.943950 16045 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.944253 16045 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:56.947516 16190 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:56.947616 15999 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.948055 16190 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.948446 16190 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:56.949162 16119 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.949827 16030 raft_consensus.cc:697] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:56.950832 16030 consensus_queue.cc:237] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:56.954365 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.928335 16046 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:19:56.955559 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.956166 13209 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
I20260709 12:19:56.936777 16189 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.956938 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:56.957186 16189 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:56.958658 13211 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:19:56.959865 16203 log.cc:927] Time spent T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:19:56.960786 16154 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:56.961328 16154 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:56.963572 16154 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:56.943182 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:56.970278 13252 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:56.970821 13211 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:56.971539 13208 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:56.975548 13205 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:56.972330 13252 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:56.984795 13252 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:56.987154 13131 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:56.989065 13175 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:56.991796 13203 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:56.990526 13252 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:56.994446 13252 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:56.996942 13134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1253) took 1424 ms. Trace:
I20260709 12:19:56.997355 13134 rpcz_store.cc:276] 0709 12:19:55.572544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.573838 (+  1294us) service_pool.cc:224] Handling call
0709 12:19:55.608001 (+ 34163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:55.608381 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:55.608409 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:56.758935 (+1150526us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b2c00000c88. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:19:56.759796 (+   861us) log.cc:844] Serialized 26 byte log entry
0709 12:19:56.844702 (+ 84906us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:56.844738 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.844805 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.990588 (+145783us) raft_consensus.cc:1685] finished
0709 12:19:56.990607 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.996871 (+  6264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19650,"raft.queue_time_us":75658,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":9476,"spinlock_wait_cycles":12011392,"thread_start_us":70699,"threads_started":1,"wal-append.queue_time_us":106215}
I20260709 12:19:57.002463 15636 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:57.003754 16158 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:57.004163 16158 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.004312 13252 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:57.004581 16158 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:57.005300 16181 log.cc:927] Time spent T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.740s	user 0.001s	sys 0.001s
I20260709 12:19:57.006544 16091 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:56.996481 15999 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:56.972846 16119 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:56.990799 16117 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:57.021623 13252 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:56.972692 16046 consensus_queue.cc:1059] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:19:56.996184 16172 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:57.008925 16068 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:57.032356 16046 raft_consensus.cc:3055] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:57.032829 16046 raft_consensus.cc:740] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:57.033703 16046 consensus_queue.cc:260] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.035022 16046 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:57.024063 16149 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:19:57.012559 15999 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:57.038733 15999 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:57.040179 16067 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.042371 15935 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:57.011273 16137 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:57.044638 16137 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.044981 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:57.046229 16067 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:57.047945 16137 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:57.053798 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:57.054431 13207 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:57.054239 15999 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.057430 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:57.023727 15891 consensus_queue.cc:1059] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:19:57.057998 13209 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:57.058476 16137 raft_consensus.cc:3055] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:57.058854 16137 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:57.059651 16137 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.061184 15852 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:57.060993 16189 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.061442 16137 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:57.061918 15244 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:57.029181 16091 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:19:57.064965 16091 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:57.065533 16091 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.012701 16104 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:19:57.069149 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.069761 13277 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:57.070602 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.063048 16189 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:57.071926 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.072530 13279 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:57.075794 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.076627 13283 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 2.
I20260709 12:19:57.048614 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:57.077697 15244 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:57.077775 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.063024 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.078505 13285 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:57.067770 13207 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:57.085561 13279 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
W20260709 12:19:57.076777 16200 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.395s	user 0.002s	sys 0.000s
I20260709 12:19:57.077781 13100 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:57.078167 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:57.089780 16149 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.090277 16149 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.090875 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.092031 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.092371 16149 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:57.092628 13286 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:19:57.093660 13284 raft_consensus.cc:1240] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:57.094928 13277 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:57.095148 15244 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:57.097194 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:57.098098 13130 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:57.021028 16117 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:57.028831 16080 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:57.103466 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:57.104156 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.104293 13207 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:57.107478 13252 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:57.115760 13207 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:57.079358 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.100721 16161 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.096581 15891 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:57.102339 15995 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:57.105090 16117 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:57.130882 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:57.106637 16071 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:57.099792 16172 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:57.150405 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.144622 13102 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:57.151399 13883 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:57.152981 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:57.153930 13887 raft_consensus.cc:2393] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:57.154819 13885 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:57.116182 16004 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:57.158550 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.101392 15735 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:19:57.148284 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.174882 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:57.164803 16091 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:57.109717 15852 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.176281 15852 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.177753 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.178669 15852 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:57.178901 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.179702 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.179951 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.181845 13884 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:57.182528 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 674) took 1036 ms. Trace:
I20260709 12:19:57.183754 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 673) took 1046 ms. Trace:
I20260709 12:19:57.184157 13880 rpcz_store.cc:276] 0709 12:19:56.137305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.148068 (+ 10763us) service_pool.cc:224] Handling call
0709 12:19:57.035798 (+887730us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:57.183691 (+147893us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6106496}
W20260709 12:19:57.184563 13280 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2627) took 2165 ms (client timeout 1867 ms). Trace:
W20260709 12:19:57.184940 13280 rpcz_store.cc:269] 0709 12:19:55.018719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.018870 (+   151us) service_pool.cc:224] Handling call
0709 12:19:57.184350 (+2165480us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400097ed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:57.184455 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3388109568}
I20260709 12:19:57.185410 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.186753 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.147312 13206 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:19:57.188846 13206 pending_rounds.cc:85] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 4
I20260709 12:19:57.157971 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.158301 16125 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:57.158766 16154 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:57.159184 15636 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:57.160118 15554 raft_consensus.cc:3055] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:57.161087 15807 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:57.125747 15935 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:57.115538 16080 raft_consensus.cc:697] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:57.167217 13283 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:57.221639 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.024345 16162 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.169538 16077 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:57.170325 16073 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:57.171087 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1251) took 1599 ms. Trace:
I20260709 12:19:57.145237 16119 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:19:57.175419 13207 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:57.182868 13884 rpcz_store.cc:276] 0709 12:19:56.146560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.148358 (+  1798us) service_pool.cc:224] Handling call
0709 12:19:57.181429 (+1033071us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e66fc0 00007f70f9e51929 00007f70f9e513d2 00007f70f33c8bd4
0709 12:19:57.181649 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:57.182261 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.182468 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9281920}
I20260709 12:19:57.194900 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:57.230129 15484 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:57.143117 13209 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:19:57.156647 15891 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.196651 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 665) took 1924 ms. Trace:
I20260709 12:19:57.187368 13880 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:19:57.149416 16161 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.197230 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.208630 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:57.242527 13887 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:57.208923 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.243058 13885 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:57.213572 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.243921 13886 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:57.189093 13206 pending_rounds.cc:107] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:19:57.244837 13206 raft_consensus.cc:2917] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 12:19:57.245302 13206 raft_consensus.cc:2889] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:57.137025 15995 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.225762 13135 rpcz_store.cc:276] 0709 12:19:55.571857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.571993 (+   136us) service_pool.cc:224] Handling call
0709 12:19:55.609275 (+ 37282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:55.609623 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:55.609653 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:56.396700 (+787047us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b2c00000c88. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:19:56.397241 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 12:19:56.518396 (+121155us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:56.518433 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.518502 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:57.075924 (+557422us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:19:57.170864 (+ 94940us) raft_consensus.cc:1685] finished
0709 12:19:57.170890 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:57.171030 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82096,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":12734,"spinlock_wait_cycles":14007040,"thread_start_us":65439,"threads_started":1,"wal-append.queue_time_us":191740}
I20260709 12:19:57.139470 13130 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:19:57.233565 13252 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:57.240034 13879 rpcz_store.cc:276] 0709 12:19:55.263380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.263691 (+   311us) service_pool.cc:224] Handling call
0709 12:19:55.264004 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:56.471512 (+1207508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.187746 (+716234us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540047efd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:57.187898 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2762245888}
I20260709 12:19:57.212369 15554 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:57.250119 13285 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:19:57.252170 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.254827 15995 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:57.239705 16130 consensus_queue.cc:1059] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:19:57.256053 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:57.255864 16080 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.257184 16190 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.232991 15935 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:57.192982 16004 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:57.280772 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 127569us
I20260709 12:19:57.280789 13285 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:57.257710 13207 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:57.284447 13841 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:57.288873 13252 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:57.270582 16104 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:57.290784 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:57.297029 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.302855 13207 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:57.297504 16093 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:57.297612 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47544 (request call id 1) took 1129 ms. Trace:
I20260709 12:19:57.276872 16161 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:57.303679 13887 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:19:57.263398 16045 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.309861 13209 raft_consensus.cc:2368] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5.
I20260709 12:19:57.310997 16045 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:57.270987 16137 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:19:57.312819 13102 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:57.266418 16053 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.302511 16130 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:57.284411 16071 raft_consensus.cc:697] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:57.300494 15891 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:57.356171 13207 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:19:57.357712 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.307507 16104 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:57.362509 16104 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.363955 16211 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:57.364678 16211 raft_consensus.cc:697] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:57.365585 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:57.365782 16211 consensus_queue.cc:237] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.366914 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:57.367517 13204 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:57.361338 13206 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:57.369720 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.370311 13206 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
W20260709 12:19:57.358757 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 46038.5us
I20260709 12:19:57.273032 16172 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.373998 13205 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:57.371212 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.377794 16164 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.378813 16128 raft_consensus.cc:3055] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:57.379249 16128 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:57.379873 13205 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:57.378454 16164 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.377341 13206 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:57.341780 16093 raft_consensus.cc:697] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:57.351191 13882 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:57.387465 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2665) took 2320 ms. Trace:
I20260709 12:19:57.387991 13212 rpcz_store.cc:276] 0709 12:19:55.066606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.067570 (+   964us) service_pool.cc:224] Handling call
0709 12:19:55.068005 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:56.447886 (+1379881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.387130 (+939244us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002157d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:57.387364 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3128499584}
W20260709 12:19:57.383644 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 210902us
I20260709 12:19:57.392665 13878 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:19:57.393006 13878 pending_rounds.cc:85] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Aborting all ops after (but not including) 5
I20260709 12:19:57.393210 13878 pending_rounds.cc:107] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:19:57.393440 13878 raft_consensus.cc:2889] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:57.394766 13283 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:57.395790 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.396311 13283 raft_consensus.cc:2376] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6. Re-sending same reply.
I20260709 12:19:57.397125 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.397799 13283 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:57.400568 13283 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:57.401592 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.402539 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.402951 13206 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:57.402634 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.403833 13282 raft_consensus.cc:2410] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:19:57.340380 16077 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:19:57.405647 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.473779 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:57.408532 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.412207 13212 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:57.417551 13100 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:57.476706 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 59234.5us
I20260709 12:19:57.476884 16125 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:57.477530 16125 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.477573 13100 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:57.478039 16125 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:57.308318 13881 rpcz_store.cc:276] 0709 12:19:56.168646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.242870 (+ 74224us) service_pool.cc:224] Handling call
0709 12:19:57.297385 (+1054515us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540047efd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e87853 00007f70f9e5560a 00007f70f33db7d4 00007f70f33db762 00007f70f33db691 00007f70f33db60c 00007f70f33da8c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:57.297524 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422690048}
I20260709 12:19:57.305395 16158 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.493952 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.494293 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:57.480263 13177 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:57.481757 13212 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:57.473798 13207 raft_consensus.cc:3055] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:57.497500 13207 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:57.491418 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.502187 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.502604 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:57.503487 13887 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:57.503803 13177 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:57.405261 16073 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.504976 13878 raft_consensus.cc:2393] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:57.380131 16128 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.509152 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.505435 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.510188 13212 raft_consensus.cc:2393] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:57.506505 13285 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:19:57.499924 13282 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 2.
I20260709 12:19:57.485754 15636 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:57.511076 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.511880 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.548929 13879 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:57.549525 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.513702 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:57.513773 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:57.514354 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:57.513919 16071 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.515003 13207 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.515810 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.517087 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.554713 13212 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:57.518182 13878 raft_consensus.cc:2393] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:57.518839 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:19:57.553077 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.473513 15891 consensus_queue.cc:1059] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:19:57.520149 13885 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:19:57.520409 16004 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:57.520841 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.558795 13887 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:57.527506 16063 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:57.381392 16116 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.563061 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:57.531546 16067 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:57.533094 16053 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:57.534682 13102 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:57.535277 16214 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:57.349805 15554 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.610386 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:57.537398 16073 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.407717 15935 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.485548 16045 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:57.545274 16190 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:57.546275 16128 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:57.548367 13283 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:57.555480 13204 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:57.557047 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.561415 13177 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:57.605381 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:57.610627 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:57.585196 16063 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.612648 13278 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:57.612689 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.641296 13212 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:19:57.622025 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.628032 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:57.554432 15636 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.630229 13286 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:57.638916 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:57.611675 13135 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:57.635496 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 74184.5us
I20260709 12:19:57.610440 15852 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:57.557905 16030 consensus_queue.cc:1059] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:19:57.642213 13887 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:57.644912 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.659021 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.628715 15962 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.560508 16068 consensus_queue.cc:1059] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:19:57.637313 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.646344 13878 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:57.643239 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.648718 13130 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:57.610365 16046 consensus_queue.cc:1059] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:19:57.643546 15554 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:57.649030 16190 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:57.663288 13212 raft_consensus.cc:2410] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:19:57.664588 13278 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:19:57.643718 16063 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:57.672554 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.693825 13885 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:19:57.673358 13137 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:57.653880 16213 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:57.677050 13887 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:57.629310 15891 consensus_queue.cc:1243] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:19:57.675125 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:57.745151 13878 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:57.644932 13177 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:57.681595 13838 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:57.746770 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 65265.3us
I20260709 12:19:57.679160 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:57.649410 15636 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:57.673895 16161 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.691954 16169 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.649894 15852 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:57.700776 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:57.746784 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 101929us
I20260709 12:19:57.750201 13130 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:19:57.700843 13212 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:57.610849 16093 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.643023 16115 consensus_queue.cc:1059] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:19:57.759210 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:57.673516 16052 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:19:57.760425 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.815703 13887 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:57.747153 16130 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:57.776059 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:57.699620 16045 raft_consensus.cc:3055] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:57.759531 16189 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:57.758765 16004 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:57.800422 13878 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:19:57.816998 13212 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
W20260709 12:19:57.754575 16117 consensus_meta.cc:287] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.602s	user 0.003s	sys 0.007s
I20260709 12:19:57.818413 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:57.744361 16190 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:57.829146 13212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:57.831990 13880 raft_consensus.cc:1240] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:57.832062 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:57.832767 13137 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:57.778455 15852 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:57.833642 13212 raft_consensus.cc:606] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:57.775166 16213 raft_consensus.cc:697] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:57.836501 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:57.826875 15995 consensus_meta.cc:287] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 12:19:57.673486 15962 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:57.815817 16053 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:57.818056 16045 raft_consensus.cc:740] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:57.851413 13212 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:57.796381 16046 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:19:57.854880 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:57.855074 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:57.773694 16161 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.777930 16169 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.853645 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:57.840201 16189 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:57.873821 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:57.875488 13212 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:57.877352 13212 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:57.879070 13885 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:57.845382 16214 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:19:57.881955 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 347308us
I20260709 12:19:57.883477 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:57.887137 16211 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:19:57.906975 13102 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:57.827819 16125 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.849298 16158 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:57.852391 16164 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:57.826223 16052 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.857700 16068 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:57.833364 16117 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.927568 13878 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:19:57.925678 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:57.936551 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:57.943380 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:19:57.946038 16219 log.cc:927] Time spent T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 12:19:57.946156 16221 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:19:57.945676 16068 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.948055 16068 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:57.949424 13133 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:19:57.951440 16213 consensus_queue.cc:237] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.952467 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:57.953033 13285 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:19:57.953136 16119 raft_consensus.cc:3055] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:57.953642 16119 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:57.954403 16119 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.959990 16189 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.939350 16190 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:57.942047 16073 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:57.939675 16116 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:57.963819 16045 consensus_queue.cc:260] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.965885 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:57.853942 15995 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:57.970716 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:57.971599 13137 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
W20260709 12:19:57.926606 16223 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:19:58.000152 13135 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
W20260709 12:19:58.000775 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.014313 13285 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 4.
I20260709 12:19:58.014706 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:58.019841 16052 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:58.016075 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:58.022946 13177 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:58.023844 16046 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:58.024396 16046 raft_consensus.cc:697] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:58.018532 15554 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:58.025470 15554 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.025307 16046 consensus_queue.cc:237] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.025899 15554 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:58.025985 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 510) took 2765 ms. Trace:
I20260709 12:19:58.030103 16245 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:58.030159 15807 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:58.030865 15807 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.013638 16230 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:19:58.029214 13128 rpcz_store.cc:276] 0709 12:19:55.260518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.263482 (+  2964us) service_pool.cc:224] Handling call
0709 12:19:55.430698 (+167216us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:55.569093 (+138395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:55.570910 (+  1817us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:57.050634 (+1479724us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b2c00000c88. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:19:57.051398 (+   764us) log.cc:844] Serialized 78 byte log entry
0709 12:19:57.226421 (+175023us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:57.229845 (+  3424us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b18003594a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:19:57.604967 (+375122us) log.cc:844] Serialized 14 byte log entry
0709 12:19:57.964362 (+359395us) log.cc:844] Serialized 14 byte log entry
0709 12:19:58.025603 (+ 61241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.025697 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:58.025744 (+    47us) raft_consensus.cc:1685] finished
0709 12:19:58.025760 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.025902 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125557,"prepare.queue_time_us":477554,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":174905,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":15438,"spinlock_wait_cycles":25798272,"thread_start_us":723564,"threads_started":3,"wal-append.queue_time_us":244763}
I20260709 12:19:58.033830 13279 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:58.034951 16117 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:58.035950 13128 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:58.037014 15995 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:57.858112 16053 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.042992 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:58.043164 13208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:19:58.043797 13208 raft_consensus.cc:606] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:19:58.044171 13208 raft_consensus.cc:614] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:58.046976 13885 raft_consensus.cc:2368] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9.
I20260709 12:19:58.048426 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:58.049734 13132 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:58.080277 13135 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:58.002560 16045 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:58.001395 16125 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:58.108192 13208 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:19:58.116021 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 321248us
W20260709 12:19:58.121502 13252 leader_election.cc:336] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.830s (SENT)
I20260709 12:19:58.133064 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:58.135303 13103 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:58.149361 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:58.154582 16164 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:58.155136 16164 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.155642 15852 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.157241 16164 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:58.157424 16169 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:58.157594 15852 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:58.185817 13249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.012s	sys 0.021s
W20260709 12:19:58.186245 13249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.012s	sys 0.021s
W20260709 12:19:58.186538 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 631260us
I20260709 12:19:57.927618 16214 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.193650 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:58.196285 13135 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:58.196887 13103 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:58.199676 13103 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:58.196455 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:58.142832 16073 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:58.142912 16092 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:58.151312 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:58.203651 13103 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:58.206570 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:58.202677 13210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1463) took 1525 ms (client timeout 1830 ms). Trace:
I20260709 12:19:58.221177 13129 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
W20260709 12:19:58.221130 13210 rpcz_store.cc:269] 0709 12:19:56.677434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.756162 (+ 78728us) service_pool.cc:224] Handling call
0709 12:19:58.202490 (+1446328us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b54001c4654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:58.202619 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89937664}
I20260709 12:19:58.225108 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:58.232365 13135 raft_consensus.cc:2393] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:58.202383 16235 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:58.197980 16245 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:58.202028 16172 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:58.240665 15484 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:58.260366 16235 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:58.268975 15484 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:58.268994 16235 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.269814 16235 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:58.223325 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:58.211115 15962 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:58.233186 16125 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:58.202217 16230 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:19:58.216429 16091 consensus_queue.cc:1059] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:19:58.257293 13882 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:19:58.256341 16053 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:58.225466 16158 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:58.240880 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:58.285881 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 72162.5us
I20260709 12:19:58.289438 16161 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:58.290184 16222 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
I20260709 12:19:58.290622 16214 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:58.270247 15484 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:58.325577 16227 log.cc:927] Time spent T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:19:58.271278 16172 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.337364 16172 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:19:58.343089 16244 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:19:58.351260 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 63678.9us
I20260709 12:19:58.280544 16125 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:58.365134 13282 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:19:58.365514 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1478) took 1260 ms. Trace:
W20260709 12:19:58.371151 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 137448us
I20260709 12:19:58.371848 13887 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:58.371301 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:58.366312 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:58.370083 16063 consensus_meta.cc:287] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.618s	user 0.003s	sys 0.019s
I20260709 12:19:58.366461 13209 rpcz_store.cc:276] 0709 12:19:57.104936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.474895 (+369959us) service_pool.cc:224] Handling call
0709 12:19:57.498982 (+ 24087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.501487 (+  2505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.501522 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.501985 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:19:57.796947 (+294962us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:19:57.797020 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.797114 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:58.364910 (+567796us) raft_consensus.cc:1685] finished
0709 12:19:58.364968 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.365320 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39936,"raft.queue_time_us":2808,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5402,"thread_start_us":252153,"threads_started":1,"wal-append.queue_time_us":558284}
I20260709 12:19:58.384672 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:58.274559 16245 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.367086 16125 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:58.370518 15636 consensus_meta.cc:287] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.003s
I20260709 12:19:58.404636 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:19:58.388562 15735 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:58.403656 13881 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:58.417933 15554 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.419299 13881 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:19:58.423974 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 60226.7us
I20260709 12:19:58.425856 13249 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:58.428524 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:58.408244 15735 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:58.430454 16232 consensus_queue.cc:1059] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:58.430833 15554 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:58.431313 15735 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.431965 16091 consensus_queue.cc:1059] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:58.432354 15735 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:58.432684 16229 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:58.433413 16237 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:58.435326 16232 raft_consensus.cc:3055] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:58.435715 16232 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:19:58.436376 16241 log.cc:927] Time spent T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:19:58.437160 15891 raft_consensus.cc:3055] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:58.437620 15891 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:58.437795 16091 raft_consensus.cc:3055] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:58.438230 16091 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:58.438357 15891 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.439369 15891 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:58.439147 16091 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.440448 16091 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:58.443771 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.439759 16233 log.cc:927] Time spent T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:19:58.407588 16158 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:58.445076 16158 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.423530 16230 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:19:58.448489 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 483) took 1284 ms. Trace:
I20260709 12:19:58.448880 13277 rpcz_store.cc:276] 0709 12:19:57.164474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.164607 (+   133us) service_pool.cc:224] Handling call
0709 12:19:57.164879 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:57.277214 (+112335us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:19:57.503503 (+226289us) log.cc:844] Serialized 14 byte log entry
0709 12:19:58.189510 (+686007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:58.189569 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:58.189620 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.448266 (+258646us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001ad1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:58.448307 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.448421 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11300,"prepare.queue_time_us":377473,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":127579,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"spinlock_wait_cycles":257819392,"thread_start_us":900208,"threads_started":3,"wal-append.queue_time_us":463001}
I20260709 12:19:58.436600 16232 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.452819 15999 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:58.452935 16232 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:58.457796 15999 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:58.458246 16073 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:58.459179 16238 consensus_queue.cc:1059] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:19:58.461828 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.397101 16063 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.406688 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:58.465204 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.466281 13841 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:58.473345 13841 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:58.476192 13841 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:58.423880 16071 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:58.479504 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.478430 13841 leader_election.cc:400] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5.
I20260709 12:19:58.480067 13841 leader_election.cc:403] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:19:58.405766 15636 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.495718 13841 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:19:58.475694 16128 consensus_meta.cc:287] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.836s	user 0.009s	sys 0.005s
W20260709 12:19:58.472240 16226 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:19:58.502694 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:58.505466 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:58.507259 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:58.509063 13249 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:58.477463 16161 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:58.510680 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:58.481084 16169 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:58.480927 16071 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.493883 15995 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:58.478328 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:58.500067 16052 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 4. Current term is 5.
I20260709 12:19:58.524111 16242 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:58.536406 16249 log.cc:927] Time spent T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:19:58.540184 16242 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:58.537201 16252 log.cc:927] Time spent T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:19:58.540890 16242 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.539279 16091 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:58.528427 16071 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:58.499223 16235 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.556704 13129 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:58.557847 16235 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:58.511984 16068 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:58.561234 16104 raft_consensus.cc:1064] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:19:58.511061 16149 raft_consensus.cc:2764] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:19:58.563838 15636 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:58.526710 16169 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.565433 16169 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:58.504585 15962 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:19:58.573447 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.527532 16128 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:58.543252 16242 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:58.527118 16229 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:19:58.506213 16238 consensus_queue.cc:1059] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:19:58.588562 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:58.588553 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:58.581087 13175 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:58.592594 13135 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 4: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:58.571651 15962 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:58.607797 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1480) took 1502 ms. Trace:
I20260709 12:19:58.609238 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:58.582448 16172 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:58.606892 16046 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:58.610687 16137 raft_consensus.cc:3055] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:58.573092 16091 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:19:58.608265 13205 rpcz_store.cc:276] 0709 12:19:57.105488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.472753 (+367265us) service_pool.cc:224] Handling call
0709 12:19:57.497162 (+ 24409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.497536 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.497570 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.503515 (+  5945us) log.cc:844] Serialized 26 byte log entry
0709 12:19:57.756701 (+253186us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:57.756759 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.756852 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:58.607554 (+850702us) raft_consensus.cc:1685] finished
0709 12:19:58.607576 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.607732 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":378,"raft.queue_time_us":1136,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2222,"thread_start_us":219404,"threads_started":1,"wal-append.queue_time_us":618849}
I20260709 12:19:58.639498 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:58.633738 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 138101us
I20260709 12:19:58.599649 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:58.599314 16128 raft_consensus.cc:697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:58.640827 13134 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:19:58.643743 13134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 527) took 1031 ms. Trace:
I20260709 12:19:58.644320 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:58.644102 13134 rpcz_store.cc:276] 0709 12:19:57.612569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.655570 (+ 43001us) service_pool.cc:224] Handling call
0709 12:19:58.639367 (+983797us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b5800001298. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68eee 000000000036eb39 00007f70f9ddc1e0 00007f70f9ea50c4 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:19:58.643683 (+  4316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14507136}
W20260709 12:19:58.641119 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 130538us
I20260709 12:19:58.645434 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:58.647881 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:58.660477 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:58.661475 13284 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:58.636437 16137 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:58.637974 15995 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:58.652340 16245 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:19:58.673966 16255 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:19:58.674089 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:58.698598 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 65587.7us
I20260709 12:19:58.637527 16172 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.651813 16262 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:58.652165 16161 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:19:58.648361 16052 consensus_queue.cc:1059] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 12:19:58.712608 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 48348.2us
I20260709 12:19:58.711740 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:58.717778 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:19:58.699138 16242 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:58.703605 16063 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:58.677656 15995 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.730348 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 485) took 1565 ms. Trace:
I20260709 12:19:58.731312 13286 rpcz_store.cc:276] 0709 12:19:57.165066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.165165 (+    99us) service_pool.cc:224] Handling call
0709 12:19:57.176820 (+ 11655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:57.643895 (+467075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.730124 (+1086229us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54000e6354. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:58.730292 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042073856}
I20260709 12:19:58.712172 16046 raft_consensus.cc:697] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:58.732883 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:58.736908 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:58.733548 13886 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
W20260709 12:19:58.749788 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.716445 16238 consensus_queue.cc:1059] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 12:19:58.755566 16254 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:19:58.756289 16238 raft_consensus.cc:3055] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:19:58.756568 16267 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:19:58.756839 16238 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:58.757725 16271 consensus_queue.cc:1059] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:19:58.757943 16238 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:58.760203 16259 log.cc:927] Time spent T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:19:58.762840 16149 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:58.763623 16149 raft_consensus.cc:697] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:58.764914 16149 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:19:58.768265 16068 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.768862 16068 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.771096 16068 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:58.771713 16093 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.772569 16093 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.774674 16093 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:19:58.769037 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 68342.2us
I20260709 12:19:58.775748 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:58.777751 13879 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:19:58.780326 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 43530.6us
I20260709 12:19:58.781487 13249 leader_election.cc:400] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9.
I20260709 12:19:58.781864 13249 leader_election.cc:403] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:19:58.786996 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.798391 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:58.678812 15962 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:58.800793 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 125906us
I20260709 12:19:58.804142 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:58.789732 13133 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 522) took 1281 ms (client timeout 1627 ms). Trace:
W20260709 12:19:58.805603 13133 rpcz_store.cc:269] 0709 12:19:57.508054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.508216 (+   162us) service_pool.cc:224] Handling call
0709 12:19:58.789521 (+1281305us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54003cf5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:58.789648 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916069248}
I20260709 12:19:58.812415 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:58.702020 16128 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.725737 16117 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 12:19:58.801553 16092 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:58.816511 13175 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:58.805524 16238 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:58.805608 16093 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:58.800256 16263 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:58.819981 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 90159.9us
I20260709 12:19:58.819235 15852 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.717860 16137 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.778656 15735 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:19:58.823290 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:58.823558 16046 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.811167 16063 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:58.813776 16264 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:58.830818 13175 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:58.825557 15995 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:58.834224 13133 raft_consensus.cc:2393] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:19:58.819262 15962 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:19:58.836576 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.838914 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:58.826054 16093 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.860946 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:58.832908 16262 raft_consensus.cc:697] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:58.863152 13137 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:19:58.829145 16269 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:58.862159 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 523) took 1315 ms. Trace:
I20260709 12:19:58.910972 16093 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:58.939563 13130 rpcz_store.cc:276] 0709 12:19:57.547222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.547528 (+   306us) service_pool.cc:224] Handling call
0709 12:19:58.861980 (+1314452us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b54001f40d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:58.862100 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35393792}
W20260709 12:19:58.844080 16261 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:19:58.942714 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.946892 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.854539 16080 raft_consensus.cc:3055] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:58.834997 15852 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.839989 16270 raft_consensus.cc:2764] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:19:58.951011 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:58.839749 16264 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.954064 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:58.865289 15735 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.955029 13133 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 3.
I20260709 12:19:58.957190 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 553) took 1687 ms. Trace:
I20260709 12:19:58.937321 16232 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:58.838342 16045 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:58.944517 15995 raft_consensus.cc:3055] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:19:58.948751 16258 log.cc:927] Time spent T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:19:58.908565 16275 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.982424 13130 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:19:58.853185 16125 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:58.969450 13212 rpcz_store.cc:276] 0709 12:19:57.269948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.878201 (+608253us) service_pool.cc:224] Handling call
0709 12:19:57.878516 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.039669 (+161153us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:58.281080 (+241411us) log.cc:844] Serialized 14 byte log entry
0709 12:19:58.411884 (+130804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:58.411937 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:58.411981 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.956862 (+544881us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540032c8d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:58.956943 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.957114 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":162185,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":3689,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6320,"spinlock_wait_cycles":370065152,"thread_start_us":371441,"threads_started":2,"wal-append.queue_time_us":218815}
W20260709 12:19:58.988332 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.952569 16063 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:58.950294 16080 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:58.968768 16264 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:59.059119 13283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2651) took 1657 ms (client timeout 1978 ms). Trace:
I20260709 12:19:58.945153 16169 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:58.981429 15995 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:59.061143 13283 rpcz_store.cc:269] 0709 12:19:57.401216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.402395 (+  1179us) service_pool.cc:224] Handling call
0709 12:19:59.058903 (+1656508us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540023cb54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:59.059058 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331667328}
I20260709 12:19:58.840824 16104 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.050243 16172 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:58.983708 15735 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.078789 15735 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:59.085731 15995 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.087035 15995 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:58.967344 16273 consensus_queue.cc:1059] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.117s
W20260709 12:19:59.088357 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 268647us
I20260709 12:19:59.064116 13135 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:59.067982 16080 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:59.072153 15807 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:59.092460 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:19:59.092949 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 254102us
I20260709 12:19:59.093389 13285 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 4: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:59.093477 13130 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:19:59.076383 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 521) took 1576 ms. Trace:
I20260709 12:19:59.052520 16275 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.090801 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 495) took 1545 ms. Trace:
I20260709 12:19:59.099399 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:59.100449 13285 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:59.099160 13284 rpcz_store.cc:276] 0709 12:19:57.545550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.021614 (+476064us) service_pool.cc:224] Handling call
0709 12:19:58.021906 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.661982 (+640076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.090583 (+428601us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54002503d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:59.090742 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464103680}
I20260709 12:19:59.090940 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:59.102785 13280 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:19:59.092360 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:58.981320 16232 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:59.105463 13100 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:59.095615 13131 rpcz_store.cc:276] 0709 12:19:57.500433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.500916 (+   483us) service_pool.cc:224] Handling call
0709 12:19:57.501198 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.497980 (+996782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:58.498027 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:58.498085 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:58.498123 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.076154 (+578031us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b54002b5054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:59.076201 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:59.076323 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291699968}
I20260709 12:19:59.108301 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:59.108964 13212 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:19:59.109311 13283 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:59.111013 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1475) took 2057 ms. Trace:
I20260709 12:19:59.111364 13102 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:59.111410 13206 rpcz_store.cc:276] 0709 12:19:57.053589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.382577 (+328988us) service_pool.cc:224] Handling call
0709 12:19:57.402735 (+ 20158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.405373 (+  2638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.110828 (+1705455us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b540041cdd0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:59.110958 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36433792}
I20260709 12:19:59.112498 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:19:59.115537 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.116515 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:59.118232 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:59.118628 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:59.166533 13206 raft_consensus.cc:2410] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:19:59.104043 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:59.119388 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:59.119622 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:59.167788 13212 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:59.167981 13883 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:59.120373 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:59.168789 13885 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:19:59.169622 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:59.120672 13210 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:59.121533 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:19:59.170884 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49428.5us
I20260709 12:19:59.118954 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:59.113049 16278 consensus_queue.cc:1059] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:19:59.129355 16232 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:59.130399 16263 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9.
I20260709 12:19:59.131256 16073 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:59.131793 16162 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:59.138413 16275 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:59.138636 16269 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:59.123188 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:19:59.167654 16229 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:59.139919 16125 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:59.140632 13838 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:19:59.145129 16093 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:59.154155 16071 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.002s
I20260709 12:19:59.155226 15852 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:59.157076 16169 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:59.157608 16080 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:59.061106 16262 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.163684 16235 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:59.164016 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:19:59.164429 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 53161.3us
I20260709 12:19:59.163726 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:59.172744 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:19:59.176662 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 72712.7us
I20260709 12:19:59.177206 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:59.122481 15807 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:19:59.362728 13878 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:59.286314 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:59.363584 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 240603us
I20260709 12:19:59.306173 13102 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:19:59.361653 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.260519 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:59.368042 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:59.364799 13886 raft_consensus.cc:2376] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5. Re-sending same reply.
W20260709 12:19:59.368729 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.371063 13283 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:59.371934 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:59.373214 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:59.373826 13205 raft_consensus.cc:2410] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:19:59.220526 13207 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:59.372532 13177 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:19:59.373852 13283 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:59.203293 13881 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:19:59.374760 16282 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:59.375641 13838 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:59.375835 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:59.212071 13882 raft_consensus.cc:2393] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:19:59.182648 15735 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:59.378274 13277 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:19:59.175410 16121 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.206s
I20260709 12:19:59.382920 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:59.375115 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:59.429461 13278 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:19:59.406167 13286 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 12:19:59.417505 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.382751 13841 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:19:59.362550 16067 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:59.419348 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 113295us
I20260709 12:19:59.433252 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:59.185619 16280 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:59.374835 15807 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:59.407882 16169 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:19:59.436674 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 53874.3us
I20260709 12:19:59.444670 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:19:59.437140 16282 raft_consensus.cc:697] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:59.437484 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:59.437975 16277 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:59.381632 16229 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:19:59.438251 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 55642.2us
I20260709 12:19:59.407757 16272 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:59.176900 15484 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.231s
I20260709 12:19:59.437175 16046 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:59.177428 16264 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.446720 13102 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:59.185923 16273 consensus_queue.cc:1059] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.246s
I20260709 12:19:59.405797 16278 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:59.470808 16264 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:59.470950 16278 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.471575 16278 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:59.475410 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:59.476514 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 696) took 1119 ms. Trace:
I20260709 12:19:59.476943 13884 rpcz_store.cc:276] 0709 12:19:58.357517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.475019 (+1117502us) service_pool.cc:224] Handling call
0709 12:19:59.476438 (+  1419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:59.418238 15735 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.478235 15735 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:59.479585 16046 raft_consensus.cc:697] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:59.480150 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 487) took 2314 ms. Trace:
I20260709 12:19:59.480460 13132 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:59.480582 16046 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.482487 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1264) took 1823 ms. Trace:
I20260709 12:19:59.482601 16280 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:59.483178 16280 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:59.484078 16119 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:59.485484 16280 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:59.450888 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:59.489347 16128 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:59.489470 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:59.489815 16128 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:59.490690 16128 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.493580 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:19:59.469089 16281 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 12:19:59.471755 13284 raft_consensus.cc:2368] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5.
I20260709 12:19:59.452584 13283 raft_consensus.cc:2410] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:19:59.482949 13137 rpcz_store.cc:276] 0709 12:19:57.671301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.010943 (+339642us) service_pool.cc:224] Handling call
0709 12:19:58.862924 (+851981us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:58.938448 (+ 75524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.482276 (+543828us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54001f40d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:19:59.482422 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958263040}
I20260709 12:19:59.492193 13211 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:59.369814 16071 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.492283 13131 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:59.534763 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:59.491108 13210 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:59.535665 13283 raft_consensus.cc:2393] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:59.536033 13211 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:59.536705 16278 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.537669 16277 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:59.538938 16278 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:59.444340 16169 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:19:59.539635 16169 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:59.540068 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:19:59.494472 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:59.489375 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:19:59.544221 13206 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:59.439268 16067 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.523147 13212 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:19:59.454807 15852 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:59.530761 13277 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:59.533085 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:59.557520 13132 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:59.480594 13279 rpcz_store.cc:276] 0709 12:19:57.165592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.165717 (+   125us) service_pool.cc:224] Handling call
0709 12:19:57.165978 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.034231 (+868253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.479910 (+1445679us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54004097d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:59.480088 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995436800}
W20260709 12:19:59.558482 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.505606 15995 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:59.548911 13207 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:19:59.456578 16272 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:59.554723 13841 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:59.565591 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:59.563050 13279 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:59.451731 13878 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:19:59.530211 16293 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.492414 16211 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:59.564985 13207 pending_rounds.cc:85] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 5
I20260709 12:19:59.529466 16030 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:19:59.570551 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 397469us
I20260709 12:19:59.570827 13207 pending_rounds.cc:107] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:19:59.532874 16235 raft_consensus.cc:697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:59.622756 13207 raft_consensus.cc:2889] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:59.561522 16121 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:59.624137 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1479) took 2518 ms. Trace:
I20260709 12:19:59.628940 13207 rpcz_store.cc:276] 0709 12:19:57.105237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.473259 (+368022us) service_pool.cc:224] Handling call
0709 12:19:57.473629 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.217940 (+1744311us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400103c20. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e02a1d 00007f70f4de91a4 00007f70f4e6b447 00007f70f4e83fe7 00007f70f4e857de 00007f70f4e8fb49 00007f70f4e90416 00007f70f4e8cd8f 00007f70f4e8c83e 00007f70f9e51419
0709 12:19:59.623855 (+405915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.624077 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260918016}
W20260709 12:19:59.631313 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 255735us
I20260709 12:19:59.634539 13838 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:19:59.570822 16117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.006s	sys 0.028s
I20260709 12:19:59.569063 16272 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:59.641927 13887 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 5 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:19:59.643086 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:59.569526 15852 raft_consensus.cc:697] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:19:59.645512 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:59.623767 16045 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:59.668243 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 221617us
I20260709 12:19:59.671137 13886 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:59.626917 16270 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.673187 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:59.680809 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:59.681139 13887 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:59.572180 16292 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:59.625397 16275 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:59.670662 13100 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:59.646628 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:59.676878 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.562680 16128 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:59.687558 13136 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:59.700197 13279 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:59.703464 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:19:59.704056 13883 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:59.706171 13206 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
W20260709 12:19:59.669575 16117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.006s	sys 0.028s
I20260709 12:19:59.671623 15995 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:59.717577 15962 consensus_queue.cc:1059] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:59.719910 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:59.721122 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:59.722133 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:59.722963 13279 raft_consensus.cc:2410] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:19:59.725771 16299 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:59.727568 16292 consensus_queue.cc:1059] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:19:59.728322 16287 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:19:59.743968 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:59.745421 13279 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 4: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:19:59.747094 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:59.749068 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:19:59.709226 13886 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:19:59.692124 16264 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.693073 15999 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.800886 16264 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:59.801043 15999 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:59.582602 16293 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.699795 16238 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.760506 13887 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
W20260709 12:19:59.760514 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 122180us
I20260709 12:19:59.807821 13100 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:59.808892 13100 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:19:59.810531 13100 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:59.761989 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:59.763507 15807 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:59.708623 16093 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:59.765231 16172 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:59.711195 16121 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:59.689035 16045 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.758037 16280 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.765801 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:19:59.708164 16273 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:59.768534 16289 log.cc:927] Time spent T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 12:19:59.772261 13883 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:19:59.623626 16282 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.783561 16298 raft_consensus.cc:3055] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:59.784929 13279 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:19:59.784742 15852 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.786501 16229 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:59.787204 15962 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:59.831082 15807 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:59.948922 15807 raft_consensus.cc:697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:59.950057 15807 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.828495 16238 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:59.952970 16045 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:59.953513 16238 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:59.830864 16172 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:59.693719 16270 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:19:59.800069 16288 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
W20260709 12:19:59.814666 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 52760.4us
I20260709 12:19:59.834729 13887 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:19:59.957147 16172 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:19:59.957705 16172 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:19:59.958175 16172 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:59.803220 15999 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:59.848392 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:59.823949 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:59.959848 13883 raft_consensus.cc:2410] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:19:59.959905 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 136079us
I20260709 12:19:59.961308 13883 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 12:19:59.761584 15995 raft_consensus.cc:697] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:19:59.920756 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:59.831851 16073 consensus_meta.cc:287] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.000s
I20260709 12:19:59.973377 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:19:59.686118 16232 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:19:59.741657 16235 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.830569 16211 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:19:59.934218 16294 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.928309 16298 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:19:59.947573 16071 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:59.948256 16067 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:59.961836 15962 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:19:59.958523 13887 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:19:59.985953 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:19:59.986814 13887 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:19:59.805377 16293 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:19:59.988953 13175 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:59.803244 16264 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:19:59.962128 13205 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:59.963490 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:19:59.972038 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.973893 13279 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:19:59.993448 13279 pending_rounds.cc:85] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 7
I20260709 12:19:59.826131 16119 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:19:59.978333 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 300980us
I20260709 12:19:59.962344 16121 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:59.830722 16169 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.930020 16297 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:59.953603 16045 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.847630 15735 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:19:59.982077 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 605) took 2472 ms. Trace:
I20260709 12:19:59.993700 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:19:59.988684 16305 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.994055 13279 pending_rounds.cc:107] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:20:00.009471 13279 raft_consensus.cc:2889] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:59.993916 16067 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:59.847152 16280 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:19:59.973464 16275 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:19:59.998232 13840 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:59.993408 13883 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:19:59.989440 15962 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:00.004904 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 695) took 1647 ms. Trace:
W20260709 12:20:00.061690 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 63537.5us
I20260709 12:20:00.069546 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:00.070760 13879 rpcz_store.cc:276] 0709 12:19:58.357271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.433838 (+ 76567us) service_pool.cc:224] Handling call
0709 12:19:58.434117 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.778286 (+344169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.004630 (+1226344us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400750b54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:00.004833 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677405440}
I20260709 12:20:00.072409 13885 raft_consensus.cc:2368] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7.
I20260709 12:20:00.072165 13840 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:19:59.854651 16273 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:00.003798 13880 rpcz_store.cc:276] 0709 12:19:57.509775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.515689 (+  5914us) service_pool.cc:224] Handling call
0709 12:19:57.515989 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:57.832605 (+316616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.971639 (+2139034us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540015f4d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:19:59.980173 (+  8534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726225664}
W20260709 12:20:00.060328 16162 consensus_meta.cc:287] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.863s	user 0.009s	sys 0.003s
I20260709 12:19:59.976250 16073 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:00.031183 16119 raft_consensus.cc:697] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:19:59.982335 16294 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:00.070246 15891 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:00.059267 16238 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.998286 16128 consensus_queue.cc:1059] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:20:00.004678 16121 raft_consensus.cc:697] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:00.099628 13204 raft_consensus.cc:2410] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:00.093493 13881 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:00.009050 16045 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:00.110842 16172 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:00.149098 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:00.149940 13205 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:20:00.143954 16275 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:00.144677 16308 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:00.144920 16119 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:00.073141 16298 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:00.147267 15735 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:00.096158 16264 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:20:00.069730 16305 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:00.169605 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.116665 16053 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:00.148337 16080 consensus_meta.cc:287] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.002s
I20260709 12:20:00.136699 15891 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:00.181744 13281 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:00.114632 16277 consensus_queue.cc:1059] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 12:20:00.154336 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 82252.7us
I20260709 12:20:00.072952 15995 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:00.163573 16308 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:00.222800 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 98382.7us
I20260709 12:20:00.229555 13283 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:00.136404 16238 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:00.172412 16172 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.239084 15935 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.178077 16067 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:00.247469 13205 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:00.188789 16128 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:00.241019 16229 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.281561 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:00.284984 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:00.310402 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 63857.6us
I20260709 12:20:00.211411 16316 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.312963 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:00.314339 13883 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:20:00.318527 13129 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:00.314296 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:00.237282 16298 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:00.315374 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:00.314513 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:00.188400 16311 consensus_queue.cc:1059] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 12:20:00.191413 16304 consensus_queue.cc:1059] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.223s
I20260709 12:20:00.224215 16053 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:00.319245 13136 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:00.646941 13839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.021s	sys 0.051s
W20260709 12:20:00.691620 13839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.021s	sys 0.052s
W20260709 12:20:00.668926 13277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 1863) took 1408 ms (client timeout 1660 ms). Trace:
I20260709 12:20:00.277830 16277 consensus_queue.cc:1243] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:00.438877 13203 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:20:00.409997 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.692225 13277 rpcz_store.cc:269] 0709 12:19:59.260830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.437202 (+176372us) service_pool.cc:224] Handling call
0709 12:20:00.668673 (+1231471us) spinlock_profiling.cc:243] Waited 81 ms on lock 0x7b54002da5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:00.668854 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186297216}
W20260709 12:20:00.594496 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 278270us
I20260709 12:20:00.280529 16080 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.319607 13207 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:00.946750 16311 consensus_queue.cc:1243] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:20:00.309476 16272 consensus_meta.cc:287] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
W20260709 12:20:00.651377 16290 log.cc:927] Time spent T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 1.183s	user 0.003s	sys 0.003s
I20260709 12:20:00.555889 16190 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:01.241315 13838 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.889s (SENT) [suppressed 6 similar messages]
W20260709 12:20:00.739706 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.329238 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:00.288656 16172 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:00.849546 16305 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:00.514317 16164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.013s	sys 0.013s
I20260709 12:20:00.299599 15935 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.260329 16080 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:00.650230 16294 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:01.070117 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.984032 13136 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:01.190114 15735 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:01.240090 16243 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.000s	sys 0.017s
W20260709 12:20:01.159147 13885 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 616) took 1514 ms (client timeout 1601 ms). Trace:
I20260709 12:20:01.020378 16247 raft_consensus.cc:3055] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:00.315455 16229 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.160292 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 486) took 3995 ms. Trace:
I20260709 12:20:00.479418 16312 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.772s
W20260709 12:20:01.000439 16073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.021s
I20260709 12:20:00.569010 16067 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.269567 16172 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:00.242297 16308 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:01.253388 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:01.278255 16243 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.000s	sys 0.018s
W20260709 12:20:01.296113 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54821.7us
I20260709 12:20:01.069262 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 701) took 1429 ms. Trace:
W20260709 12:20:00.617765 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 140661us
I20260709 12:20:01.206060 16128 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:00.794296 13884 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.005s	sys 0.009s
W20260709 12:20:00.646607 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 365130us
I20260709 12:20:01.252565 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:01.304087 13203 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:01.303261 13884 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.013s	sys 0.014s
W20260709 12:20:01.257771 13103 connection.cc:256] RPC call timeout handler was delayed by -1.9432733559999633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 12:20:00.479048 16309 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:00.317868 16303 log.cc:927] Time spent T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.387s	user 0.003s	sys 0.016s
W20260709 12:20:00.690788 16320 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:20:01.266079 13206 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
W20260709 12:20:00.819552 16327 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 12:20:01.268088 16164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.285s	user 0.031s	sys 0.029s
I20260709 12:20:01.269963 15935 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:00.479691 16071 consensus_queue.cc:1059] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.770s
I20260709 12:20:01.271986 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:00.310935 16162 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:01.277782 13252 connection.cc:256] RPC call timeout handler was delayed by -1.3693281780001598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 12:20:01.276821 13885 rpcz_store.cc:269] 0709 12:19:59.645150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.645266 (+   116us) service_pool.cc:224] Handling call
0709 12:20:01.158907 (+1513641us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54006928d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:01.159058 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916132096}
I20260709 12:20:01.278308 13281 rpcz_store.cc:276] 0709 12:19:57.165334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.165431 (+    97us) service_pool.cc:224] Handling call
0709 12:19:57.176096 (+ 10665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.211830 (+3035734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.160056 (+948226us) spinlock_profiling.cc:243] Waited 3.01 s on lock 0x7b540029dbd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:01.160237 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6911602560}
I20260709 12:20:00.594219 16280 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:01.282790 13175 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:00.315128 16262 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:00.847757 16238 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:00.514050 16169 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:00.809775 16149 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.408896 16328 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.072302 16045 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:00.715142 16332 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:00.549618 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.259088 15807 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.480428 16292 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.798s
I20260709 12:20:01.182448 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 893) took 1348 ms. Trace:
W20260709 12:20:00.818461 13035 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42070 (request call id 325) took 25706 ms (client timeout 15000 ms). Trace:
W20260709 12:20:01.281481 16271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.523s	user 0.028s	sys 0.015s
I20260709 12:20:01.299700 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:01.287273 16073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.008s	sys 0.022s
W20260709 12:20:01.307297 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.339178 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2696) took 1053 ms. Trace:
I20260709 12:20:01.358737 13206 rpcz_store.cc:276] 0709 12:20:00.285387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.285543 (+   156us) service_pool.cc:224] Handling call
0709 12:20:01.339115 (+1053572us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:01.270448 16190 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:00.559180 15891 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.265668 16272 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:00.315724 16121 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.339531 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 563) took 1799 ms. Trace:
I20260709 12:20:01.361099 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 558) took 2243 ms. Trace:
I20260709 12:20:01.343050 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 702) took 1702 ms. Trace:
I20260709 12:20:01.343076 13207 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:20:01.343941 13252 connection.cc:256] RPC call timeout handler was delayed by -1.3009281780000492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 12:20:01.345942 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 44799.9us
I20260709 12:20:01.289507 16119 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:01.278849 16247 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:01.352757 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:01.346032 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 63330.4us
I20260709 12:20:01.344782 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:01.352275 13887 raft_consensus.cc:3055] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:01.417140 13887 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:01.407311 13206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
W20260709 12:20:01.379624 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 66266.8us
I20260709 12:20:01.297540 16305 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.418247 13206 raft_consensus.cc:606] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:01.418776 13209 rpcz_store.cc:276] 0709 12:19:59.117891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.120117 (+  2226us) service_pool.cc:224] Handling call
0709 12:19:59.158681 (+ 38564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:59.159068 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:59.159101 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:59.159652 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:19:59.454045 (+294393us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:59.454084 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.454147 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:00.243344 (+789197us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:01.360758 (+1117414us) raft_consensus.cc:1685] finished
0709 12:20:01.360788 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.361027 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5552,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":149259008,"thread_start_us":294009,"threads_started":1,"wal-append.queue_time_us":305644}
I20260709 12:20:01.420876 13210 rpcz_store.cc:276] 0709 12:19:59.540512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.540679 (+   167us) service_pool.cc:224] Handling call
0709 12:19:59.540994 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:59.541419 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:59.541464 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:59.542407 (+   943us) log.cc:844] Serialized 26 byte log entry
0709 12:19:59.633587 (+ 91180us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:59.633625 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.633689 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:00.243699 (+610010us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b2400152588. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1c269c4 00007f70f1c24acb 00007f70f1ddfdc9 00007f70f1ddfa55 00007f70f1ddf09d 00007f70f4a1110e 00007f70f4a2888c 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221
0709 12:20:01.339232 (+1095533us) raft_consensus.cc:1685] finished
0709 12:20:01.339252 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.339464 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7181,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6628,"spinlock_wait_cycles":14225792,"thread_start_us":90755,"threads_started":1,"wal-append.queue_time_us":302258}
W20260709 12:20:01.422935 13175 connection.cc:256] RPC call timeout handler was delayed by -1.0963245010000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 12:20:01.424860 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:01.425735 13131 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:01.426369 13203 raft_consensus.cc:2410] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:01.422698 13884 rpcz_store.cc:276] 0709 12:19:59.640586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.640694 (+   108us) service_pool.cc:224] Handling call
0709 12:19:59.670142 (+ 29448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.670391 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:59.975487 (+305096us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.342698 (+1367211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.342768 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:01.342817 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.342886 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.342992 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36841,"prepare.queue_time_us":474948,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":37506,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":92,"thread_start_us":1615083,"threads_started":2}
I20260709 12:20:01.434481 13210 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:20:01.434898 13210 pending_rounds.cc:85] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:20:01.435266 13210 pending_rounds.cc:107] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 12:20:01.325534 16235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.007s	sys 0.022s
W20260709 12:20:01.351091 16271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.593s	user 0.028s	sys 0.015s
I20260709 12:20:00.433214 16316 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:01.406041 13838 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:01.432883 13137 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:20:01.446724 13137 pending_rounds.cc:85] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 2
I20260709 12:20:01.447047 13137 pending_rounds.cc:107] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:20:01.433461 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:01.435670 13210 raft_consensus.cc:2889] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:01.341105 16275 raft_consensus.cc:3055] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:01.439445 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:01.418159 13887 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.447062 13206 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:20:01.447359 13137 raft_consensus.cc:2889] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:01.343159 16304 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:01.464618 16304 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.465261 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:01.465898 13277 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:20:01.346351 16262 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.453037 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:01.484678 13203 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:01.402287 16172 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:01.486402 13203 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:01.336424 16115 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.454962 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:01.336333 16349 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.455824 13211 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:01.461756 13887 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:01.343771 16162 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:01.437688 16119 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.360551 16309 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.463395 16247 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:01.466807 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:01.440038 16128 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:01.345635 16280 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:01.467656 13279 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:01.342506 15935 consensus_queue.cc:1059] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.125s
W20260709 12:20:01.468411 16337 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 12:20:01.468604 16355 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.469594 16277 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:01.518985 16323 log.cc:927] Time spent T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
I20260709 12:20:01.430895 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2673) took 2322 ms. Trace:
I20260709 12:20:01.583922 13280 rpcz_store.cc:276] 0709 12:19:59.108971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.109390 (+   419us) service_pool.cc:224] Handling call
0709 12:19:59.109658 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.109869 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:59.110642 (+   773us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.161022 (+2050380us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18004782a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d23a 00007f70f4e97a2a
0709 12:20:01.430548 (+269526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.430602 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:01.430648 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.430721 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.430836 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":187,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":53913,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":26776832,"thread_start_us":182544,"threads_started":2}
I20260709 12:20:01.476087 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:20:01.438197 16235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.007s	sys 0.022s
I20260709 12:20:01.407811 16238 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:01.466919 16316 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:01.472883 16322 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:20:01.350926 13035 rpcz_store.cc:269] 0709 12:19:35.112058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.113976 (+  1918us) service_pool.cc:224] Handling call
0709 12:20:00.818329 (+25704353us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:53.715962 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:53.756666 (+ 40704us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:53.756717 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:19:53.756736 (+    19us) tablet.cc:662] Decoding operations
0709 12:19:53.795489 (+ 38753us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:53.795576 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:53.795609 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:19:53.895575 (+ 99966us) tablet.cc:701] Row locks acquired
0709 12:19:53.919519 (+ 23944us) write_op.cc:260] PREPARE: finished
0709 12:19:53.919783 (+   264us) write_op.cc:270] Start()
0709 12:19:53.919988 (+   205us) write_op.cc:276] Timestamp: P: 1783599593919690 usec, L: 0
0709 12:19:53.920020 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:19:53.920987 (+   967us) log.cc:844] Serialized 3214 byte log entry
0709 12:19:54.944273 (+1023286us) op_driver.cc:464] REPLICATION: finished
0709 12:19:56.225826 (+1281553us) write_op.cc:301] APPLY: starting
0709 12:19:56.225955 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:56.226213 (+   258us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:56.226358 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:56.243356 (+ 16998us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:56.281790 (+ 38434us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:19:56.281864 (+    74us) write_op.cc:312] APPLY: finished
0709 12:19:56.282262 (+   398us) log.cc:844] Serialized 65 byte log entry
0709 12:19:56.365038 (+ 82776us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:56.365216 (+   178us) write_op.cc:454] Released schema lock
0709 12:19:56.365312 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:56.391897 (+ 26585us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:56.398474 (+  6577us) write_op.cc:454] Released schema lock
0709 12:19:56.952307 (+553833us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b54003633d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8a32a 00007f70f4e0ff14 00007f70f4e0fec3 00007f70f4e0fe38 00007f70f4e0fdf3 00007f70f4e0f0dc 00007f70f4e38e16 00007f70f4e20cbb 00007f70f4e0b39d 00007f70f4e0ed75
Metrics: {"mutex_wait_us":6414,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":1281105,"apply.run_cpu_time_us":30194,"apply.run_wall_time_us":140236,"num_ops":8,"prepare.queue_time_us":131371,"prepare.run_cpu_time_us":27532,"prepare.run_wall_time_us":421173,"raft.queue_time_us":521039,"raft.run_cpu_time_us":53716,"raft.run_wall_time_us":2029278,"replication_time_us":1023980,"spinlock_wait_cycles":6424960,"thread_start_us":1110609,"threads_started":5,"wal-append.queue_time_us":523391,"wal-append.run_cpu_time_us":41393,"wal-append.run_wall_time_us":2532348}]]}
I20260709 12:20:01.471987 16292 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:01.350149 15807 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.456889 16275 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:01.347173 16149 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:01.774501 13103 connection.cc:256] RPC call timeout handler was delayed by -1.171090427000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 12:20:01.484113 16169 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:01.471911 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 65988us
I20260709 12:20:01.740067 16354 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:01.578735 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 65191.3us
I20260709 12:20:01.581166 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:01.782100 13206 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:01.511683 16071 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.431689 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:01.587118 13884 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:01.348022 16332 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.513685 13882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 703) took 1860 ms. Trace:
W20260709 12:20:01.552914 16342 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:20:01.446038 16305 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.347451 16328 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.724113 13203 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:20:01.592555 16277 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:01.785081 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 353450us
I20260709 12:20:01.776204 16243 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.826311 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:01.827139 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1864) took 2558 ms. Trace:
I20260709 12:20:01.770390 16229 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:01.635154 13207 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:01.500806 16115 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:01.699100 16269 raft_consensus.cc:993] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
W20260709 12:20:01.700393 16286 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 2.240s	user 0.012s	sys 0.014s
W20260709 12:20:01.748782 15962 consensus_meta.cc:287] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.670s	user 0.013s	sys 0.002s
I20260709 12:20:01.836032 13252 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:01.513343 16349 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.750058 16363 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.750735 16372 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:01.750926 16369 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 12:20:01.751842 16338 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:20:01.752324 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1279) took 3018 ms. Trace:
I20260709 12:20:01.755090 16190 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:01.756510 16294 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:01.635697 16371 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:01.758421 16364 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.758642 16262 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:01.759855 16128 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.760792 16278 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:01.559176 16280 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.761396 16335 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.761781 16272 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:01.579370 16355 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.762612 16030 raft_consensus.cc:3055] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:01.955453 16330 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:01.955703 16030 raft_consensus.cc:740] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:01.680500 16316 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.602450 16080 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:01.629522 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:01.891645 16229 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:01.730043 16271 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.771962 16292 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:01.959807 16030 consensus_queue.cc:260] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.967104 16030 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:01.967192 16292 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.968413 16292 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:01.970521 16308 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.000s
I20260709 12:20:01.971675 15807 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:01.736972 15935 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.955192 16149 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:01.778371 13838 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:01.783078 13102 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:01.776772 13103 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:01.936025 13133 rpcz_store.cc:276] 0709 12:19:58.733602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.969228 (+235626us) service_pool.cc:224] Handling call
0709 12:19:58.991140 (+ 21912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.991381 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:59.114237 (+122856us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.751812 (+2637575us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180004d8c0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f4a354bc 00007f70f1d8348b 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9d455 00007f70f4e85060 00007f70f4e97716 00007f70f4ea8287
0709 12:20:01.751944 (+   132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.752001 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:01.752053 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.752127 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.752265 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9269,"prepare.queue_time_us":184539,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":106259,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5885,"spinlock_wait_cycles":26400512,"thread_start_us":500909,"threads_started":3,"wal-append.queue_time_us":420170,"wal-append.run_cpu_time_us":1883,"wal-append.run_wall_time_us":1183833}
W20260709 12:20:02.162012 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 378863us
I20260709 12:20:02.164057 15807 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:01.786612 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:01.852319 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:02.180045 13203 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
W20260709 12:20:02.181243 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 394608us
I20260709 12:20:02.181998 13203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
W20260709 12:20:01.877601 13204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2692) took 4199 ms (client timeout 1769 ms). Trace:
I20260709 12:20:02.183951 16272 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:20:02.183897 13204 rpcz_store.cc:269] 0709 12:19:57.663596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.671052 (+  7456us) service_pool.cc:224] Handling call
0709 12:20:01.841790 (+4170738us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b54000b6654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:01.862524 (+ 20734us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5349308672}
I20260709 12:20:02.186965 13204 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:01.869828 13206 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:20:01.909947 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:02.192200 13210 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:20:02.193269 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 414884us
I20260709 12:20:01.954000 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2700) took 1570 ms. Trace:
I20260709 12:20:02.195803 13211 rpcz_store.cc:276] 0709 12:20:00.383461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.383644 (+   183us) service_pool.cc:224] Handling call
0709 12:20:00.384081 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.500300 (+1116219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.953698 (+453398us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002d4954. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:01.953924 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2464097024}
I20260709 12:20:02.196676 13279 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:20:02.199859 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:01.898981 13212 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.012s	sys 0.001s
W20260709 12:20:02.200563 13212 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.012s	sys 0.006s
I20260709 12:20:02.201659 16368 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:20:01.864351 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:01.856150 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:02.204473 13284 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2674) took 3094 ms (client timeout 1604 ms). Trace:
I20260709 12:20:02.205346 16272 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:20:01.885303 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 148979us
I20260709 12:20:01.570761 13887 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:01.869828 13884 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:02.237685 13206 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:20:02.239007 16189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.149s	user 0.032s	sys 0.120s
I20260709 12:20:01.827602 13283 rpcz_store.cc:276] 0709 12:19:59.261120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.536282 (+275162us) service_pool.cc:224] Handling call
0709 12:19:59.536553 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.236311 (+699758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.819108 (+1582797us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54000979d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:01.819387 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592594816}
I20260709 12:20:01.955090 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 708) took 1717 ms. Trace:
W20260709 12:20:02.114979 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.256779 13879 rpcz_store.cc:276] 0709 12:20:00.237764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.237976 (+   212us) service_pool.cc:224] Handling call
0709 12:20:01.066724 (+828748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:01.067252 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.067302 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:01.070849 (+  3547us) log.cc:844] Serialized 556 byte log entry
0709 12:20:01.071025 (+   176us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:01.071070 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.071154 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:01.339578 (+268424us) raft_consensus.cc:1685] finished
0709 12:20:01.339598 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.953087 (+613489us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54009501d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:01.954983 (+  1896us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904310016}
I20260709 12:20:02.257951 16092 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.258752 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:01.886096 15962 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.262483 16262 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:02.134418 15935 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:02.142452 13130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 534) took 3025 ms (client timeout 1889 ms). Trace:
I20260709 12:20:01.791016 16071 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:02.278374 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:01.761399 16119 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:01.751264 16164 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.280467 16164 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.281314 15935 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:01.785334 16169 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.282601 16293 raft_consensus.cc:3055] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:02.283200 16293 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:01.493047 16172 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.284561 16169 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.284822 16172 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:02.285392 16169 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.286193 16169 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.286625 16295 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.635190 16238 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:01.840016 16243 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:01.599638 16247 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:02.021512 16270 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:01.980409 16271 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.284905 16293 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.316238 16071 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:01.822166 16275 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.967293 16277 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:01.952548 16278 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.949395 16294 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:02.325941 16238 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:01.961511 16304 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:01.970950 16308 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.809233 16309 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:01.960462 16298 consensus_meta.cc:287] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.002s
I20260709 12:20:01.962929 16316 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.947503 16328 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:01.956167 16330 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:01.960248 16332 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:01.959955 16335 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.408411 16312 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.409334 16312 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:01.297366 13878 rpcz_store.cc:276] 0709 12:19:59.640268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.640387 (+   119us) service_pool.cc:224] Handling call
0709 12:19:59.685108 (+ 44721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.685372 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:59.960610 (+275238us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.059162 (+1098552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.059231 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:01.066428 (+  7197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.066556 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.069174 (+  2618us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47045,"prepare.queue_time_us":460215,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":968587,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":11788,"thread_start_us":952732,"threads_started":3,"wal-append.queue_time_us":543412}
W20260709 12:20:01.790802 16341 log.cc:927] Time spent T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:20:01.861508 16348 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:20:02.411442 16335 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:01.782214 16339 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.943034 16349 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:01.808424 16350 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 12:20:01.961786 16355 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.418294 16291 raft_consensus.cc:3055] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:02.418519 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.418924 16291 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:01.964600 16356 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 12:20:01.943019 16359 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:01.933936 16363 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:01.843910 16366 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 12:20:01.949628 16364 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.430924 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:01.944073 16371 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.935546 16372 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.435817 16371 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:01.961262 16374 raft_consensus.cc:1081] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
W20260709 12:20:01.950232 16375 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:20:02.144811 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1278) took 3411 ms. Trace:
I20260709 12:20:02.159886 16305 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.451745 13135 rpcz_store.cc:276] 0709 12:19:58.733182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.968509 (+235327us) service_pool.cc:224] Handling call
0709 12:19:59.048931 (+ 80422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.093331 (+ 44400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.143771 (+3050440us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b540027e554. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:02.144505 (+   734us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34321280}
I20260709 12:20:02.452525 13878 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 12:20:02.164647 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 387785us
I20260709 12:20:02.453894 13103 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:02.163841 16280 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.201857 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2697) took 1916 ms. Trace:
W20260709 12:20:01.774765 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 270625us
I20260709 12:20:02.177050 15807 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:02.205178 13284 rpcz_store.cc:269] 0709 12:19:59.109284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.112243 (+  2959us) service_pool.cc:224] Handling call
0709 12:20:02.203731 (+3091488us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54001e96d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:02.204071 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824418560}
I20260709 12:20:01.828234 13882 rpcz_store.cc:276] 0709 12:19:59.640955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.669907 (+ 28952us) service_pool.cc:224] Handling call
0709 12:19:59.938549 (+268642us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5800084698. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e66fc0 00007f70f9e51929 00007f70f9e513d2 00007f70f33c8bd4
0709 12:19:59.938778 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.939037 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:00.533777 (+594740us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.401309 (+867532us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.435661 (+ 34352us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:01.438050 (+  2389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.475751 (+ 37701us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.501086 (+ 25335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":229498,"prepare.queue_time_us":206959,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":537304,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":41307520,"thread_start_us":1024159,"threads_started":3,"wal-append.queue_time_us":804542}
I20260709 12:20:01.940203 13883 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:02.183287 13203 raft_consensus.cc:606] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:02.502468 13203 raft_consensus.cc:614] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:02.226032 16269 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:02.504113 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:02.504557 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:02.505187 13203 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:01.350787 13886 rpcz_store.cc:276] 0709 12:19:59.834309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.835114 (+   805us) service_pool.cc:224] Handling call
0709 12:19:59.835398 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.835638 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:00.328374 (+492736us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.181878 (+853504us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.181967 (+    89us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:01.182044 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.182150 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.182344 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139147,"prepare.queue_time_us":310173,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":709769,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3536,"thread_start_us":1099434,"threads_started":3,"wal-append.queue_time_us":701664}
I20260709 12:20:02.232501 13279 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:20:02.233273 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:02.234225 16161 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 12:20:02.239560 16189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.169s	user 0.033s	sys 0.120s
I20260709 12:20:02.241614 16149 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:02.515969 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2704) took 2000 ms. Trace:
I20260709 12:20:02.515774 16149 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:02.516361 13207 rpcz_store.cc:276] 0709 12:20:00.515226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.404621 (+889395us) service_pool.cc:224] Handling call
0709 12:20:01.405002 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.878000 (+472998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.515506 (+637506us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400073ad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:02.515799 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528793856}
I20260709 12:20:02.517736 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:02.518095 16149 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.244544 15891 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.518885 15891 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:02.521049 15891 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.251783 16053 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.252823 16073 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:02.526938 16073 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:02.528350 13208 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:02.528770 16073 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.530081 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2691) took 4893 ms. Trace:
I20260709 12:20:02.530769 16073 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:01.952270 15735 consensus_meta.cc:287] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.000s
I20260709 12:20:02.537369 16312 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:02.537634 15735 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:02.243299 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 60626.1us
I20260709 12:20:02.260700 16229 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.480895 16172 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:02.264137 13130 rpcz_store.cc:269] 0709 12:19:59.116167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.121808 (+  5641us) service_pool.cc:224] Handling call
0709 12:20:02.141477 (+3019669us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b540010c7d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:02.141960 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5356889856}
I20260709 12:20:02.267903 16137 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:02.550282 16115 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.553925 13207 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:02.270419 13879 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:02.556391 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:02.557142 13879 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:02.235582 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:02.276711 16273 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.277002 15962 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.294126 16326 raft_consensus.cc:3055] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:02.560034 16326 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:02.561452 16326 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.302588 13206 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:02.305061 16383 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.306950 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:02.300107 16243 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:02.568087 13211 raft_consensus.cc:2410] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:02.308701 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2667) took 3224 ms. Trace:
I20260709 12:20:02.569428 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:02.569479 13286 rpcz_store.cc:276] 0709 12:19:59.083753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.084230 (+   477us) service_pool.cc:224] Handling call
0709 12:19:59.084608 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:59.432032 (+347424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.308000 (+2875968us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54002292d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:02.308477 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738731904}
I20260709 12:20:02.571321 13209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9377aea669547028ee8449f654c60b7"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:20:02.308169 16295 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.283367 16164 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:02.319152 16317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.007s	sys 0.017s
I20260709 12:20:02.311127 16169 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:02.324678 16271 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.325335 16278 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.317227 16293 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:02.358786 13210 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:02.367918 13205 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:20:02.388304 16262 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:02.404620 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 44848.1us
W20260709 12:20:02.407254 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.410518 16330 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:01.789193 16354 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.413013 16339 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:01.804728 16365 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:02.420843 16316 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.433135 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 705) took 2790 ms. Trace:
I20260709 12:20:02.601996 13881 rpcz_store.cc:276] 0709 12:19:59.642478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.669956 (+ 27478us) service_pool.cc:224] Handling call
0709 12:19:59.711834 (+ 41878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.145777 (+433943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.413711 (+2267934us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54006144d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:02.432926 (+ 19215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824411904}
I20260709 12:20:02.433220 13204 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
W20260709 12:20:02.433950 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.434026 16364 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.438097 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2677) took 2647 ms. Trace:
I20260709 12:20:02.608012 16354 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.441520 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.609236 13282 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:02.610252 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:02.611210 13282 raft_consensus.cc:2410] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:20:02.444083 16052 raft_consensus.cc:3055] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:02.450476 16294 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:02.454291 16308 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.467365 16125 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:02.468012 16363 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.468780 16372 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.470749 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:02.420529 16291 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.617725 16262 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.618624 16291 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:02.619006 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 148415us
I20260709 12:20:02.483857 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.489748 16162 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:02.454337 13878 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:02.496884 13212 rpcz_store.cc:276] 0709 12:20:00.285763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.285917 (+   154us) service_pool.cc:224] Handling call
0709 12:20:00.286326 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.286609 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:00.409240 (+122631us) log.cc:844] Serialized 14 byte log entry
0709 12:20:02.201184 (+1791944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:02.201304 (+   120us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:02.201436 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.201542 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.201778 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":452732,"prepare.queue_time_us":151700,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":507645,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":52260,"thread_start_us":1338490,"threads_started":2,"wal-append.queue_time_us":1074067}
I20260709 12:20:02.506752 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:02.499927 15807 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:02.512578 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.512882 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2685) took 1082 ms. Trace:
I20260709 12:20:02.513343 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.530545 13208 rpcz_store.cc:276] 0709 12:19:57.636227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.148309 (+512082us) service_pool.cc:224] Handling call
0709 12:19:58.184067 (+ 35758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.528811 (+4344744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.529770 (+   959us) spinlock_profiling.cc:243] Waited 4.34 s on lock 0x7b54000b7054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:02.529999 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9989680000}
I20260709 12:20:02.259023 16092 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.542742 13885 raft_consensus.cc:2410] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:02.542635 13175 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:02.542160 16229 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.544114 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:02.545574 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:02.564081 16383 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.571969 13209 raft_consensus.cc:606] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:02.571111 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:02.566946 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:02.571329 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:02.593222 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 92685.3us
I20260709 12:20:02.608469 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2687) took 1154 ms. Trace:
I20260709 12:20:02.589501 16172 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:02.445636 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 609478us
W20260709 12:20:02.621838 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.622998 13203 raft_consensus.cc:2393] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:02.621572 13279 rpcz_store.cc:276] 0709 12:20:01.430312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.227038 (+796726us) service_pool.cc:224] Handling call
0709 12:20:02.227580 (+   542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:02.508161 (+280581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.512787 (+  4626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.624485 13209 raft_consensus.cc:614] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:02.625686 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.626070 13211 raft_consensus.cc:2410] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 8 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:20:02.666972 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.612792 16052 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:02.629211 13884 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:02.633034 13206 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:20:02.634346 13281 raft_consensus.cc:2410] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:20:02.625394 13283 rpcz_store.cc:276] 0709 12:20:01.460120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.266484 (+806364us) service_pool.cc:224] Handling call
0709 12:20:02.266954 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.521834 (+254880us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:02.522209 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 12:20:02.587121 (+ 64912us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:02.587173 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:02.587219 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.608109 (+ 20890us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54003b65d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:02.608150 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.608290 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":156,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":267,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":5340,"spinlock_wait_cycles":585343744,"thread_start_us":64401,"threads_started":1,"wal-append.queue_time_us":94452}
I20260709 12:20:02.672636 16365 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:02.635901 16243 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:02.636091 13284 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:02.638046 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:02.638672 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2698) took 2342 ms. Trace:
I20260709 12:20:02.639760 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:02.641121 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 98614.3us
I20260709 12:20:02.641523 16383 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:02.643998 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 712) took 1343 ms. Trace:
I20260709 12:20:02.647523 16162 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:02.685276 13885 rpcz_store.cc:276] 0709 12:20:01.300827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.344455 (+ 43628us) service_pool.cc:224] Handling call
0709 12:20:02.643782 (+1299327us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54004d3354. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:02.643927 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2577019264}
I20260709 12:20:02.648793 16229 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.649396 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2681) took 1220 ms. Trace:
I20260709 12:20:02.650050 16315 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:02.650573 16121 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:02.650861 13286 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:02.617740 16363 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:02.652072 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:02.696170 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 55635.8us
I20260709 12:20:02.656543 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.658298 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:02.658933 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:02.660307 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:02.663589 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.697853 13135 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:02.699470 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.663985 16275 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:02.608033 13278 rpcz_store.cc:276] 0709 12:19:59.731820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.937577 (+205757us) service_pool.cc:224] Handling call
0709 12:20:00.668847 (+731270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.669084 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:00.931649 (+262565us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.271629 (+339980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.271837 (+   208us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:01.272042 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.272260 (+   218us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.366010 (+1093750us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54002da5d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:02.379592 (+ 13582us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1138445,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":22490,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4192,"spinlock_wait_cycles":1680963328,"thread_start_us":589919,"threads_started":2,"wal-append.queue_time_us":871049}
I20260709 12:20:02.616137 15962 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.669170 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.669646 16092 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.670462 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:02.670521 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:02.673168 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.675766 13205 rpcz_store.cc:276] 0709 12:20:00.296708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.296922 (+   214us) service_pool.cc:224] Handling call
0709 12:20:00.297400 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:02.590002 (+2292602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.638375 (+ 48373us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54002d4e54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:02.638593 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4719208832}
I20260709 12:20:02.674599 16365 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:02.678637 13212 raft_consensus.cc:2410] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:02.678568 16115 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:02.703552 16294 consensus_queue.cc:1059] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:20:02.707352 16115 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.708107 16294 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:02.708489 16294 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:02.709586 16115 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.710089 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.673805 16295 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:02.679253 16091 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.678908 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:02.677173 16243 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.716024 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:02.680068 16247 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.681974 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.682888 13883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 899) took 1324 ms. Trace:
I20260709 12:20:02.689252 16052 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.685601 16293 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.697229 13129 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:02.703151 13130 raft_consensus.cc:2393] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:02.701845 16368 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:20:02.705315 13279 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:02.705394 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.706133 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.706045 15962 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.692643 13277 rpcz_store.cc:276] 0709 12:20:01.429067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.960808 (+531741us) service_pool.cc:224] Handling call
0709 12:20:01.981561 (+ 20753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.288627 (+307066us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:02.289083 (+   456us) log.cc:844] Serialized 14 byte log entry
0709 12:20:02.398602 (+109519us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:02.398667 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:02.404292 (+  5625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.634198 (+229906us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54004083d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:02.634238 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.649229 (+ 14991us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4812,"prepare.queue_time_us":2201,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":13029,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":29347,"spinlock_wait_cycles":418571136,"thread_start_us":96256,"threads_started":1,"wal-append.queue_time_us":131236}
I20260709 12:20:02.685252 16326 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:02.719933 13878 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:20:02.712675 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:02.712700 13280 raft_consensus.cc:2410] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:20:02.712955 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:02.678584 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.654796 16339 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:02.714522 16091 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.716830 13883 rpcz_store.cc:276] 0709 12:20:01.358632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.936186 (+577554us) service_pool.cc:224] Handling call
0709 12:20:01.936511 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.502362 (+565851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.682528 (+180166us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b54006b26d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:02.682725 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7463808}
I20260709 12:20:02.723976 16052 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:02.724291 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.724613 13284 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:02.693315 16315 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:02.744187 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.731594 16115 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.731731 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.732236 13283 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:20:02.745905 13283 pending_rounds.cc:85] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 5
I20260709 12:20:02.717844 16243 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:02.734704 13103 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:02.709532 16294 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:02.735448 16382 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:02.736312 16211 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:02.737808 16298 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.703974 16172 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:20:02.739725 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:02.740379 16247 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:02.719599 16368 consensus_queue.cc:1243] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:02.741329 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.734218 16091 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.750677 13129 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:02.751502 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:02.751653 13282 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:02.751742 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.752530 13208 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:02.692821 16371 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.753325 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:02.746137 13283 pending_rounds.cc:107] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:20:02.769097 13283 raft_consensus.cc:2889] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:02.741083 16149 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:02.754886 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.759734 13252 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:02.760267 13885 raft_consensus.cc:2393] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:02.760752 13286 raft_consensus.cc:2393] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:20:02.760942 16403 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:20:02.754914 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:02.762677 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.762977 16339 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:02.763712 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:02.759213 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 47820us
I20260709 12:20:02.770183 13882 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
W20260709 12:20:02.772096 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.772080 13284 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:20:02.763463 16365 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.773331 16092 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:02.775462 16125 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:02.779762 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:02.778223 13878 raft_consensus.cc:2368] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5.
I20260709 12:20:02.780782 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:02.714784 16363 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.788275 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.788345 13135 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:20:02.789053 13282 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:02.788487 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:02.747704 16121 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.795648 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.795003 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.780856 16339 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:02.803620 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.805891 13205 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:02.804260 13284 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:02.767211 16293 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.808900 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:02.768743 16115 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:02.807178 13103 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:02.785473 16125 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:02.811192 13281 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:02.818477 13278 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:20:02.816360 13282 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 12:20:02.821395 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.825534 16115 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.821166 13282 pending_rounds.cc:85] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 4
I20260709 12:20:02.823652 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:02.806532 16339 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:02.835594 13282 pending_rounds.cc:107] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:20:02.836158 13282 raft_consensus.cc:2889] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:02.837708 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:02.838356 13129 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:20:02.817180 15935 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:20:02.825552 16402 log.cc:927] Time spent T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:20:02.847555 16383 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:02.847973 16383 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:02.848349 16383 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:02.844889 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:02.852386 13033 catalog_manager.cc:5697] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:20:02.826303 15995 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:20:02.854481 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:02.855788 16115 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:02.856216 16115 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.856590 16115 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:02.835632 16294 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:02.857733 13285 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:02.858109 16363 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:02.858623 13249 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:02.859547 16347 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:20:02.859783 13285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42730 (request call id 502) took 3166 ms (client timeout 2799 ms). Trace:
I20260709 12:20:02.860107 16347 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.860569 16347 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:02.859360 16365 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:02.863765 16264 raft_consensus.cc:3055] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:02.864171 16264 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:02.865187 16264 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.866613 16264 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:02.854820 13033 catalog_manager.cc:5697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:02.867898 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 85672.1us
I20260709 12:20:02.868954 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:02.869009 13033 catalog_manager.cc:5697] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 3, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:02.860198 13285 rpcz_store.cc:269] 0709 12:19:59.693182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.765541 (+ 72359us) service_pool.cc:224] Handling call
0709 12:20:02.859559 (+3094018us) spinlock_profiling.cc:243] Waited 3.02 s on lock 0x7b54002756d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:02.859715 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6956977536}
I20260709 12:20:02.863190 16365 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:02.852764 16125 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:02.871789 16365 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.837450 16162 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:02.873133 16125 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:02.874277 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:02.874363 13840 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:02.875255 13134 raft_consensus.cc:2410] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:02.872299 16365 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:02.876344 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.803646 16298 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:02.879377 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:02.880184 13129 raft_consensus.cc:2410] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:02.834548 15962 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.881788 16080 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.885113 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.837306 16247 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:02.839745 16368 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:02.856583 15935 raft_consensus.cc:697] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:02.889199 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.889420 13841 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:02.887660 13282 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:20:02.871207 13033 catalog_manager.cc:5697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:02.893993 13282 pending_rounds.cc:85] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 5
I20260709 12:20:02.888162 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:02.898820 13136 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:20:02.899475 16304 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:02.899919 16304 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.899968 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:02.900326 16304 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:02.900733 13137 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:20:02.895398 16080 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.896957 16162 raft_consensus.cc:2764] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:20:02.906701 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.907831 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:02.908245 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.911135 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:02.911772 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.913465 13282 pending_rounds.cc:107] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:20:02.913913 13282 raft_consensus.cc:2889] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:02.912623 13284 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:02.915457 13286 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:02.893180 16371 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:02.920991 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.930712 13286 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:02.932607 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.928736 13033 catalog_manager.cc:5697] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:20:02.934756 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 45414.3us
I20260709 12:20:02.922209 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.908697 13128 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:02.941749 16393 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:02.946295 16393 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:02.946770 16393 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:02.946964 16406 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:20:02.953413 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:02.955626 16162 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:02.955655 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.956247 16162 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.956326 13100 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:02.956640 16162 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:02.956823 16298 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:02.957230 16368 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:02.957842 16368 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:02.945730 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.976737 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.918941 16211 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:20:02.958815 16368 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.976928 16293 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.992240 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:02.992782 16121 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.989480 16382 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:02.993480 13103 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:02.992072 16172 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:02.992877 16080 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:02.988679 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.995951 13279 raft_consensus.cc:2410] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:20:02.993847 16382 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:02.994086 16282 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
W20260709 12:20:02.998847 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.999637 16315 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:03.003075 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 58708.3us
I20260709 12:20:03.006047 16363 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:02.935132 15935 consensus_queue.cc:237] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:03.017720 16408 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.002s
I20260709 12:20:02.990170 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:03.020071 13281 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
W20260709 12:20:03.062397 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 73114.6us
I20260709 12:20:03.075378 16293 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:20:03.114166 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:03.123209 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:03.128055 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.993825 13033 catalog_manager.cc:5697] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 4 to 5, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 5 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:20:02.960121 13134 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:03.000739 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:02.955590 15852 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.164s
I20260709 12:20:03.019412 15807 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:03.170539 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:03.174510 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 149894us
W20260709 12:20:03.170751 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 95049.4us
W20260709 12:20:03.176422 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 171872us
I20260709 12:20:03.190313 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:03.182382 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 210444us
I20260709 12:20:03.191452 13033 catalog_manager.cc:5697] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 2, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:03.197181 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:03.204146 16073 consensus_meta.cc:287] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.661s	user 0.020s	sys 0.018s
I20260709 12:20:03.204557 13033 catalog_manager.cc:5697] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.205432 16393 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:03.206212 13033 catalog_manager.cc:5697] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 4 to 7, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 7 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.207753 16293 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:03.210712 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:03.211395 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:03.212594 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:03.213789 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:03.214531 13279 raft_consensus.cc:2410] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:03.214461 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.212652 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:03.215343 13212 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:20:03.216836 13208 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:03.218173 13033 catalog_manager.cc:5697] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 5, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 5 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.196254 16317 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:03.219712 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:03.220204 13033 catalog_manager.cc:5697] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:20:03.221403 16393 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:03.223928 13882 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:03.225281 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:03.230501 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:03.231460 16363 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:20:03.231778 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:03.235193 13100 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:03.221698 13033 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 5 to 6, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 6 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:03.240213 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:03.243134 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:03.244130 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:03.244735 13285 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:03.214366 15807 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:03.247654 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:03.248226 13212 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:03.248642 13207 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:03.250558 16347 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:03.251566 16312 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:03.262739 16312 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.263140 16312 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:03.263247 16382 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:03.280680 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.219269 16115 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:03.286118 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.273366 16347 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:03.292331 13033 catalog_manager.cc:5697] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 5, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 5 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.294229 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.299757 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:03.302395 13280 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:20:03.302881 13280 pending_rounds.cc:85] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 6
I20260709 12:20:03.303140 13280 pending_rounds.cc:107] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:20:03.303387 13280 raft_consensus.cc:2889] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:03.299381 13278 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:20:03.305552 13282 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:03.301573 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:03.309691 13203 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:03.310977 13882 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:03.316913 13100 leader_election.cc:400] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5.
I20260709 12:20:03.317381 13100 leader_election.cc:403] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:20:03.320971 13212 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
W20260709 12:20:03.322458 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 87022.7us
I20260709 12:20:03.325342 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.321776 13207 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:03.331743 13841 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:03.282236 16363 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:20:03.340179 13206 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
W20260709 12:20:03.341001 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 55670.6us
I20260709 12:20:03.346462 13838 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:03.283156 16073 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:20:03.356189 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:03.356470 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:03.359592 13134 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:03.360572 16283 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:03.361199 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:03.362453 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:03.364168 16115 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:03.364107 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:03.366760 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:03.361330 16283 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:03.372627 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:03.348559 13033 catalog_manager.cc:5697] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 3 to 6, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 6 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.350346 16298 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:03.387197 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:03.387030 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:03.390231 13137 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:03.388124 13135 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:03.369102 16347 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:03.392444 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.393215 13207 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:03.396548 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:03.393586 16365 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:03.394769 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:03.394898 13282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:20:03.400566 13282 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.400992 13282 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:03.400866 13206 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:03.400873 13033 catalog_manager.cc:5697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.404507 13212 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:03.408999 13033 catalog_manager.cc:5697] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 2 to 3, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:03.400581 16243 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.008s
I20260709 12:20:03.413265 13134 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:03.408975 16347 raft_consensus.cc:697] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:03.416530 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.409191 16293 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:20:03.419544 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:03.398967 16295 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:20:03.399034 15807 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:03.424999 16365 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:03.428244 16291 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:03.428777 13103 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:03.430650 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.432224 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.432583 13284 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:03.433135 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.434636 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:03.401012 16383 consensus_meta.cc:287] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.006s
I20260709 12:20:03.437729 13285 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:03.410701 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:03.439083 13282 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:03.445446 13137 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:03.449450 13033 catalog_manager.cc:5697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 4 to 6, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 6 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:03.451445 13207 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:03.451463 13134 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:03.472656 13209 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:03.476197 13204 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:03.478547 13212 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:03.447698 15807 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.482720 13204 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:03.482831 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.486063 13209 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:03.482419 13282 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:03.470420 16291 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.489900 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:03.488452 16125 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:03.491736 16125 raft_consensus.cc:697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:03.491673 16312 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:03.492676 16275 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:03.492782 16125 consensus_queue.cc:237] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:03.493311 16275 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:03.494158 16312 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:03.494248 16275 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:03.495754 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 67053.2us
I20260709 12:20:03.495908 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.497059 16291 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:03.497579 16315 consensus_queue.cc:1059] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:03.499100 16298 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 4. Current term is 5.
I20260709 12:20:03.467724 13128 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:20:03.499269 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:03.501498 16294 consensus_meta.cc:287] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.644s	user 0.006s	sys 0.011s
I20260709 12:20:03.503744 13282 pending_rounds.cc:85] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 6
W20260709 12:20:03.504738 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 104924us
I20260709 12:20:03.511307 13102 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:03.505184 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.507102 13212 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:20:03.473364 16383 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:03.478291 16073 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:03.520047 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.520851 13204 raft_consensus.cc:2393] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:03.521747 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.522310 13204 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:03.523132 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.505910 13033 catalog_manager.cc:5697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.487253 15807 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:03.510317 13280 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:03.512847 13282 pending_rounds.cc:107] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:20:03.508569 16293 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:20:03.515622 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:03.442591 16243 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:03.528718 13882 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:03.517726 16383 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:03.504148 16211 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:20:03.527670 13282 raft_consensus.cc:2889] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:03.514004 13133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.052s	sys 0.064s
I20260709 12:20:03.480041 16363 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 12:20:03.532202 13133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.053s	sys 0.064s
W20260709 12:20:03.534745 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.535259 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.535540 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:03.545748 13209 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:03.556843 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.534133 16243 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:03.537781 16121 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:03.562345 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:03.562567 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.533303 16294 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:03.504320 16347 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:03.573212 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:03.574152 13207 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:20:03.562630 16339 consensus_meta.cc:287] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.717s	user 0.013s	sys 0.007s
I20260709 12:20:03.589038 13212 raft_consensus.cc:3055] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:03.589583 13212 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:03.593071 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:03.593999 13204 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:03.594846 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.596215 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.597329 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:03.597618 16304 consensus_meta.cc:287] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.697s	user 0.013s	sys 0.018s
I20260709 12:20:03.598021 16304 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:03.576033 16162 consensus_meta.cc:287] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.004s
I20260709 12:20:03.600147 16162 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:03.601192 13211 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:03.602413 16162 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:03.567358 16294 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.609648 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:03.615243 13208 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:03.616035 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:03.619889 13204 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:20:03.626493 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:03.627635 13282 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:20:03.591260 16052 consensus_meta.cc:287] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.845s	user 0.018s	sys 0.001s
W20260709 12:20:03.629554 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.630709 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:03.632320 13204 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:03.634618 13841 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:03.635741 16052 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:03.629377 16304 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:03.635939 13212 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:03.637362 13212 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:03.653699 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.663946 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:03.680577 13209 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:03.681815 13203 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:03.681999 13207 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:20:03.687546 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:03.612525 16294 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:03.697937 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:03.700722 13882 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:03.704530 13100 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:03.714339 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:03.608803 16339 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:03.750062 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:03.750705 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.705147 16363 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:03.714967 16371 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:20:03.803759 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.806154 13212 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:03.716133 16243 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.814734 13130 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:03.730540 16293 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:03.821847 13205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.007s	sys 0.013s
W20260709 12:20:03.811465 16317 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
W20260709 12:20:03.823724 13205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.008s	sys 0.013s
I20260709 12:20:03.815582 16363 raft_consensus.cc:697] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:03.823302 16371 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:03.848872 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:03.834947 16317 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:03.879410 13885 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.005s	sys 0.022s
W20260709 12:20:03.879901 13885 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.006s	sys 0.022s
I20260709 12:20:03.823714 16243 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:03.882332 13286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.000s	sys 0.026s
W20260709 12:20:03.870652 16368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.007s	sys 0.018s
W20260709 12:20:03.883931 13286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.001s	sys 0.026s
W20260709 12:20:03.907569 13283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.008s	sys 0.002s
W20260709 12:20:03.879026 16326 consensus_meta.cc:287] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 1.149s	user 0.009s	sys 0.005s
W20260709 12:20:03.910907 13283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.008s	sys 0.002s
W20260709 12:20:03.913178 13249 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.020s	sys 0.012s
W20260709 12:20:03.913515 13249 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.020s	sys 0.012s
W20260709 12:20:03.913838 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 683949us
I20260709 12:20:03.914286 13128 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:20:03.886077 16368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.007s	sys 0.019s
W20260709 12:20:03.896953 13838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.006s	sys 0.004s
W20260709 12:20:03.911319 15935 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.015s	sys 0.026s
I20260709 12:20:03.916422 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1895) took 1009 ms. Trace:
W20260709 12:20:03.923898 13177 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.019s	sys 0.019s
W20260709 12:20:03.936179 13177 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.020s	sys 0.020s
W20260709 12:20:03.936523 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 728358us
W20260709 12:20:03.922756 13210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.025s	sys 0.030s
W20260709 12:20:03.938797 13210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.025s	sys 0.030s
W20260709 12:20:03.939394 13277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.007s	sys 0.029s
I20260709 12:20:03.912761 16283 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:03.939742 13277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.007s	sys 0.029s
W20260709 12:20:03.940459 13838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.007s	sys 0.004s
W20260709 12:20:03.941792 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.878777 16291 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:03.934196 16282 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.010s	sys 0.061s
W20260709 12:20:03.938958 15935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.022s	sys 0.028s
I20260709 12:20:03.947790 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:03.953022 16440 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.938055 16383 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:03.959672 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 460858us
W20260709 12:20:03.941246 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 584886us
W20260709 12:20:03.947079 13886 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.005s	sys 0.005s
W20260709 12:20:03.961942 13886 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.005s	sys 0.005s
W20260709 12:20:03.960511 13879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.034s	sys 0.043s
W20260709 12:20:03.969558 13879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.034s	sys 0.043s
I20260709 12:20:03.970001 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:03.972678 13838 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:03.950587 16282 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.010s	sys 0.061s
W20260709 12:20:03.974972 13177 leader_election.cc:336] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.559s (SENT)
I20260709 12:20:03.951917 16211 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.910838 15807 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:03.984613 13887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.015s
W20260709 12:20:03.995735 13887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.000s	sys 0.015s
I20260709 12:20:03.949167 16283 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:03.984458 16125 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.006706 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:04.009958 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 48357.8us
I20260709 12:20:04.013588 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.014408 13134 raft_consensus.cc:2393] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:03.974514 16383 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:03.949003 16363 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.014398 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.018736 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:04.021299 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:04.025584 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 50643.8us
I20260709 12:20:04.029508 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:04.040627 13177 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.596s (SENT)
I20260709 12:20:04.041215 13177 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:03.984035 16440 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:03.971139 16371 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:03.998740 16211 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:04.046626 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.050907 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.051556 13130 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:20:04.055584 16121 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:04.057842 16425 log.cc:927] Time spent T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:20:04.039868 16417 log.cc:927] Time spent T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:20:04.063582 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:04.016752 16125 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.036711 16419 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:04.084169 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:04.065686 16411 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:20:04.098906 13128 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:04.099005 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:04.099053 13278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.000s	sys 0.026s
W20260709 12:20:04.101020 13278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.026s
I20260709 12:20:04.100850 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:04.102007 13884 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.030s	sys 0.032s
W20260709 12:20:04.114888 13884 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.031s	sys 0.033s
I20260709 12:20:04.069353 16243 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:04.081748 16422 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:20:04.109117 13211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.008s	sys 0.020s
W20260709 12:20:04.128171 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:04.129376 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 89040.7us
I20260709 12:20:04.130311 13134 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:04.128762 13211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.008s	sys 0.020s
I20260709 12:20:04.102149 16419 raft_consensus.cc:697] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:04.142361 16162 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:04.143121 16312 raft_consensus.cc:3055] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:04.149866 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:04.161919 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:04.175962 13249 leader_election.cc:336] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.590s (SENT)
I20260709 12:20:04.179939 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.181232 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.182394 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:04.182694 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.183115 13129 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:04.184127 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.184255 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.184950 13129 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:04.185070 13131 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:04.186053 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.186178 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.186748 13129 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:04.187661 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.188284 13129 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:04.189425 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:04.189996 13210 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:20:04.190090 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:04.190187 16440 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:04.193233 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:04.193748 13207 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:20:04.194128 13207 pending_rounds.cc:85] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:20:04.194288 13136 raft_consensus.cc:2410] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:04.194823 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:04.195763 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:04.195405 13203 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:20:04.199803 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:04.201062 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:04.202396 13130 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:20:04.203727 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:04.203738 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.206483 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.204883 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.194345 13207 pending_rounds.cc:107] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:20:04.207799 13207 raft_consensus.cc:2889] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:04.209195 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.212862 16430 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.213757 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:04.215026 13207 raft_consensus.cc:2410] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:04.213653 16430 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.212337 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:04.215193 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 71908us
I20260709 12:20:04.191296 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:04.195371 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:04.218264 13136 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:04.222668 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.224385 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:04.228194 13206 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:04.226157 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 76382.1us
I20260709 12:20:04.227186 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:04.241153 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.246894 13131 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:04.228509 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:04.250342 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.174734 16291 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:04.174122 16312 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:04.276703 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:04.277735 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 195471us
I20260709 12:20:04.279657 13129 raft_consensus.cc:2410] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:04.283346 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:04.291543 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 86706.8us
I20260709 12:20:04.247418 16162 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:04.251601 15807 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:04.287304 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.297390 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:04.300611 13134 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:20:04.294744 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:04.302655 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:04.303287 13210 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:04.304243 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:04.292295 13103 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:04.312940 16441 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:04.314910 16418 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:20:04.316000 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:04.316295 16312 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:04.317404 16434 log.cc:927] Time spent T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:20:04.317636 16312 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:04.319020 16436 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:20:04.319207 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.296476 15935 consensus_queue.cc:1059] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:20:04.319911 13131 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:04.320847 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1894) took 1414 ms. Trace:
I20260709 12:20:04.320887 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.326370 16339 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:04.306090 16429 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:04.331355 13136 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:04.332010 16125 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:04.335741 16211 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:04.336069 13177 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:04.321437 13277 rpcz_store.cc:276] 0709 12:20:02.906287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.907555 (+  1268us) service_pool.cc:224] Handling call
0709 12:20:02.907902 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:02.908502 (+   600us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:03.297735 (+389233us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.943300 (+645565us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:03.954866 (+ 11566us) log.cc:844] Serialized 26 byte log entry
0709 12:20:03.955003 (+   137us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:03.955037 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.955152 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.320612 (+365460us) raft_consensus.cc:1685] finished
0709 12:20:04.320641 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.320766 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":309987,"prepare.queue_time_us":43801,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":3912,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":12423,"thread_start_us":911705,"threads_started":2,"wal-append.queue_time_us":798142}
I20260709 12:20:04.337404 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:04.338246 16422 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:04.338548 16430 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:04.338780 16422 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:04.338996 13177 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.339334 16422 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:04.339974 16162 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:04.339982 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:04.343613 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 51390.3us
W20260709 12:20:04.370183 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 58623.2us
I20260709 12:20:04.349869 13210 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:04.281229 16293 raft_consensus.cc:697] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:04.356902 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.368196 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 524) took 1131 ms. Trace:
I20260709 12:20:04.374528 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:04.428336 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:04.429623 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:04.430019 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.430763 13136 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:04.430814 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.428264 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 916) took 1068 ms. Trace:
I20260709 12:20:04.431595 13886 rpcz_store.cc:276] 0709 12:20:03.359529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.414782 (+ 55253us) service_pool.cc:224] Handling call
0709 12:20:03.415108 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.415320 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:03.962344 (+547024us) log.cc:844] Serialized 14 byte log entry
0709 12:20:04.427901 (+465557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:04.427956 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:04.428013 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.428078 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.428205 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9847,"prepare.queue_time_us":755774,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"thread_start_us":951514,"threads_started":2}
W20260709 12:20:04.433355 13885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.012s	sys 0.014s
I20260709 12:20:04.373708 13279 rpcz_store.cc:276] 0709 12:20:03.237032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.258556 (+ 21524us) service_pool.cc:224] Handling call
0709 12:20:03.258847 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:03.259167 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.259215 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:03.265259 (+  6044us) log.cc:844] Serialized 26 byte log entry
0709 12:20:03.699061 (+433802us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:03.699117 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.699196 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.367929 (+668733us) raft_consensus.cc:1685] finished
0709 12:20:04.367959 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.368125 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":260,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":433453,"threads_started":1,"wal-append.queue_time_us":612006}
I20260709 12:20:04.358405 15807 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:04.436663 13885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.013s	sys 0.014s
I20260709 12:20:04.367003 16125 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.438920 13130 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:20:04.355831 15995 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.003s	sys 0.026s
I20260709 12:20:04.427697 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.427780 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.450541 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.453284 13134 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 4.
W20260709 12:20:04.453850 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 78394.5us
I20260709 12:20:04.455263 13102 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.437794 16172 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:04.460127 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.461197 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:04.468144 13284 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:04.462064 13878 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:20:04.463406 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 124471us
I20260709 12:20:04.492700 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:04.493825 13277 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:20:04.496266 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.498337 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:04.500501 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 396592us
W20260709 12:20:04.456935 15995 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.004s	sys 0.026s
I20260709 12:20:04.499037 13129 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
W20260709 12:20:04.507267 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 50311.3us
W20260709 12:20:04.509897 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 49837.5us
I20260709 12:20:04.511617 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:04.514210 13136 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:04.515904 13134 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:04.457432 16275 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:04.456563 16162 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:04.493687 16347 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:04.461015 16291 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:04.494802 16441 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:04.529036 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:04.456686 16283 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:04.543125 16445 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:04.544440 16445 raft_consensus.cc:3055] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:04.544855 16445 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:03.934108 13283 rpcz_store.cc:276] 0709 12:20:02.906615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.906757 (+   142us) service_pool.cc:224] Handling call
0709 12:20:02.907088 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.907468 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:03.185786 (+278318us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.916022 (+730236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.916073 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:03.916118 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.916251 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.916367 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5636,"prepare.queue_time_us":44599,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":4049,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":9774,"thread_start_us":965604,"threads_started":2}
I20260709 12:20:04.535892 13210 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:04.545887 16445 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.543154 13130 raft_consensus.cc:2410] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:04.550761 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:04.555822 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 276387us
I20260709 12:20:04.458182 16125 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.366869 16419 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.518185 16452 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:04.568212 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.571116 13129 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:04.582674 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:04.583354 13210 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:04.510528 16172 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.550263 16445 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:04.618507 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:04.620196 13203 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:04.622262 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.623106 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.623802 13129 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:04.625721 13130 raft_consensus.cc:2410] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:20:04.627087 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 84733.4us
I20260709 12:20:04.585721 16211 raft_consensus.cc:2764] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:20:04.646365 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 145145us
W20260709 12:20:04.648761 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.650473 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:04.659592 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.663226 13203 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:04.586941 16365 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:20:04.664347 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:04.667956 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.557622 16293 consensus_queue.cc:237] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.657444 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 723) took 1404 ms. Trace:
W20260709 12:20:04.670253 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 168801us
I20260709 12:20:04.666024 13838 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:04.659996 16423 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.374s	user 0.001s	sys 0.001s
I20260709 12:20:04.676544 13838 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:04.679328 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 111225us
I20260709 12:20:04.682060 13838 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:20:04.682457 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 141907us
I20260709 12:20:04.689808 13130 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:04.691031 13129 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:20:04.682435 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:04.674361 16430 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:04.691954 13177 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:04.669492 15935 raft_consensus.cc:3055] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:04.691391 13129 pending_rounds.cc:85] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 5
I20260709 12:20:04.702015 13129 pending_rounds.cc:107] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:20:04.701797 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:04.702337 13129 raft_consensus.cc:2889] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:04.679574 16371 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:04.711882 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:04.713725 16450 log.cc:927] Time spent T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:20:04.714665 16465 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:04.715222 16465 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:04.716045 13252 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:04.716934 13252 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.717278 16465 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:04.717870 16465 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:04.718341 16115 consensus_queue.cc:1059] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.719128 16115 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:04.719739 16476 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:04.719955 16115 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.720348 16476 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.720852 16476 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:04.721720 16432 log.cc:927] Time spent T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 12:20:04.722466 16455 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:04.723417 16125 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:04.723735 16456 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:20:04.725364 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 724) took 1497 ms. Trace:
I20260709 12:20:04.690075 16429 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:04.674587 13885 rpcz_store.cc:276] 0709 12:20:03.227496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.227858 (+   362us) service_pool.cc:224] Handling call
0709 12:20:03.228152 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.228398 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:03.880281 (+651883us) log.cc:844] Serialized 14 byte log entry
0709 12:20:04.631645 (+751364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:04.631714 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:04.631779 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.631866 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.632034 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19413,"prepare.queue_time_us":921294,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":106019,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":1312026,"threads_started":3,"wal-append.queue_time_us":674313}
I20260709 12:20:04.720582 16115 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.732920 13206 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:04.740904 13284 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:04.695472 16430 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:04.758502 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 46716.5us
I20260709 12:20:04.698895 15935 raft_consensus.cc:740] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:04.725752 13884 rpcz_store.cc:276] 0709 12:20:03.227764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.228802 (+  1038us) service_pool.cc:224] Handling call
0709 12:20:03.229088 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:03.229446 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.229472 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:03.229921 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.115499 (+885578us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:04.115559 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.115629 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.725151 (+609522us) raft_consensus.cc:1685] finished
0709 12:20:04.725174 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.725307 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32446,"raft.queue_time_us":3556,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":3139,"thread_start_us":885174,"threads_started":1,"wal-append.queue_time_us":1209656}
W20260709 12:20:04.719750 16294 consensus_meta.cc:287] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.971s	user 0.008s	sys 0.005s
W20260709 12:20:04.775115 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.779639 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 919) took 1137 ms. Trace:
I20260709 12:20:04.782456 16465 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:04.785085 16459 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:20:04.785447 16465 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.785521 16475 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:04.785959 16465 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:04.786087 16475 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.786600 16475 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:04.787143 16470 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:04.787606 16470 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:04.788005 16470 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:04.788257 16458 log.cc:927] Time spent T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:20:04.791800 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 915) took 1432 ms. Trace:
I20260709 12:20:04.792645 16115 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:04.792461 15935 consensus_queue.cc:260] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:04.793244 16115 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:04.794004 16115 raft_consensus.cc:3055] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:04.792148 13879 rpcz_store.cc:276] 0709 12:20:03.359194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.359324 (+   130us) service_pool.cc:224] Handling call
0709 12:20:03.359710 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:03.987217 (+627507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.987254 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:04.001007 (+ 13753us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.461849 (+460842us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:04.461885 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.461950 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.787678 (+325728us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:04.791501 (+  3823us) raft_consensus.cc:1685] finished
0709 12:20:04.791524 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.791735 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1858,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":8867072,"thread_start_us":1036582,"threads_started":2,"wal-append.queue_time_us":606504}
I20260709 12:20:04.794400 16115 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:04.795176 16461 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:20:04.795601 16464 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:20:04.797622 16317 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:04.784801 13129 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:04.769850 16430 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:04.794076 15935 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:04.806102 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 914) took 1450 ms. Trace:
I20260709 12:20:04.810550 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 586) took 1607 ms. Trace:
W20260709 12:20:04.786248 16454 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 12:20:04.835121 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 154784us
I20260709 12:20:04.812359 13887 rpcz_store.cc:276] 0709 12:20:03.355656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.357534 (+  1878us) service_pool.cc:224] Handling call
0709 12:20:03.357977 (+   443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:03.996647 (+638670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.996685 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:04.016936 (+ 20251us) log.cc:844] Serialized 52 byte log entry
0709 12:20:04.456847 (+439911us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:04.456905 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.457064 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.805891 (+348827us) raft_consensus.cc:1685] finished
0709 12:20:04.805911 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.806041 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3327,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":1027776,"threads_started":2,"wal-append.queue_time_us":615042}
I20260709 12:20:04.817051 13205 rpcz_store.cc:276] 0709 12:20:03.203138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.210275 (+  7137us) service_pool.cc:224] Handling call
0709 12:20:03.210595 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:03.835967 (+625372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.836067 (+   100us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:03.876092 (+ 40025us) log.cc:844] Serialized 52 byte log entry
0709 12:20:04.358321 (+482229us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:04.436207 (+ 77886us) log.cc:844] Serialized 14 byte log entry
0709 12:20:04.436492 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.436605 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.721910 (+285305us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:04.798445 (+ 76535us) raft_consensus.cc:1685] finished
0709 12:20:04.810305 (+ 11860us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.810470 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71809,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":7217,"raft.queue_time_us":278977,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":16013,"spinlock_wait_cycles":6389504,"thread_start_us":1047768,"threads_started":2,"wal-append.queue_time_us":664755}
W20260709 12:20:04.855576 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 138698us
I20260709 12:20:04.784040 16294 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:04.859300 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 100884us
W20260709 12:20:04.861835 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 171091us
W20260709 12:20:04.863577 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.864292 13175 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:04.798281 16317 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.878053 13841 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:04.856343 13252 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.852150 16172 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:04.909269 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 141987us
W20260709 12:20:04.905500 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49202.8us
I20260709 12:20:04.922528 13135 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:04.923363 13252 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.924690 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:04.926113 13177 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:04.923324 13249 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:04.936718 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:04.935380 13838 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:04.941076 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 43951.1us
I20260709 12:20:04.895646 16469 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:04.946461 13252 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.954581 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:04.923611 15995 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:04.960317 16449 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:20:04.960942 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.956278 13879 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:04.854198 16115 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.906493 16468 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:04.979490 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.965600 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:04.978507 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:04.981812 13129 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 4.
I20260709 12:20:04.944628 16478 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.981458 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:04.983814 13100 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:04.989364 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:04.965415 16480 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:04.990058 13885 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:04.990298 16480 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:04.990782 16480 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:04.990906 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:04.991139 16494 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:04.784793 13880 rpcz_store.cc:276] 0709 12:20:03.641763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.641899 (+   136us) service_pool.cc:224] Handling call
0709 12:20:03.642262 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:03.642475 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.642502 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:03.677849 (+ 35347us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.246463 (+568614us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:04.253301 (+  6838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.274333 (+ 21032us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.733344 (+459011us) raft_consensus.cc:1685] finished
0709 12:20:04.733371 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.779557 (+ 46186us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":417249,"threads_started":1,"wal-append.queue_time_us":796116}
I20260709 12:20:04.991637 13886 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
I20260709 12:20:04.992061 16462 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:20:04.992547 16494 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:04.993119 16494 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:04.993547 16494 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:04.994767 16462 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:04.995359 16493 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:04.996124 16482 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:20:04.995937 16493 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:04.998090 16493 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:04.992628 16466 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:04.951265 16483 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:04.961479 15995 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.936050 16472 consensus_queue.cc:1059] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:20:05.015769 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:05.016763 13129 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
W20260709 12:20:05.014986 16312 consensus_meta.cc:287] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.697s	user 0.003s	sys 0.009s
I20260709 12:20:05.014654 15995 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:05.040517 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1509) took 1520 ms. Trace:
W20260709 12:20:05.033721 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 107655us
I20260709 12:20:05.044562 13211 rpcz_store.cc:276] 0709 12:20:03.520330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.602809 (+ 82479us) service_pool.cc:224] Handling call
0709 12:20:03.603207 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:03.603940 (+   733us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:03.603988 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:03.604658 (+   670us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.137170 (+532512us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:04.137593 (+   423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.137658 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:05.040233 (+902575us) raft_consensus.cc:1685] finished
0709 12:20:05.040253 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.040420 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6873,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":70511,"thread_start_us":531560,"threads_started":1,"wal-append.queue_time_us":768609}
I20260709 12:20:05.046132 16490 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:05.046321 16468 consensus_queue.cc:1059] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:05.041802 13131 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
W20260709 12:20:05.047945 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 97282us
I20260709 12:20:05.018051 16115 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:05.046725 16490 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:05.048736 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:05.068436 16474 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
W20260709 12:20:05.068984 16488 log.cc:927] Time spent T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:20:05.069171 16470 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:05.008249 16478 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:05.071902 16383 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:05.073185 16478 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:05.075532 16457 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:05.075789 16294 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:05.077560 16471 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:20:05.058418 16462 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:05.079836 16462 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.082163 16462 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:05.082687 16473 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:20:05.047122 16497 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
W20260709 12:20:05.079275 16162 consensus_meta.cc:287] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
I20260709 12:20:05.047317 16466 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.062650 16485 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:05.071285 16470 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:05.063129 16483 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:05.113394 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:05.116423 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 67774.4us
I20260709 12:20:05.063791 16490 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:05.146433 16476 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.113267 16486 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:05.147583 16283 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:05.148120 16283 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.150133 16283 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:05.111685 16497 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.150723 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:05.115484 16162 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.151080 16497 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:05.075330 16465 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:05.152496 16497 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:05.129557 13211 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:05.152997 16497 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:05.153285 16465 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:05.153425 16497 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:05.130920 13204 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:05.130564 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:05.129549 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1852) took 1027 ms. Trace:
I20260709 12:20:05.132732 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1846) took 1118 ms. Trace:
I20260709 12:20:05.135960 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:05.139998 16438 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.626s	user 0.000s	sys 0.002s
I20260709 12:20:05.159067 13137 rpcz_store.cc:276] 0709 12:20:04.013976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.020634 (+  6658us) service_pool.cc:224] Handling call
0709 12:20:04.038410 (+ 17776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:04.102388 (+ 63978us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:04.102420 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:04.102462 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:04.102491 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.132485 (+1029994us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b540027db54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:05.132531 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.132654 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2582,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":11921,"spinlock_wait_cycles":146365184}
I20260709 12:20:05.115278 16485 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:05.143666 16422 consensus_meta.cc:287] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.003s
I20260709 12:20:05.144438 13133 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:05.131139 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:05.124774 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:05.129995 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:05.152542 13175 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:05.156126 16317 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:05.130774 16480 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:05.157090 13128 rpcz_store.cc:276] 0709 12:20:04.101973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.102489 (+   516us) service_pool.cc:224] Handling call
0709 12:20:04.133054 (+ 30565us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:04.217400 (+ 84346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.217446 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:04.262584 (+ 45138us) log.cc:844] Serialized 52 byte log entry
0709 12:20:04.562353 (+299769us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:04.593132 (+ 30779us) log.cc:844] Serialized 14 byte log entry
0709 12:20:04.593409 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.593512 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:05.069752 (+476240us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b1800405280. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:05.129253 (+ 59501us) raft_consensus.cc:1685] finished
0709 12:20:05.129349 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.129493 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5258,"prepare.queue_time_us":34050,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":31021,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":51213,"spinlock_wait_cycles":47720704,"thread_start_us":259559,"threads_started":1,"wal-append.queue_time_us":747500}
I20260709 12:20:05.169435 13285 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: [3.2-6.3]
I20260709 12:20:05.063766 16487 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 12:20:05.175145 13879 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEARNER]: Advancing to term 7
I20260709 12:20:05.177249 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:20:05.181802 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.185212 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:05.184010 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:05.185222 13177 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:05.165652 16485 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:05.191845 13886 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:05.192166 13885 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:05.196238 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:05.197021 13103 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:05.197779 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.199909 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1851) took 1112 ms. Trace:
I20260709 12:20:05.210218 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.210841 13882 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:05.209717 13135 rpcz_store.cc:276] 0709 12:20:04.087520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.087681 (+   161us) service_pool.cc:224] Handling call
0709 12:20:04.114590 (+ 26909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:04.923561 (+808971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.199611 (+276050us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b540027ef54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:05.199833 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1821502720}
I20260709 12:20:05.164229 16476 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:05.209813 13204 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:05.215185 16457 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:05.215240 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:05.215847 13132 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 9. Ops: [7.5-7.5]
I20260709 12:20:05.216352 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.220682 13212 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:20:05.221467 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:05.212730 13100 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:05.226174 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.224414 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 725) took 1978 ms. Trace:
I20260709 12:20:05.227509 13878 rpcz_store.cc:276] 0709 12:20:03.253766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.258368 (+  4602us) service_pool.cc:224] Handling call
0709 12:20:03.264170 (+  5802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.499677 (+1235507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.224157 (+724480us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400570b54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:05.224340 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729620864}
I20260709 12:20:05.224478 13100 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:05.229532 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 527) took 1951 ms. Trace:
W20260709 12:20:05.229668 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 49527.2us
I20260709 12:20:05.230218 13100 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:05.230480 13177 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:05.229919 13278 rpcz_store.cc:276] 0709 12:20:03.278573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.401732 (+123159us) service_pool.cc:224] Handling call
0709 12:20:03.402054 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:03.414048 (+ 11994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.414097 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:03.448835 (+ 34738us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.127269 (+678434us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:04.127347 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.127746 (+   399us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:05.139325 (+1011579us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:05.218833 (+ 79508us) raft_consensus.cc:1685] finished
0709 12:20:05.218864 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.229453 (+ 10589us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":512,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":24919,"spinlock_wait_cycles":31271680,"thread_start_us":618858,"threads_started":1,"wal-append.queue_time_us":950781}
I20260709 12:20:05.232901 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.235518 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.235946 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.191581 16470 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:05.236557 13204 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:05.170554 16422 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:05.253890 13840 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:05.252106 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.252790 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.256549 13882 raft_consensus.cc:2368] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
I20260709 12:20:05.201225 16506 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.259068 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.187659 16162 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:20:05.259119 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.259603 13278 raft_consensus.cc:3055] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:05.225004 16457 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:05.262006 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:05.242825 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 45884.9us
I20260709 12:20:05.243659 16483 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.272637 13885 raft_consensus.cc:2410] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:20:05.236320 16293 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:05.273037 13278 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:05.258797 16445 consensus_meta.cc:287] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
I20260709 12:20:05.275848 13206 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:05.243121 16121 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:05.267933 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2731) took 1047 ms. Trace:
I20260709 12:20:05.254587 16312 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.238133 16465 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:05.258761 16435 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.284981 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:05.276028 16457 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:05.305109 13841 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:05.231526 16494 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.306805 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:05.263691 13880 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:05.296416 13207 rpcz_store.cc:276] 0709 12:20:04.220926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.221165 (+   239us) service_pool.cc:224] Handling call
0709 12:20:04.256611 (+ 35446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.693993 (+437382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.694029 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:04.712953 (+ 18924us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.867714 (+154761us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:04.905392 (+ 37678us) log.cc:844] Serialized 14 byte log entry
0709 12:20:05.237658 (+332266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.237730 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:05.237775 (+    45us) raft_consensus.cc:1685] finished
0709 12:20:05.237794 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.267855 (+ 30061us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29733,"prepare.queue_time_us":38586,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":138277,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":12681,"thread_start_us":823020,"threads_started":3,"wal-append.queue_time_us":275402}
I20260709 12:20:05.280231 16470 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:05.299999 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.302848 13278 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.281108 16283 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:05.251883 16430 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.308502 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:05.371444 13277 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
W20260709 12:20:05.296322 16475 consensus_meta.cc:287] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.004s
I20260709 12:20:05.230036 16478 consensus_queue.cc:1059] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:20:05.306826 13841 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:05.300076 16121 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:05.388062 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 81819.6us
I20260709 12:20:05.299719 16510 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:20:05.311821 16294 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.316254 16298 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.313515 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:05.405035 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 91613.5us
I20260709 12:20:05.405503 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.406039 13103 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:05.315853 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.315913 16439 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:05.330155 16466 raft_consensus.cc:3055] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:05.315989 16484 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:05.285730 16293 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.368602 13278 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:05.297329 16506 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:05.376255 13280 raft_consensus.cc:3055] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:20:05.317572 16453 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.776s	user 0.003s	sys 0.003s
I20260709 12:20:05.427100 13280 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:05.399068 16304 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:20:05.392082 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 426504us
I20260709 12:20:05.287949 16483 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:05.365800 16434 log.cc:927] Time spent T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:20:05.312253 16431 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:05.365808 16283 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.397486 13841 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:05.452491 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:05.408624 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:05.408874 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 429422us
I20260709 12:20:05.309734 16317 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:20:05.308610 16465 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.391181 16469 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:05.421031 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:05.421290 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:05.396143 16121 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:05.363725 16445 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:20:05.426162 16294 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:05.471598 13249 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:05.472793 13249 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:05.384996 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 163593us
W20260709 12:20:05.453689 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 56324.9us
I20260709 12:20:05.402803 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:05.473906 13277 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:05.473966 13841 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:05.454803 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 47383.1us
W20260709 12:20:05.460007 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 229612us
I20260709 12:20:05.413164 16439 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:05.412935 16466 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:05.428449 16293 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:05.426970 16312 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:05.428290 16480 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:05.441886 16304 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.389771 16475 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.456498 16283 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:05.478330 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.439510 16490 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:05.463973 16469 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:05.458633 16507 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:05.502172 13249 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:05.507465 13882 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:05.456816 16431 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.456708 16472 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:20:05.515314 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.527007 13204 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:05.527997 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:05.519080 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.519913 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:05.528757 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.528868 13210 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:05.477118 16439 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:05.477525 16512 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:05.530860 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.531170 13884 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:05.484869 16419 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:05.511478 13205 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:05.484674 16383 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:05.495110 16304 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:05.576059 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 73966us
I20260709 12:20:05.532878 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.533226 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.532932 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:05.578884 13204 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:05.579937 16524 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
W20260709 12:20:05.580540 16519 log.cc:927] Time spent T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:20:05.581271 16520 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
W20260709 12:20:05.582909 15935 consensus_meta.cc:287] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.739s	user 0.009s	sys 0.001s
I20260709 12:20:05.583374 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:05.520620 16365 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.585264 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:05.586162 13211 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:20:05.523142 16437 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:20:05.508358 16486 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.596120 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.605535 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.467689 16513 consensus_queue.cc:1059] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:20:05.521870 16507 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:05.526350 16422 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:05.526151 16431 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:05.611044 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.623318 13205 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:05.615646 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:05.522065 16527 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:05.640156 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.644510 13210 raft_consensus.cc:2410] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:20:05.533371 16464 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:05.647086 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:05.651204 16516 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:05.657740 13883 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:20:05.660804 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 131007us
I20260709 12:20:05.622740 16507 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:05.662385 13278 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:05.673400 13879 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEARNER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:05.675675 13252 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:05.523384 16506 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 12:20:05.584311 16383 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.682557 13212 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:05.697261 13252 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:05.721141 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:05.675482 16460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.003s	sys 0.021s
I20260709 12:20:05.723733 13879 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:05.620273 16365 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:05.665437 16430 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:05.751895 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 276047us
W20260709 12:20:05.755277 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 58093.7us
I20260709 12:20:05.754328 13881 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:05.681056 16464 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:05.758155 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:05.760634 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.766422 16490 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:05.680047 16527 raft_consensus.cc:697] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:05.767946 16527 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:05.759357 16472 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:05.769281 16283 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.771849 16125 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.764904 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:05.731917 16460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.003s	sys 0.022s
I20260709 12:20:05.674374 16172 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:05.722697 16497 consensus_meta.cc:287] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 12:20:05.787343 13879 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:05.576233 16466 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:05.829710 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:05.830565 13133 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:05.832635 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:05.721916 16465 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:05.785315 16458 log.cc:927] Time spent T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:20:05.840553 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:05.766486 16515 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:05.854501 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 271209us
I20260709 12:20:05.852877 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:05.720775 16121 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.821798 16243 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:05.888132 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:05.840458 16535 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:05.908236 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:05.909042 13136 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:05.858565 16515 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.861389 16283 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:05.829067 16445 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:20:05.838516 16172 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:05.883153 16494 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:05.918624 16475 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:05.966687 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 174882us
I20260709 12:20:05.894287 16466 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:05.915683 16483 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:05.834827 16497 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:05.858196 16512 raft_consensus.cc:697] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:06.043673 13136 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:05.971463 16515 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:06.050767 13203 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:06.051640 13212 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:06.056974 13210 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:20:06.068261 13136 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:06.040602 16422 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:06.075088 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 45726us
I20260709 12:20:06.080647 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:06.086308 13136 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:06.069437 15995 consensus_meta.cc:287] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 1.006s	user 0.004s	sys 0.009s
I20260709 12:20:06.060544 16487 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:06.082679 16514 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.417s	user 0.001s	sys 0.000s
I20260709 12:20:06.042037 16529 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:20:06.112394 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:06.085146 16494 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:06.128753 13204 consensus_meta.cc:287] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.001s
I20260709 12:20:06.093050 16468 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:06.133770 13204 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:06.132555 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:06.140269 16383 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:06.141146 16550 log.cc:927] Time spent T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:20:06.144475 16172 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:06.146466 16115 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.085s	user 0.004s	sys 0.008s
I20260709 12:20:06.149892 13207 pending_rounds.cc:85] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:20:06.150213 13207 pending_rounds.cc:107] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:20:06.150437 13207 raft_consensus.cc:2889] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:06.151091 16484 consensus_meta.cc:287] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.710s	user 0.000s	sys 0.008s
I20260709 12:20:06.133642 16365 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:06.152165 16485 consensus_meta.cc:287] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.914s	user 0.006s	sys 0.006s
I20260709 12:20:06.152721 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:06.152571 16485 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.153770 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:06.154686 16485 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:06.087584 16422 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.156811 16422 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:06.159826 16538 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 12:20:06.141083 16121 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:06.160575 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 921) took 1253 ms. Trace:
I20260709 12:20:06.161057 13887 rpcz_store.cc:276] 0709 12:20:04.931462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.943715 (+ 12253us) service_pool.cc:224] Handling call
0709 12:20:04.962194 (+ 18479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.962503 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.962540 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:04.970067 (+  7527us) log.cc:844] Serialized 26 byte log entry
0709 12:20:05.398378 (+428311us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:05.398416 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.398495 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:06.160317 (+761822us) raft_consensus.cc:1685] finished
0709 12:20:06.160348 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.160506 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":386598,"threads_started":1,"wal-append.queue_time_us":546362}
I20260709 12:20:06.163273 13209 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:06.164366 16539 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:20:06.162070 16472 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:06.174408 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 61899.3us
W20260709 12:20:06.140455 16540 log.cc:927] Time spent T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:20:06.125324 16243 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.180250 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:06.180989 13133 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
W20260709 12:20:06.174815 16513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.040s	sys 0.033s
I20260709 12:20:06.199672 13887 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:06.140395 16557 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.200764 16557 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.201694 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:06.202898 16557 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:06.185166 16484 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:06.187700 16243 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.203914 13206 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:06.204036 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:06.205065 16544 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.205446 16243 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:06.189338 16546 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:06.189870 16365 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:06.136617 16494 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.207841 16529 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:06.208328 16529 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:06.191361 13133 pending_rounds.cc:85] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 5
I20260709 12:20:06.209525 13133 pending_rounds.cc:107] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 6.6
W20260709 12:20:06.195542 16532 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:20:06.197576 16115 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:06.132795 16468 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:06.215850 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:06.205569 16544 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.192905 16470 raft_consensus.cc:3055] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:06.209968 13133 raft_consensus.cc:2889] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:06.098650 15995 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.212848 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:06.134629 16545 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:06.133338 16487 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.243932 16557 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:06.244920 16497 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:06.248586 13131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1306) took 2063 ms (client timeout 2048 ms). Trace:
I20260709 12:20:06.260571 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1291) took 2080 ms. Trace:
I20260709 12:20:06.265964 13132 rpcz_store.cc:276] 0709 12:20:04.179864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.180071 (+   207us) service_pool.cc:224] Handling call
0709 12:20:05.215518 (+1035447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:05.225340 (+  9822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.256960 (+1031620us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540027ef50. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:06.260502 (+  3542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344171264}
I20260709 12:20:06.266526 16493 raft_consensus.cc:3055] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:06.266923 16493 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:06.265209 13131 rpcz_store.cc:269] 0709 12:20:04.184685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.320647 (+135962us) service_pool.cc:224] Handling call
0709 12:20:06.248367 (+1927720us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400136ad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:06.248484 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655889280}
W20260709 12:20:06.211021 16304 consensus_meta.cc:287] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.002s
W20260709 12:20:06.260859 16500 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 1.142s	user 0.003s	sys 0.006s
I20260709 12:20:06.222710 16468 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:06.257226 16484 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.251012 16545 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:06.261519 16293 consensus_meta.cc:287] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.765s	user 0.011s	sys 0.000s
I20260709 12:20:06.262912 16489 raft_consensus.cc:3055] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:06.263586 16464 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:06.263530 16557 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:06.255232 13175 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.520s (SENT) [suppressed 36 similar messages]
I20260709 12:20:06.209215 16529 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.271243 13878 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:06.267532 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:06.288543 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:06.288645 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:06.265324 16457 consensus_meta.cc:287] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.899s	user 0.009s	sys 0.003s
I20260709 12:20:06.254928 16470 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:06.130635 16512 consensus_queue.cc:237] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.304867 13132 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:06.292894 16545 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:06.297053 16464 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:06.293180 16489 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:06.346004 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:06.290011 16304 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.349704 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:06.294365 16293 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.294028 16484 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.357749 13132 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:20:06.360015 16544 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:06.360725 16431 consensus_meta.cc:287] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 12:20:06.361156 16431 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.362300 13880 raft_consensus.cc:2393] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:06.331923 16493 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.304497 16457 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.363901 16431 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:06.364487 16493 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:06.365622 16557 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:06.356374 16470 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.366467 16470 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:06.368161 15995 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:06.368546 16501 log.cc:927] Time spent T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 1.226s	user 0.001s	sys 0.003s
I20260709 12:20:06.372586 13885 raft_consensus.cc:2368] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
I20260709 12:20:06.373600 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2729) took 2163 ms. Trace:
I20260709 12:20:06.379738 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1855) took 2158 ms. Trace:
I20260709 12:20:06.382120 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:06.374075 13208 rpcz_store.cc:276] 0709 12:20:04.210558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.210684 (+   126us) service_pool.cc:224] Handling call
0709 12:20:04.211130 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.620408 (+409278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.620451 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:04.667027 (+ 46576us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.892873 (+225846us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:04.893209 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.893298 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:06.249935 (+1356637us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:06.369888 (+119953us) raft_consensus.cc:1685] finished
0709 12:20:06.369918 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.373535 (+  3617us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35481,"raft.queue_time_us":82725,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":7002880,"thread_start_us":548149,"threads_started":2,"wal-append.queue_time_us":426196}
I20260709 12:20:06.386682 13132 raft_consensus.cc:2393] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:06.382594 13130 rpcz_store.cc:276] 0709 12:20:04.225014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.736790 (+511776us) service_pool.cc:224] Handling call
0709 12:20:04.780575 (+ 43785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.783163 (+  2588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.783207 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:04.814663 (+ 31456us) log.cc:844] Serialized 26 byte log entry
0709 12:20:05.012102 (+197439us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:05.012227 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.012410 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:06.367925 (+1355515us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:06.376574 (+  8649us) raft_consensus.cc:1685] finished
0709 12:20:06.376606 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.379651 (+  3045us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":10618,"spinlock_wait_cycles":35673856,"thread_start_us":120248,"threads_started":1,"wal-append.queue_time_us":285973}
I20260709 12:20:06.365633 16457 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:06.374351 16504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.004s	sys 0.017s
I20260709 12:20:06.398334 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:06.399360 13130 raft_consensus.cc:2393] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:06.387899 16494 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:06.397817 16439 consensus_meta.cc:287] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.813s	user 0.009s	sys 0.004s
I20260709 12:20:06.405752 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:06.401314 16504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.246s	user 0.004s	sys 0.018s
I20260709 12:20:06.420804 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:06.418216 13132 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:06.446141 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:06.453821 16515 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.455935 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:06.459169 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.459323 13131 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:06.460206 16515 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:06.458545 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:06.461165 13131 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:20:06.461653 13130 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:06.462764 13131 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:20:06.481052 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.420861 16439 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:06.397511 16489 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:06.516855 16293 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:06.536517 13134 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:20:06.537794 16560 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:20:06.539570 16515 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:06.540222 16515 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.542586 16515 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:06.544516 13137 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:06.545657 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:06.545846 13129 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:20:06.546317 13279 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:06.490871 16487 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:06.555780 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:06.556560 13278 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:06.518924 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 303444us
W20260709 12:20:06.558000 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.560210 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:06.568264 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 313047us
I20260709 12:20:06.572662 13249 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:06.577317 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:06.578078 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:06.578200 13284 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:20:06.586454 13278 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:06.596503 16546 consensus_queue.cc:1059] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:06.597395 16546 consensus_queue.cc:1243] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer cbc6af7757ec459ab451e47724fdf44b log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:06.598017 16347 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:06.598542 16347 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.600498 16347 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:06.600556 16439 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:06.601686 16476 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:20:06.604499 16507 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.924s	user 0.010s	sys 0.002s
I20260709 12:20:06.604943 16507 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.605485 16464 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.566673 16304 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:06.607651 13882 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:06.608160 16464 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:06.577409 16472 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:06.608857 16507 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:06.589564 16115 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:06.616443 16545 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.616569 13280 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.617897 13280 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:06.618628 16545 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:06.574225 16484 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:06.588747 16489 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:06.623099 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 200275us
I20260709 12:20:06.625170 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:06.625680 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:06.626147 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.626276 13132 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
W20260709 12:20:06.627544 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 58097.2us
I20260709 12:20:06.627787 13206 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:06.629812 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:06.630461 13211 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:20:06.576987 16293 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.632830 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:06.634827 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:06.635341 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:06.636065 13205 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:06.640739 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:06.641546 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:06.641690 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:06.642222 13209 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
W20260709 12:20:06.623507 16466 consensus_meta.cc:287] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.001s
I20260709 12:20:06.647858 13103 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:06.645375 16484 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:06.650795 13175 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:06.650980 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:06.653004 13284 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:06.655053 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:06.655689 13281 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 4.
W20260709 12:20:06.657233 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.646216 16515 consensus_queue.cc:1059] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:20:06.658917 16515 raft_consensus.cc:3055] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:06.659243 16515 raft_consensus.cc:740] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:06.644107 16293 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.660087 16515 consensus_queue.cc:260] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.661409 16515 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:06.662194 16293 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:06.662724 16172 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.662926 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:06.630260 16125 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:20:06.663252 16172 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:06.630648 16472 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:20:06.665184 16472 raft_consensus.cc:3055] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:06.665446 16172 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:20:06.665620 16472 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:06.667269 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:06.667894 13211 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:06.668738 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:06.671799 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:06.672463 13205 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:20:06.672950 16466 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.663530 13212 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:06.673720 16466 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.629812 16439 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:20:06.677531 16544 consensus_queue.cc:1059] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:06.679024 16543 raft_consensus.cc:3055] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:06.655248 13286 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:06.679374 16543 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:06.680775 16543 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.681954 16543 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:06.686167 13131 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:20:06.687758 13175 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:06.691233 13212 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:06.691248 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:06.694182 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:06.670573 16469 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.692546 13175 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:06.695477 13841 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:06.704617 13211 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:06.696460 13879 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:06.694998 13838 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:06.708259 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:06.709194 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:06.709359 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:06.709853 13886 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:06.710012 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:06.710584 13280 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:20:06.711413 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 549) took 1399 ms. Trace:
I20260709 12:20:06.710070 13284 raft_consensus.cc:2410] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:20:06.696976 13206 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
W20260709 12:20:06.698814 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.693133 16295 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:06.712044 13280 rpcz_store.cc:276] 0709 12:20:05.312030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.312332 (+   302us) service_pool.cc:224] Handling call
0709 12:20:05.376096 (+ 63764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.616259 (+1240163us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54003ea1a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e0b06f 00007f70f4e83f60 00007f70f4e857de 00007f70f4e8fb49 00007f70f4e90416 00007f70f4e8cd8f 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62
0709 12:20:06.710945 (+ 94686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.711333 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707526528}
I20260709 12:20:06.703590 13286 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:06.713331 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.714869 13838 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:06.716482 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:06.721295 13206 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:06.717401 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:06.675911 16466 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:06.724848 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:06.724380 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:06.726769 13880 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:06.726317 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:06.723088 13103 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:06.735369 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:06.666703 16472 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.741034 13252 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:06.724342 13841 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:06.735363 16487 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:06.695719 16504 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:06.695964 16554 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:06.749295 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:06.753135 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.646288 16527 consensus_queue.cc:1059] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:20:06.717360 16462 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:06.711062 16365 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.764217 13205 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
W20260709 12:20:06.769091 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.717123 16495 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:06.672926 16484 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.736013 16347 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:06.929749 16504 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:06.930732 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:06.931871 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:06.933030 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 631) took 1626 ms. Trace:
I20260709 12:20:06.933583 13131 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:20:06.934146 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:06.760499 16507 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:06.925819 16468 consensus_meta.cc:287] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.633s	user 0.001s	sys 0.010s
I20260709 12:20:06.925455 16365 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.960326 13882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 930) took 1475 ms. Trace:
I20260709 12:20:06.960487 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:06.960754 13882 rpcz_store.cc:276] 0709 12:20:05.484983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.522535 (+ 37552us) service_pool.cc:224] Handling call
0709 12:20:05.522793 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.608070 (+1085277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.960111 (+352041us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54004b8054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:06.960270 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2494470016}
I20260709 12:20:06.961295 13132 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:06.926296 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:06.963232 16293 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:06.963713 13283 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:06.926859 16115 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:06.968082 16115 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.970122 16115 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:06.928764 16484 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:06.749169 16439 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.972918 16439 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.745054 16466 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.926860 13205 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:06.933382 13885 rpcz_store.cc:276] 0709 12:20:05.306795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.315518 (+  8723us) service_pool.cc:224] Handling call
0709 12:20:06.932838 (+1617320us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b540056ac54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:06.932971 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218185472}
I20260709 12:20:06.743271 16497 consensus_queue.cc:1059] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.193s
I20260709 12:20:06.769698 16570 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:06.959508 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:07.019517 16115 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:20:07.019676 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 60276.1us
I20260709 12:20:07.020067 16115 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.020571 16115 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:07.020865 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:07.022634 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:06.975478 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 234489us
I20260709 12:20:07.024385 13252 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:06.984784 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1532) took 1460 ms. Trace:
I20260709 12:20:06.938020 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:06.763540 16470 consensus_queue.cc:1059] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.214s
I20260709 12:20:06.886915 16462 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.989861 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:06.941658 16464 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:07.001672 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 635) took 1506 ms. Trace:
I20260709 12:20:07.046942 13878 rpcz_store.cc:276] 0709 12:20:05.495303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.515771 (+ 20468us) service_pool.cc:224] Handling call
0709 12:20:07.001383 (+1485612us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54005f0354. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:07.001592 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592346496}
I20260709 12:20:07.027853 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:07.048120 13278 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:07.049239 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:07.049901 13132 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:07.050364 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:07.050989 13278 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:06.736831 16295 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:06.744002 16518 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.192s
W20260709 12:20:07.027596 16500 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:20:07.040261 16546 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:07.040731 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:07.086211 13286 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:06.760119 16503 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.217s
W20260709 12:20:07.040675 13130 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.018s	sys 0.049s
I20260709 12:20:06.940160 16472 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:07.026731 13210 rpcz_store.cc:276] 0709 12:20:05.524645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.651788 (+127143us) service_pool.cc:224] Handling call
0709 12:20:05.652674 (+   886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.062680 (+410006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.984346 (+921666us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54000726d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:06.984704 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928802688}
W20260709 12:20:07.095737 13130 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.018s	sys 0.049s
I20260709 12:20:06.963120 16365 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:06.884362 16125 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 12:20:06.939708 16347 raft_consensus.cc:697] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:06.938516 16516 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:06.954480 16495 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:06.975128 16439 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:07.017902 16466 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:06.963721 16293 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:06.994582 16507 raft_consensus.cc:697] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:07.076491 16470 consensus_queue.cc:1243] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:20:07.080595 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 334393us
W20260709 12:20:07.092357 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 102600us
W20260709 12:20:07.096213 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.017139 16570 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.119833 13283 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:20:07.037901 13249 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:07.047729 16462 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:06.988958 16468 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:07.102173 13279 consensus_meta.cc:287] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.002s
I20260709 12:20:06.991850 16484 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.149755 16484 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:07.150998 16489 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.000s
I20260709 12:20:07.123135 16570 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:07.151974 16484 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:07.065838 16513 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:07.112959 16495 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:07.153218 16513 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:07.153730 16513 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:07.153543 16495 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:07.116552 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.116428 13177 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:07.154662 16513 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:07.155771 16507 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.121156 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:07.101625 16542 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:20:07.123785 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 86009.7us
I20260709 12:20:07.166180 13249 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:07.167651 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 51285.9us
I20260709 12:20:07.168514 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:07.125149 13838 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:07.127722 13278 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:07.131819 16295 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:07.134480 13279 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:07.105979 16365 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:07.149160 16468 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:07.114485 16503 raft_consensus.cc:3055] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:07.065459 16554 consensus_queue.cc:1059] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:20:07.068326 16464 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.169714 13886 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:07.171100 16487 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:07.171854 16489 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:07.146636 16586 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:20:07.168501 13177 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:07.200821 13282 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:07.215862 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 47458.5us
I20260709 12:20:07.217083 13177 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:20:07.186107 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 61046.6us
I20260709 12:20:07.174230 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:07.172324 16573 log.cc:927] Time spent T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:20:07.223526 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:07.107767 16516 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.205013 16494 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:07.233207 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:07.245731 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:07.246731 13283 raft_consensus.cc:2393] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:07.225347 16512 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:07.166260 16542 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:07.205241 16503 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:07.216084 16543 consensus_meta.cc:287] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 12:20:07.267727 16243 raft_consensus.cc:3055] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:07.268263 16243 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:07.269378 16243 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:07.270363 16243 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:07.247707 16347 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.250327 16489 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:07.275207 16489 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:07.276342 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:07.247363 16487 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:07.279613 16503 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.279887 16487 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:07.155798 16293 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:07.231946 16470 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:07.284102 16470 raft_consensus.cc:697] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:07.285027 16470 consensus_queue.cc:237] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:07.231158 16515 consensus_meta.cc:287] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.005s
I20260709 12:20:07.231710 16435 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:07.288067 16435 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:07.288425 16435 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:07.289534 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:07.290377 13282 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:07.291621 16172 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:07.291703 13177 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:07.292270 16172 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.293327 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1861) took 1210 ms. Trace:
I20260709 12:20:07.293835 13133 rpcz_store.cc:276] 0709 12:20:06.083363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.190752 (+107389us) service_pool.cc:224] Handling call
0709 12:20:06.191160 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.250509 (+ 59349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.250556 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.258770 (+  8214us) log.cc:844] Serialized 26 byte log entry
0709 12:20:06.428733 (+169963us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:06.428786 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.428876 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.293054 (+864178us) raft_consensus.cc:1685] finished
0709 12:20:07.293082 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.293252 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":166852,"threads_started":1,"wal-append.queue_time_us":782432}
I20260709 12:20:07.296614 13280 raft_consensus.cc:2410] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:20:07.260951 16542 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:07.294857 16526 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:20:07.312806 13136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.000s	sys 0.042s
W20260709 12:20:07.313216 13136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.000s	sys 0.042s
I20260709 12:20:07.326305 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:07.246014 13279 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:07.327737 13282 raft_consensus.cc:2410] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:20:07.279892 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:07.328926 13283 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:07.334764 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:07.351234 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:07.355005 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:07.313063 16526 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.328926 16544 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:07.355468 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:07.328413 16503 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:07.330533 16293 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:07.329020 16468 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.334635 16515 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:07.362764 13284 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.019s	sys 0.028s
W20260709 12:20:07.354924 16593 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:20:07.340593 16512 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:07.361794 16526 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:07.358563 16494 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:07.371223 13841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.018s	sys 0.015s
W20260709 12:20:07.368623 13840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.011s	sys 0.022s
W20260709 12:20:07.369690 13284 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.019s	sys 0.028s
W20260709 12:20:07.394851 13841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.019s	sys 0.015s
W20260709 12:20:07.395231 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 671824us
I20260709 12:20:07.395958 13841 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:07.396345 13175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.012s
W20260709 12:20:07.396533 13840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.011s	sys 0.023s
W20260709 12:20:07.396690 13175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.008s	sys 0.012s
W20260709 12:20:07.396963 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 626758us
W20260709 12:20:07.397253 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 647981us
I20260709 12:20:07.408607 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:07.398805 13211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.011s	sys 0.012s
W20260709 12:20:07.411360 13211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.011s	sys 0.012s
W20260709 12:20:07.380764 16557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.005s	sys 0.027s
W20260709 12:20:07.413491 16557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.005s	sys 0.027s
I20260709 12:20:07.414332 16295 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:20:07.453320 16115 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.456259 13283 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:07.462622 13286 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:07.464048 16115 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:07.464191 16546 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:07.465346 16469 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:07.466918 16172 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:07.381193 16512 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.468164 16523 raft_consensus.cc:3055] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:07.468572 16523 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:07.469143 16365 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:07.469897 16512 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:07.471853 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:07.472496 13286 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:07.408607 13841 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:07.469529 16523 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.371351 16468 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:07.473789 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 65251us
W20260709 12:20:07.480723 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.376871 16515 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.407275 16466 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:07.488837 13177 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:07.484654 13839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.006s	sys 0.018s
W20260709 12:20:07.494419 13839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.006s	sys 0.019s
W20260709 12:20:07.486460 13100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.025s	sys 0.022s
I20260709 12:20:07.417208 16304 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:07.483915 13841 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:07.495373 13100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.025s	sys 0.022s
W20260709 12:20:07.521977 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 757733us
I20260709 12:20:07.523836 13175 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:07.405210 16462 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.518489 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 566) took 1744 ms. Trace:
I20260709 12:20:07.518236 16512 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.531675 16523 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:07.530405 13128 rpcz_store.cc:276] 0709 12:20:05.774133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.775604 (+  1471us) service_pool.cc:224] Handling call
0709 12:20:05.835341 (+ 59737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.071645 (+236304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.071916 (+   271us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.085764 (+ 13848us) log.cc:844] Serialized 26 byte log entry
0709 12:20:06.392320 (+306556us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:07.485175 (+1092855us) spinlock_profiling.cc:243] Waited 9.91 ms on lock 0x7b1800472a80. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f4a354bc 00007f70f1d8348b 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9d455 00007f70f88853c7 00007f70f4e979a7 00007f70f4ea70bf
0709 12:20:07.488866 (+  3691us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.491678 (+  2812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.491780 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.491835 (+    55us) raft_consensus.cc:1685] finished
0709 12:20:07.518215 (+ 26380us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.518420 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36068,"prepare.queue_time_us":152143,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":10789,"raft.queue_time_us":231480,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":44927,"spinlock_wait_cycles":22787456,"thread_start_us":642250,"threads_started":3,"wal-append.queue_time_us":379651}
I20260709 12:20:07.531741 16512 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:07.473754 16516 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:07.518422 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:07.533309 13286 raft_consensus.cc:2393] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:07.534063 16512 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:07.534610 16431 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:07.535084 16431 raft_consensus.cc:697] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:07.536320 13286 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: [3.2-6.3]
I20260709 12:20:07.536702 16515 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:07.519797 13206 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.011s	sys 0.040s
W20260709 12:20:07.538264 13206 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.011s	sys 0.040s
I20260709 12:20:07.535980 16431 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.540877 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:20:07.561838 13203 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.033s	sys 0.026s
I20260709 12:20:07.526139 13175 leader_election.cc:400] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
I20260709 12:20:07.561116 13279 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:07.563400 13175 leader_election.cc:403] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:07.564150 13134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.024s	sys 0.070s
W20260709 12:20:07.565296 13134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.024s	sys 0.071s
I20260709 12:20:07.462710 16570 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:07.565841 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:07.529220 16172 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:07.574347 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:07.562338 13203 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.033s	sys 0.026s
I20260709 12:20:07.577165 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:07.577931 13135 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:07.569229 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:07.571455 13129 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:07.405552 16494 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.573594 13131 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:07.584705 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:07.585738 13128 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 5: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:07.410439 16598 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.136s
W20260709 12:20:07.568109 13102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.010s	sys 0.020s
I20260709 12:20:07.561417 16304 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:07.588981 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:07.591001 13102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.010s	sys 0.020s
I20260709 12:20:07.591688 13131 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:07.591676 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:07.593014 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.570248 16527 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:07.596766 16304 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:07.606463 13209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.028s	sys 0.060s
W20260709 12:20:07.607084 13209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.029s	sys 0.061s
I20260709 12:20:07.576808 16172 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:07.569448 16441 consensus_queue.cc:1059] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:20:07.616842 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.589587 16464 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:07.630070 13252 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.017s	sys 0.016s
W20260709 12:20:07.633047 13252 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.017s	sys 0.017s
W20260709 12:20:07.643364 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:07.662467 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 638110us
I20260709 12:20:07.617425 16445 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:07.620039 13103 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.019s	sys 0.038s
W20260709 12:20:07.628458 13277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.007s	sys 0.031s
W20260709 12:20:07.628521 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.620663 16172 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:07.675861 13103 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.020s	sys 0.038s
W20260709 12:20:07.676066 13277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.007s	sys 0.031s
W20260709 12:20:07.684985 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 750356us
I20260709 12:20:07.687364 13252 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:07.690475 13102 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:07.688025 13103 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:07.632285 16527 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:07.697268 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:07.725296 13252 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:07.727255 16512 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:07.732358 16462 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:07.732581 16527 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.684993 16452 raft_consensus.cc:3055] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:07.628943 13135 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:07.661118 16524 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 12:20:07.744983 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.722067 16480 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:07.760529 13130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.003s	sys 0.042s
I20260709 12:20:07.725800 16518 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:07.763545 13130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.004s	sys 0.043s
I20260709 12:20:07.735416 16464 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:07.686786 16445 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:07.766911 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1865) took 1652 ms. Trace:
I20260709 12:20:07.780349 13130 rpcz_store.cc:276] 0709 12:20:06.114928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.489396 (+374468us) service_pool.cc:224] Handling call
0709 12:20:06.538176 (+ 48780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.538387 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:07.096170 (+557783us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.766471 (+670301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.766539 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:07.766607 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.766691 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.766841 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38606,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"thread_start_us":1227411,"threads_started":2}
I20260709 12:20:07.740880 16452 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:07.748368 16602 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:07.761112 16557 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:07.787252 16605 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:07.809734 16125 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
W20260709 12:20:07.778473 16559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.008s	sys 0.022s
I20260709 12:20:07.779882 16518 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.767104 16599 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
W20260709 12:20:07.893839 13285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.010s	sys 0.027s
W20260709 12:20:07.894351 13285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.010s	sys 0.028s
W20260709 12:20:07.886785 16592 log.cc:927] Time spent T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.299s	user 0.000s	sys 0.007s
I20260709 12:20:07.879894 16604 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:07.901818 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1921) took 1348 ms. Trace:
W20260709 12:20:07.889079 16559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.008s	sys 0.022s
W20260709 12:20:07.891742 16595 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.149s	user 0.004s	sys 0.003s
I20260709 12:20:07.890419 16570 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:07.895273 16515 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:07.915163 16506 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.142s	user 0.021s	sys 0.026s
I20260709 12:20:07.910900 16494 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:07.886745 16557 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:07.912254 13285 rpcz_store.cc:276] 0709 12:20:06.552996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.554154 (+  1158us) service_pool.cc:224] Handling call
0709 12:20:06.574084 (+ 19930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.574300 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:07.083179 (+508879us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.894873 (+811694us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.894940 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:07.894996 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.901552 (+  6556us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.901746 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":829792,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":483,"thread_start_us":1300130,"threads_started":2}
I20260709 12:20:07.962280 16497 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:20:07.963805 13885 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.007s	sys 0.007s
I20260709 12:20:07.930327 16524 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:07.948756 16506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.194s	user 0.021s	sys 0.026s
W20260709 12:20:07.981256 13885 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.007s	sys 0.007s
I20260709 12:20:07.945407 16604 raft_consensus.cc:2764] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:20:08.009335 13282 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.011s	sys 0.038s
W20260709 12:20:08.016705 13282 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.011s	sys 0.038s
W20260709 12:20:07.996717 16495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.010s	sys 0.037s
W20260709 12:20:07.980630 16489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.011s	sys 0.004s
I20260709 12:20:07.950549 16125 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:07.969558 16487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.004s	sys 0.010s
W20260709 12:20:08.017551 13878 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.020s	sys 0.028s
W20260709 12:20:07.995648 16545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.009s	sys 0.008s
I20260709 12:20:07.980830 16497 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:08.029980 13878 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.021s	sys 0.028s
I20260709 12:20:08.031474 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:07.897575 16452 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:08.023176 16513 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.005s	sys 0.014s
I20260709 12:20:08.061607 13285 raft_consensus.cc:2376] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5. Re-sending same reply.
W20260709 12:20:08.032349 16487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.004s	sys 0.010s
W20260709 12:20:08.030680 16495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.010s	sys 0.037s
W20260709 12:20:08.027783 16507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.000s	sys 0.019s
W20260709 12:20:08.032573 16489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.012s	sys 0.004s
W20260709 12:20:08.066316 16347 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.008s	sys 0.012s
I20260709 12:20:08.028579 16445 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:08.061141 16513 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.005s	sys 0.014s
W20260709 12:20:08.034989 16545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.009s	sys 0.008s
W20260709 12:20:08.035719 16526 consensus_meta.cc:287] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.001s
W20260709 12:20:08.070739 16470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.001s	sys 0.048s
I20260709 12:20:08.076113 16512 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:08.083151 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.008936 16524 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:08.074926 16469 consensus_meta.cc:287] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.005s
W20260709 12:20:08.106285 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:08.073742 16507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.000s	sys 0.019s
I20260709 12:20:08.098754 16452 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:08.106591 16470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.001s	sys 0.048s
W20260709 12:20:08.117475 13839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.001s	sys 0.022s
I20260709 12:20:08.045818 16125 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:08.109687 16542 consensus_meta.cc:287] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.011s
W20260709 12:20:08.112881 16435 consensus_meta.cc:287] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.011s
I20260709 12:20:08.105846 16612 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:08.102929 16347 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.009s	sys 0.013s
W20260709 12:20:08.123903 13211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.006s	sys 0.015s
W20260709 12:20:08.135977 13211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.006s	sys 0.015s
W20260709 12:20:08.124452 13210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.009s	sys 0.012s
W20260709 12:20:08.124763 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.113938 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:08.115067 16243 consensus_meta.cc:287] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.842s	user 0.013s	sys 0.009s
I20260709 12:20:08.112665 16554 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:08.132764 13284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.011s	sys 0.009s
W20260709 12:20:08.140568 13284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.011s	sys 0.009s
W20260709 12:20:08.117940 13839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.001s	sys 0.022s
W20260709 12:20:08.142364 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.138517 13285 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
W20260709 12:20:08.143872 13178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.013s	sys 0.014s
W20260709 12:20:08.145830 13178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.014s	sys 0.015s
I20260709 12:20:08.149240 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:08.148895 13175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.006s	sys 0.023s
I20260709 12:20:08.110136 16526 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:08.106700 16583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.014s	sys 0.029s
I20260709 12:20:08.126580 16556 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:20:08.166119 16613 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:20:08.167320 13841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.015s	sys 0.012s
W20260709 12:20:08.167737 13841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.015s	sys 0.012s
I20260709 12:20:08.141402 16570 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.123590 16524 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:08.126140 16518 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:08.160179 13203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.013s	sys 0.013s
I20260709 12:20:08.157719 16243 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:08.191943 13203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.013s	sys 0.013s
W20260709 12:20:08.151222 13175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.006s	sys 0.023s
W20260709 12:20:08.141908 13210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.010s	sys 0.012s
I20260709 12:20:08.115917 16512 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.141654 16441 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:08.134783 16435 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.141631 16558 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:08.115223 16497 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.148887 16608 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.148609 16604 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:08.219997 13103 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.025s
I20260709 12:20:08.156780 13285 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:08.216984 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:08.221359 13103 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.000s	sys 0.025s
I20260709 12:20:08.221489 13206 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:08.221859 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 533909us
I20260709 12:20:08.157300 16347 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:08.197399 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2764) took 1468 ms. Trace:
I20260709 12:20:08.226207 13203 rpcz_store.cc:276] 0709 12:20:06.729203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.932723 (+203520us) service_pool.cc:224] Handling call
0709 12:20:06.933034 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.933217 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:07.576492 (+643275us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.197027 (+620535us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:08.197078 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:08.197119 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.197198 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.197327 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7290,"prepare.queue_time_us":42913,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":5373,"raft.queue_time_us":3638,"spinlock_wait_cycles":4221312,"thread_start_us":1258539,"threads_started":2}
W20260709 12:20:08.200294 13132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.013s	sys 0.017s
I20260709 12:20:08.156123 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2735) took 1441 ms. Trace:
W20260709 12:20:08.193262 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 624060us
I20260709 12:20:08.166927 16556 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:08.229635 13284 rpcz_store.cc:276] 0709 12:20:06.714262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.714690 (+   428us) service_pool.cc:224] Handling call
0709 12:20:06.724098 (+  9408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.724289 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:07.394813 (+670524us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.155624 (+760811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:08.155707 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:08.155783 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.155878 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.156043 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1679,"prepare.queue_time_us":717910,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":14442,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5234,"thread_start_us":1416049,"threads_started":2}
I20260709 12:20:08.231782 16556 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:08.233095 16556 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:08.164435 16606 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:08.234251 16606 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.148571 16554 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:08.124486 16542 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:08.164624 16583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.016s	sys 0.031s
W20260709 12:20:08.209779 13102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.019s
I20260709 12:20:08.217562 13880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b675043435441bb980d9a219c4d3450"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:20:08.245303 13880 raft_consensus.cc:606] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:20:08.245697 13880 raft_consensus.cc:614] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:08.242419 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.198760 16484 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:08.247537 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:08.248858 13102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.005s	sys 0.020s
W20260709 12:20:08.249372 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 556663us
I20260709 12:20:08.238188 13210 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: [6.5-7.6]
I20260709 12:20:08.204559 16557 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:08.251734 13102 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:08.252781 13132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.013s	sys 0.017s
I20260709 12:20:08.256383 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:08.257169 13210 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:08.260694 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:08.236366 16472 consensus_meta.cc:287] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.134s	user 0.013s	sys 0.007s
I20260709 12:20:08.141883 16612 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:08.192517 16570 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:08.264777 13886 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEARNER]: Advancing to term 8
I20260709 12:20:08.217165 16518 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:08.266814 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:08.267724 13882 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:08.269492 13212 raft_consensus.cc:2393] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:08.271961 13281 raft_consensus.cc:2410] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:08.251788 16497 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:08.203572 16243 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:08.244720 16470 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:08.285560 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:08.277917 13285 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
W20260709 12:20:08.295475 13134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.015s	sys 0.009s
I20260709 12:20:08.295571 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:08.305635 13285 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:20:08.308108 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:08.311148 13135 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:08.313329 13177 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:08.313350 13131 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:08.262116 16599 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:08.296176 13134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.015s	sys 0.009s
I20260709 12:20:08.271896 16557 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:08.323633 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.326872 13100 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:08.333642 13285 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:20:08.245829 16347 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.206118 16441 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:08.335003 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 396434us
I20260709 12:20:08.352617 13129 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:20:08.294298 16478 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:08.337173 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:08.362905 13128 raft_consensus.cc:2410] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:20:08.365526 13252 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:08.366912 16472 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:08.371048 16615 log.cc:927] Time spent T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:20:08.344785 13206 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:08.357962 13285 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:08.224591 16608 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:08.209168 16558 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:08.236500 16604 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:08.372291 16623 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:20:08.372354 13137 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:20:08.338272 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:08.351926 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:08.404280 13210 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
W20260709 12:20:08.354113 16594 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:20:08.381057 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:08.382354 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:08.383846 13841 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:08.282275 16518 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.324473 16470 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.326766 16503 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:08.381193 16506 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.390203 16243 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:08.393281 16640 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:08.386829 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.394830 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 552) took 1460 ms. Trace:
W20260709 12:20:08.381341 16614 log.cc:927] Time spent T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:20:08.395888 16606 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:08.377100 16633 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:08.424758 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:08.517928 13137 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
W20260709 12:20:08.397109 16596 log.cc:927] Time spent T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.697s	user 0.000s	sys 0.002s
I20260709 12:20:08.397919 16445 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:08.398679 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 563) took 1440 ms. Trace:
I20260709 12:20:08.381628 16125 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:08.399595 13286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.034s	sys 0.066s
W20260709 12:20:08.551753 13286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.034s	sys 0.066s
I20260709 12:20:08.552675 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1933) took 1332 ms. Trace:
I20260709 12:20:08.521485 16632 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:08.556013 16347 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:08.557471 13280 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2739) took 1631 ms (client timeout 1994 ms). Trace:
I20260709 12:20:08.557953 13134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1337) took 1630 ms. Trace:
W20260709 12:20:08.557899 13280 rpcz_store.cc:269] 0709 12:20:06.926109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.931678 (+  5569us) service_pool.cc:224] Handling call
0709 12:20:08.557222 (+1625544us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540023bc54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:08.557380 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836715904}
I20260709 12:20:08.559787 13136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1336) took 2344 ms. Trace:
I20260709 12:20:08.558705 13134 rpcz_store.cc:276] 0709 12:20:06.927215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.931607 (+  4392us) service_pool.cc:224] Handling call
0709 12:20:06.931917 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:07.567605 (+635688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.567651 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:07.568214 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:20:08.316646 (+748432us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:08.316706 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.316804 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:08.557688 (+240884us) raft_consensus.cc:1685] finished
0709 12:20:08.557718 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.557877 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39045,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":1286251,"threads_started":2,"wal-append.queue_time_us":893654}
I20260709 12:20:08.560212 13136 rpcz_store.cc:276] 0709 12:20:06.215173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.519725 (+304552us) service_pool.cc:224] Handling call
0709 12:20:06.520182 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.558642 (+ 38460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.558680 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.592226 (+ 33546us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.313702 (+721476us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:07.313759 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.313856 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:08.396496 (+1082640us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:08.559505 (+163009us) raft_consensus.cc:1685] finished
0709 12:20:08.559525 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.559727 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54488448,"thread_start_us":621483,"threads_started":1,"wal-append.queue_time_us":994761}
I20260709 12:20:08.342537 16557 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.442806 13883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:20:08.562415 13883 raft_consensus.cc:606] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:08.408648 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.562899 16243 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:08.563731 16557 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:08.450795 13278 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:08.473482 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:08.474164 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 90428.9us
I20260709 12:20:08.473803 13279 rpcz_store.cc:276] 0709 12:20:06.934268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.335666 (+401398us) service_pool.cc:224] Handling call
0709 12:20:07.335986 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.563872 (+227886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.394575 (+830703us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54002756d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:08.394766 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465267456}
I20260709 12:20:08.469599 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 561) took 1511 ms. Trace:
W20260709 12:20:08.562423 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 87924.6us
I20260709 12:20:08.563727 16243 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.565102 16478 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:08.567488 16478 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:08.568538 16243 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:08.568698 13282 rpcz_store.cc:276] 0709 12:20:06.957966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.343830 (+385864us) service_pool.cc:224] Handling call
0709 12:20:07.344213 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.344472 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:08.025103 (+680631us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.469094 (+443991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:08.469171 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:08.469234 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.469331 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.469515 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":98031,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":142,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":48872,"thread_start_us":1106288,"threads_started":2}
I20260709 12:20:08.571045 13282 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:20:08.573163 16622 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
I20260709 12:20:08.574579 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 631) took 1048 ms. Trace:
W20260709 12:20:08.565318 16172 consensus_meta.cc:287] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.001s
I20260709 12:20:08.482440 13886 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:08.576297 16468 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:08.576678 16172 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.578145 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1918) took 3051 ms. Trace:
I20260709 12:20:08.564605 16445 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.578785 16445 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:08.579890 16172 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:08.578596 13277 rpcz_store.cc:276] 0709 12:20:05.527161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.527290 (+   129us) service_pool.cc:224] Handling call
0709 12:20:05.527619 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:05.837479 (+309860us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:05.882838 (+ 45359us) log.cc:844] Serialized 14 byte log entry
0709 12:20:06.577717 (+694879us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b180035f620. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d23a 00007f70f4e97a2a
0709 12:20:07.685267 (+1107550us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.685510 (+   243us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:07.686092 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.686271 (+   179us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:07.686318 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.577780 (+891462us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54000e6d54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:08.577852 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:08.577920 (+    68us) raft_consensus.cc:1685] finished
0709 12:20:08.577939 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.578096 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85019,"prepare.queue_time_us":44233,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":10871,"raft.queue_time_us":187341,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":17672,"spinlock_wait_cycles":605200512,"thread_start_us":1105776,"threads_started":2,"wal-append.queue_time_us":1494001}
W20260709 12:20:08.581806 16637 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.209s	user 0.001s	sys 0.001s
W20260709 12:20:08.424121 16304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.005s	sys 0.018s
W20260709 12:20:08.582535 16304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.008s	sys 0.018s
I20260709 12:20:08.575260 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:08.576179 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:08.514096 13133 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:08.421766 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 739) took 1198 ms. Trace:
I20260709 12:20:08.522571 13283 rpcz_store.cc:276] 0709 12:20:06.958587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.350571 (+391984us) service_pool.cc:224] Handling call
0709 12:20:07.363535 (+ 12964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.456763 (+ 93228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.398456 (+941693us) spinlock_profiling.cc:243] Waited 92.5 ms on lock 0x7b54002dafd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:08.398622 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212640128}
W20260709 12:20:08.415374 16312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.432s	user 0.005s	sys 0.022s
I20260709 12:20:08.425778 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 741) took 1094 ms. Trace:
W20260709 12:20:08.525089 16630 log.cc:927] Time spent T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:08.524931 16542 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:08.526176 16518 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:08.526396 16293 consensus_meta.cc:287] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.160s	user 0.007s	sys 0.006s
I20260709 12:20:08.424154 16487 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:08.528043 16626 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:20:08.528921 13285 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 4. Current term is 5. Ops: []
W20260709 12:20:08.531374 16621 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:20:08.531821 16441 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:08.432127 16544 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:08.532233 16624 log.cc:927] Time spent T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:20:08.534780 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 627) took 1869 ms. Trace:
I20260709 12:20:08.636714 13209 rpcz_store.cc:276] 0709 12:20:06.665541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.669666 (+  4125us) service_pool.cc:224] Handling call
0709 12:20:06.670012 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.670358 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:06.670690 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.614853 (+944163us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.795282 (+180429us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b180032aa00. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9d455 00007f70f4e85060 00007f70f4e97716 00007f70f4ea8287 00007f70f4ea8208
0709 12:20:08.273064 (+477782us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:08.273855 (+   791us) log.cc:844] Serialized 26 byte log entry
0709 12:20:08.282993 (+  9138us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:08.283050 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.283161 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:08.534477 (+251316us) raft_consensus.cc:1685] finished
0709 12:20:08.534508 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.534701 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2139,"prepare.queue_time_us":266,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":266093,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":6841,"spinlock_wait_cycles":29571328,"thread_start_us":1414021,"threads_started":2,"wal-append.queue_time_us":1298348}
I20260709 12:20:08.536468 16608 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:08.431763 15995 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:08.536710 16558 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:08.537072 16633 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:08.464423 16435 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:08.516865 16506 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:08.538715 16604 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:08.540030 16470 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:08.471014 16503 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.544167 16612 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:08.545878 16512 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:08.545912 16635 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.547138 16570 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:08.553046 13286 rpcz_store.cc:276] 0709 12:20:07.219979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.537098 (+317119us) service_pool.cc:224] Handling call
0709 12:20:07.537360 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.537560 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:07.537835 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.552260 (+1014425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:08.552326 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:08.552381 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.552454 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.552607 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23216,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":3078,"raft.queue_time_us":1152,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":80,"thread_start_us":1014036,"threads_started":1}
I20260709 12:20:08.334641 16599 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:08.393632 16472 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:08.589846 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:08.681113 13278 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:08.574931 13207 rpcz_store.cc:276] 0709 12:20:07.526007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.526164 (+   157us) service_pool.cc:224] Handling call
0709 12:20:07.526515 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.574923 (+ 48408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.574955 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.574997 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:07.575028 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.574363 (+999335us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b54002a17d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:08.574402 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.574526 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110815616}
I20260709 12:20:08.684227 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.685101 13207 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:08.686218 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.592311 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:08.592999 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:08.575771 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:08.587658 13878 rpcz_store.cc:276] 0709 12:20:07.223388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.330545 (+107157us) service_pool.cc:224] Handling call
0709 12:20:07.355084 (+ 24539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.355287 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:08.065817 (+710530us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.421321 (+355504us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:08.421389 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:08.421451 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.421540 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.421691 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13967,"prepare.queue_time_us":889822,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":2586,"raft.queue_time_us":2768,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":12807,"spinlock_wait_cycles":72192,"thread_start_us":1051792,"threads_started":2}
I20260709 12:20:08.606005 13885 rpcz_store.cc:276] 0709 12:20:07.331365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.331526 (+   161us) service_pool.cc:224] Handling call
0709 12:20:07.356254 (+ 24728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.356527 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:07.995003 (+638476us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.419064 (+424061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:08.419186 (+   122us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:08.425460 (+  6274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.425551 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.425705 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8090,"prepare.queue_time_us":927293,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":3602,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":18407,"thread_start_us":1040325,"threads_started":2}
W20260709 12:20:08.606011 16629 log.cc:927] Time spent T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:20:08.632624 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:08.605513 16312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.632s	user 0.007s	sys 0.024s
I20260709 12:20:08.636047 16632 raft_consensus.cc:697] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:08.655781 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 403309us
I20260709 12:20:08.666666 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.768253 13209 raft_consensus.cc:2393] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:08.639803 16544 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:08.670046 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.639853 16611 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.678720 13210 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:08.616243 16243 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 12:20:08.717598 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.652045 16542 consensus_queue.cc:1059] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.111s
W20260709 12:20:08.768796 13102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.032s	sys 0.078s
W20260709 12:20:08.845252 13102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.032s	sys 0.078s
I20260709 12:20:08.773972 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.632288 16487 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:08.794872 13204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.031s
I20260709 12:20:08.846882 13206 raft_consensus.cc:2410] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:08.673161 16503 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:08.849915 13204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.006s	sys 0.038s
W20260709 12:20:08.848637 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 81072.6us
I20260709 12:20:08.770143 16470 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.793520 16612 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:08.860339 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:08.859787 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 608076us
I20260709 12:20:08.765588 16468 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.762377 16493 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:20:08.897642 13209 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:20:08.904345 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.866421 13278 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
W20260709 12:20:08.854154 16625 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.529s	user 0.001s	sys 0.001s
I20260709 12:20:08.905299 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:08.908560 13204 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
W20260709 12:20:08.861122 16650 log.cc:927] Time spent T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:20:08.859802 16604 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.887604 16347 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:08.909436 16468 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:08.917177 16648 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:20:08.918097 16649 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 12:20:08.918875 16652 log.cc:927] Time spent T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:20:08.690326 16431 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.203s
I20260709 12:20:08.938078 16599 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:08.938367 16647 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 12:20:08.940395 16487 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:08.941326 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.944715 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2761) took 2222 ms. Trace:
I20260709 12:20:08.962517 13211 rpcz_store.cc:276] 0709 12:20:06.728223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.728457 (+   234us) service_pool.cc:224] Handling call
0709 12:20:06.728725 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:07.412617 (+683892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.412660 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:07.433678 (+ 21018us) log.cc:844] Serialized 26 byte log entry
0709 12:20:08.136896 (+703218us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:08.136951 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.137042 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:08.546833 (+409791us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:08.909914 (+363081us) raft_consensus.cc:1685] finished
0709 12:20:08.909949 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.944623 (+ 34674us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31784,"raft.queue_time_us":193522,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":17686,"spinlock_wait_cycles":13815168,"thread_start_us":1289052,"threads_started":2,"wal-append.queue_time_us":896439}
W20260709 12:20:08.945616 13203 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.018s	sys 0.038s
W20260709 12:20:08.965409 13203 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.019s	sys 0.039s
I20260709 12:20:08.907519 16472 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:20:08.980619 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.911999 16612 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:08.946112 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.950220 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.768980 16631 consensus_queue.cc:1059] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.260s
I20260709 12:20:08.986989 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.910166 16493 consensus_queue.cc:1243] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:08.690085 16635 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:08.956753 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 55052.4us
W20260709 12:20:08.959216 13881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.023s	sys 0.055s
I20260709 12:20:08.968185 16513 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.941485 16445 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.986198 13204 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:08.906304 16470 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:08.998314 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:08.986613 13252 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.014s	sys 0.043s
W20260709 12:20:09.000903 13252 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.014s	sys 0.043s
W20260709 12:20:09.001405 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 592126us
I20260709 12:20:08.956617 16347 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:08.983531 16556 consensus_meta.cc:287] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.750s	user 0.014s	sys 0.000s
I20260709 12:20:08.988481 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.989719 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:08.851616 16611 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:08.991176 13881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.024s	sys 0.056s
I20260709 12:20:08.991362 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:09.013723 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:08.992484 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 335256us
I20260709 12:20:08.954932 16604 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:08.942179 13887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.017s	sys 0.036s
W20260709 12:20:09.002897 13249 leader_election.cc:336] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 2.048s (SENT)
W20260709 12:20:09.016166 13887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.017s	sys 0.036s
I20260709 12:20:08.991590 16494 raft_consensus.cc:3055] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:09.006397 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:09.007769 13211 raft_consensus.cc:2393] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:09.007694 13207 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:09.021294 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:09.021415 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:09.016276 13249 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:09.030594 13211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:20:09.031702 13211 raft_consensus.cc:606] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:08.962248 16632 consensus_queue.cc:237] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:08.998576 16513 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:09.032217 13211 raft_consensus.cc:614] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:09.047796 13286 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:09.027472 13102 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:09.033083 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:09.020244 16494 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:09.107990 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 80644.7us
I20260709 12:20:09.105405 13204 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:09.110474 13278 raft_consensus.cc:2376] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8. Re-sending same reply.
I20260709 12:20:09.018151 16243 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:09.018426 16570 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:09.074160 16497 consensus_meta.cc:287] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.778s	user 0.007s	sys 0.006s
I20260709 12:20:09.024240 16515 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:09.117513 13211 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:09.118639 13102 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:09.098284 16660 log.cc:927] Time spent T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:20:09.161129 13211 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:20:09.161588 13211 pending_rounds.cc:85] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:20:09.030382 16633 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.029134 16559 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:09.053174 16363 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.161861 13211 pending_rounds.cc:107] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:20:09.165555 13211 raft_consensus.cc:2889] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:09.167011 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 48533.4us
I20260709 12:20:09.120213 16556 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:09.118948 16431 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.181877 13211 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:20:09.159204 16661 log.cc:927] Time spent T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:20:09.047999 16295 consensus_queue.cc:1059] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 12:20:09.059176 16669 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 12:20:09.201679 16468 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:09.202066 16544 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:09.182595 16312 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:09.203693 16445 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:09.126487 16457 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:20:09.203984 16312 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:09.205444 16544 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.172570 16243 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:09.206591 16518 raft_consensus.cc:3055] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:09.206298 16312 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.207023 16518 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:09.207547 16658 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:20:09.209844 13211 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:20:09.210294 13211 pending_rounds.cc:85] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 2
I20260709 12:20:09.210564 13211 pending_rounds.cc:107] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:20:09.210839 13211 raft_consensus.cc:2889] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:09.230672 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 114153us
I20260709 12:20:09.200300 16611 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:09.193729 16556 raft_consensus.cc:697] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:09.207737 16494 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.166157 16515 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:09.216478 13838 connection.cc:256] RPC call timeout handler was delayed by -1.4601129200000287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:20:09.246318 13838 connection.cc:256] RPC call timeout handler was delayed by -1.4418493450000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 12:20:09.249590 16570 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.250005 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:09.238673 16470 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.252241 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.250854 16570 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:09.186060 16363 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.257786 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 939) took 1001 ms. Trace:
I20260709 12:20:09.208114 16518 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.261493 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.262475 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:09.259613 13887 rpcz_store.cc:276] 0709 12:20:08.256606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.261620 (+  5014us) service_pool.cc:224] Handling call
0709 12:20:08.279210 (+ 17590us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:08.306834 (+ 27624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:08.306884 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:08.317549 (+ 10665us) log.cc:844] Serialized 52 byte log entry
0709 12:20:09.023370 (+705821us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:09.023548 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:09.023679 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:09.257575 (+233896us) raft_consensus.cc:1685] finished
0709 12:20:09.257593 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:09.257732 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27045,"raft.queue_time_us":27951,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":14830,"thread_start_us":628627,"threads_started":1,"wal-append.queue_time_us":649540}
I20260709 12:20:09.268373 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.272348 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:09.257198 16654 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:20:09.244271 16635 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:09.279392 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.233155 16669 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:20:09.209213 16431 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.280185 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.250536 16556 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.287475 13886 raft_consensus.cc:2368] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 9.
I20260709 12:20:09.282594 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.288657 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.290166 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.291282 13884 raft_consensus.cc:2410] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:20:09.282506 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.283320 13885 raft_consensus.cc:2376] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8. Re-sending same reply.
I20260709 12:20:09.285645 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.294492 13880 raft_consensus.cc:2410] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:20:09.301155 13886 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: [5.6-8.7]
W20260709 12:20:09.306180 16478 consensus_meta.cc:287] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.738s	user 0.008s	sys 0.004s
I20260709 12:20:09.306557 16616 raft_consensus.cc:3055] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:09.307052 16616 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:09.306856 16478 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.307889 16616 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:09.308840 16616 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:09.309115 16478 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:09.311971 16668 log.cc:927] Time spent T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:20:09.312929 16666 log.cc:927] Time spent T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:20:09.313151 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:09.314307 16667 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:20:09.314471 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:09.315214 16671 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:20:09.315508 13283 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 5: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:09.292090 16347 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.277697 16604 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.314528 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.316920 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:09.317555 13205 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:09.316362 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.317638 13277 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 8: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:09.318909 13882 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:09.312546 16503 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:09.322958 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.324059 13283 raft_consensus.cc:2410] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:20:09.324878 16665 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:20:09.325131 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.326093 13283 raft_consensus.cc:2393] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:09.326956 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.327782 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 568) took 1880 ms. Trace:
I20260709 12:20:09.328285 13284 rpcz_store.cc:276] 0709 12:20:07.447922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.233163 (+785241us) service_pool.cc:224] Handling call
0709 12:20:08.233558 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:08.240047 (+  6489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:08.240098 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:08.251461 (+ 11363us) log.cc:844] Serialized 26 byte log entry
0709 12:20:08.672790 (+421329us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:08.767018 (+ 94228us) log.cc:844] Serialized 14 byte log entry
0709 12:20:08.767410 (+   392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.767572 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:08.922749 (+155177us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b1800352ea0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:09.318732 (+395983us) raft_consensus.cc:1685] finished
0709 12:20:09.327542 (+  8810us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:09.327710 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":120521,"raft.queue_time_us":6101,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":17747,"spinlock_wait_cycles":223621632,"thread_start_us":286853,"threads_started":1,"wal-append.queue_time_us":403357}
I20260709 12:20:09.329910 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.330703 13284 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:20:09.331028 13284 pending_rounds.cc:85] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 5
I20260709 12:20:09.331226 13284 pending_rounds.cc:107] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:20:09.332384 13284 raft_consensus.cc:2889] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:09.332834 13209 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:09.333721 13283 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 5.
I20260709 12:20:09.334185 13209 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:09.336436 16612 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:09.337461 16512 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:09.337935 16512 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:09.338738 16512 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.340634 16515 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:09.341593 16513 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:09.296676 16518 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.340418 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1873) took 1033 ms. Trace:
I20260709 12:20:09.341732 16295 raft_consensus.cc:3055] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:09.355865 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:09.358268 16363 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.359454 16570 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.314473 16506 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.360931 16554 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.362524 16490 raft_consensus.cc:3055] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:09.363696 16431 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:09.373978 16617 log.cc:927] Time spent T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 1.003s	user 0.003s	sys 0.000s
I20260709 12:20:09.374835 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1540) took 1131 ms. Trace:
I20260709 12:20:09.419785 13212 rpcz_store.cc:276] 0709 12:20:08.243520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.247211 (+  3691us) service_pool.cc:224] Handling call
0709 12:20:09.374609 (+1127398us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b54001c4654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:09.374750 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47214848}
I20260709 12:20:09.376230 15995 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:09.377091 16503 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:09.378842 13281 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2733) took 2681 ms (client timeout 2754 ms). Trace:
I20260709 12:20:09.379817 13211 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:09.381422 16559 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:09.382313 13207 raft_consensus.cc:2393] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:09.387100 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.433670 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.434244 13279 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:09.435014 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.435720 13279 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:09.436932 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.390470 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.393110 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:09.392203 13130 rpcz_store.cc:276] 0709 12:20:08.306582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.306782 (+   200us) service_pool.cc:224] Handling call
0709 12:20:08.336739 (+ 29957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:08.418908 (+ 82169us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:08.638528 (+219620us) log.cc:844] Serialized 14 byte log entry
0709 12:20:09.102762 (+464234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:09.102818 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:09.102857 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:09.340211 (+237354us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b5400061654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:09.340260 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:09.340363 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29800,"prepare.queue_time_us":496559,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":9618,"raft.queue_time_us":31188,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":9415,"spinlock_wait_cycles":188301184,"thread_start_us":658735,"threads_started":2,"wal-append.queue_time_us":551296}
I20260709 12:20:09.395373 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:09.399051 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:09.438189 13284 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.402714 13205 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:09.405936 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:09.395099 16295 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:09.409463 16512 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.412611 16490 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:09.431725 13102 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:09.428853 13281 rpcz_store.cc:269] 0709 12:20:06.697659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.697769 (+   110us) service_pool.cc:224] Handling call
0709 12:20:09.378649 (+2680880us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001e96d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:09.378785 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3531392768}
I20260709 12:20:09.438093 13283 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:09.443722 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:09.445726 13280 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
W20260709 12:20:09.445812 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 180729us
I20260709 12:20:09.446581 13838 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:09.429661 15995 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.447880 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:09.463680 13284 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:09.447395 16609 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:09.447021 16527 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:09.466872 13838 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:09.443384 16604 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:20:09.451308 16632 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:09.459806 16431 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:09.473405 13838 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:09.470230 16295 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.481276 16295 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:09.470590 16527 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:09.489588 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 44324.4us
I20260709 12:20:09.492216 13102 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:09.469597 16609 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.495029 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:09.498202 13102 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:09.470367 16490 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:09.504369 16490 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:09.468492 16598 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:20:09.474241 16363 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:09.487812 16527 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:09.496135 16609 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:09.514777 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2753) took 2887 ms. Trace:
W20260709 12:20:09.516275 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.515211 13208 rpcz_store.cc:276] 0709 12:20:06.627569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.627900 (+   331us) service_pool.cc:224] Handling call
0709 12:20:06.655524 (+ 27624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.655968 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.656007 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.656546 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.116299 (+459753us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:07.166038 (+ 49739us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.175187 (+  9149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.175285 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:09.504571 (+2329286us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b2400152618. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1c269c4 00007f70f1c24acb 00007f70f1ddfdc9 00007f70f1ddfa55 00007f70f1ddefb0 00007f70f4a55488 00007f70f4a55be8 00007f70f4a2d398 00007f70f4a2876a 00007f70f4a27bb6
0709 12:20:09.514448 (+  9877us) raft_consensus.cc:1685] finished
0709 12:20:09.514556 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:09.514713 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9229,"prepare.queue_time_us":54286,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":40,"raft.queue_time_us":10554,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":6118,"spinlock_wait_cycles":38546304,"thread_start_us":459364,"threads_started":1,"wal-append.queue_time_us":836575}
I20260709 12:20:09.499034 16462 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:20:09.493772 16631 consensus_queue.cc:1175] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "af3f42f0797349058724e0cb2e637d24" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:20:09.524766 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.501483 16632 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:09.532262 13206 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1547) took 1263 ms (client timeout 1678 ms). Trace:
I20260709 12:20:09.532704 13102 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:09.534585 13206 rpcz_store.cc:269] 0709 12:20:08.268648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.473203 (+204555us) service_pool.cc:224] Handling call
0709 12:20:09.526110 (+1052907us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54002d5854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:09.532203 (+  6093us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643862400}
I20260709 12:20:09.548766 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.523778 16570 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:09.550472 13282 raft_consensus.cc:2410] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:20:09.553807 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.554726 13841 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:09.555938 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.524652 16556 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.569862 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.588392 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:09.539633 16543 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:09.589293 16543 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:09.589711 16543 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:09.548935 16529 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:09.591943 16529 raft_consensus.cc:697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:09.592870 16529 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.596693 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.534327 16632 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:09.606684 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 941) took 1345 ms. Trace:
I20260709 12:20:09.637753 16632 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:09.637759 13881 rpcz_store.cc:276] 0709 12:20:08.261186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.261341 (+   155us) service_pool.cc:224] Handling call
0709 12:20:08.274646 (+ 13305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:08.407823 (+133177us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:08.439023 (+ 31200us) log.cc:844] Serialized 14 byte log entry
0709 12:20:09.012050 (+573027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:09.012131 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:09.012206 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:09.367250 (+355044us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b180047f260. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:09.535085 (+167835us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b180047f260. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:09.606451 (+ 71366us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540058a2d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:09.606498 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:09.606627 (+   129us) inbound_call.cc:177] Queueing success response
0709 12:20:09.632484 (+ 25857us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
Metrics: {"mutex_wait_us":12010,"prepare.queue_time_us":32430,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":47,"raft.queue_time_us":6365,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":7976,"spinlock_wait_cycles":344238592,"thread_start_us":572577,"threads_started":1,"wal-append.queue_time_us":577162}
I20260709 12:20:09.607805 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.608245 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 943) took 1329 ms. Trace:
I20260709 12:20:09.640352 13879 rpcz_store.cc:276] 0709 12:20:08.278851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.279017 (+   166us) service_pool.cc:224] Handling call
0709 12:20:08.305389 (+ 26372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:08.526968 (+221579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:08.527002 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:08.527048 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:08.527083 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:09.608029 (+1080946us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54006b26d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:09.608085 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:09.608195 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509083008}
I20260709 12:20:09.617781 13880 raft_consensus.cc:2410] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:20:09.618410 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 63760.3us
I20260709 12:20:09.641964 13841 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:09.642840 13841 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:09.643283 16507 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:09.643671 13841 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:09.618809 16347 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:09.620587 13282 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:09.562479 16598 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.552731 16570 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:09.646833 16570 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.646621 16598 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.625622 13102 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:09.649976 16598 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.651669 16312 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:09.652266 16680 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:09.652748 16680 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:09.653136 16680 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.655311 16347 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:09.655990 16347 consensus_queue.cc:1059] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:09.657006 16431 raft_consensus.cc:3055] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:09.657353 16431 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:09.657433 16544 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:09.658172 16431 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.658798 16544 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:09.607506 16556 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.660641 16295 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:09.662103 16556 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:09.662889 16363 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:09.663725 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.664635 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.664851 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.665711 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.666498 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.666883 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.667048 13880 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:09.667469 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.666344 16431 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:09.668015 13881 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:09.668015 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.670198 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:09.668048 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.679950 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:09.681103 13887 raft_consensus.cc:2410] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:20:09.685119 15995 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.687784 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:09.687951 15995 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.620793 16494 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:09.643738 16507 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:09.691715 16507 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:09.693274 16680 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.678336 16570 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:09.704991 13879 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
W20260709 12:20:09.633152 16663 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:20:09.659258 16544 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:09.705813 16680 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:09.733153 13102 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:09.715924 13210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1549) took 1446 ms (client timeout 1636 ms). Trace:
W20260709 12:20:09.822360 13210 rpcz_store.cc:269] 0709 12:20:08.269206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.406390 (+137184us) service_pool.cc:224] Handling call
0709 12:20:09.715735 (+1309345us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000735d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:09.715858 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264528640}
I20260709 12:20:09.732193 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.824329 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:09.824381 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 91314.9us
I20260709 12:20:09.827664 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:09.827844 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.828349 13282 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.828411 13279 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:09.769945 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:09.751008 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.738516 13886 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:09.832330 13281 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:09.840852 13280 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:09.841940 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.842525 13280 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:20:09.844002 16526 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.844954 16673 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:09.845345 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:09.845484 16673 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.846138 13286 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:20:09.847929 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 71096.6us
I20260709 12:20:09.851058 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:09.872771 13282 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:09.731971 16674 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:09.904277 16674 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.907120 16674 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:09.908843 13282 pending_rounds.cc:85] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 6
I20260709 12:20:09.765607 16604 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.910431 13282 pending_rounds.cc:107] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:20:09.765050 16570 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:09.924667 13882 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:09.876767 16673 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:09.909437 13281 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:09.914815 13102 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:09.915138 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.910779 13282 raft_consensus.cc:2889] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:09.900372 16544 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:09.838032 16558 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:09.880918 16543 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:09.937762 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.939095 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:09.939761 13881 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:09.944597 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:09.946571 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.952813 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:09.953461 13133 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:09.931704 16457 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:09.963766 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:09.963934 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:09.966790 13130 raft_consensus.cc:2393] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:09.965080 13134 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:09.963420 13136 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:09.932996 16558 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.913995 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:09.765183 16489 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:09.999257 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.999883 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.002406 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:10.003686 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:10.003788 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:10.004595 13286 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:10.004838 13279 raft_consensus.cc:2410] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:20:10.005149 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:10.005553 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.006537 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:10.006834 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:10.007246 13280 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:10.008260 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.008957 13100 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.009523 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:09.766218 16559 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.969931 13131 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:09.966369 13129 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
W20260709 12:20:09.971125 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 57214.4us
I20260709 12:20:09.724728 16609 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:09.988461 16673 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:09.910199 16604 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:09.973894 16558 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.971077 16544 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:09.727859 16527 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:09.955196 16512 consensus_meta.cc:287] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
I20260709 12:20:10.010301 13100 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:10.045913 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.997352 16543 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.013273 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:10.049705 13279 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:10.012358 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:09.995357 16312 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:10.010108 16172 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.064914 16527 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:10.065084 16172 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.067320 16172 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:10.047041 13100 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.051730 13249 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:10.053203 16674 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:10.070259 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:10.070819 16674 raft_consensus.cc:697] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:10.071911 16674 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.073037 13281 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:10.073385 16604 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:10.053661 16542 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.075407 16609 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:10.075371 16542 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.077565 16542 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.054098 16506 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:10.078370 16506 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.009481 16489 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.054705 16504 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:10.079722 16504 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:10.080859 16489 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:10.080586 16504 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.081410 16489 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:10.081785 16489 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:10.082146 16489 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:10.055680 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 636) took 1821 ms. Trace:
W20260709 12:20:10.056656 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 46419.6us
I20260709 12:20:10.053694 16512 consensus_queue.cc:1059] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:20:10.084240 16512 raft_consensus.cc:3055] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:10.084620 16512 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:10.083585 13203 rpcz_store.cc:276] 0709 12:20:08.234124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.240812 (+  6688us) service_pool.cc:224] Handling call
0709 12:20:08.262809 (+ 21997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:08.263037 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:08.965988 (+702951us) log.cc:844] Serialized 14 byte log entry
0709 12:20:10.055317 (+1089329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:10.055371 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:10.055419 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.055502 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:10.055619 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":995134,"prepare.queue_time_us":50261,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":995978,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":100,"thread_start_us":796293,"threads_started":2,"wal-append.queue_time_us":208338}
I20260709 12:20:10.059700 13210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:20:10.085453 13210 raft_consensus.cc:606] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.085836 13210 raft_consensus.cc:614] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:10.085364 16512 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.070844 13278 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:10.086557 16512 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:10.061267 13279 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:10.061843 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.089802 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:10.092929 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:10.095141 13280 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:10.096971 13175 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:10.097200 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 50311.2us
I20260709 12:20:10.098381 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:10.098969 13280 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:10.100900 13102 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:10.015957 16243 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:10.102542 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:20:10.014098 16470 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.111915 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.112529 13205 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:10.112684 13206 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:20:10.113183 13206 pending_rounds.cc:85] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:20:10.113394 13206 pending_rounds.cc:107] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:20:10.113416 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.113696 13206 raft_consensus.cc:2889] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:10.114418 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.114806 13212 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:10.011740 16633 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.014226 16673 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.107892 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:10.117816 13177 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:10.119652 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.119831 13177 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:10.120060 13210 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:09.996208 16507 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.122586 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:10.125597 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.126320 13208 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:09.997725 16632 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.122394 13175 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.159684 16435 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:10.117246 16545 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:10.102547 16524 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:10.109079 16635 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:10.102658 16542 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:10.102630 16543 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:10.117345 16675 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:20:10.116189 16527 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:10.118877 16172 consensus_queue.cc:1059] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:20:10.018383 16559 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.120786 16673 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:10.123210 16487 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:10.123198 16633 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.147714 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:10.191887 13203 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:10.141687 16570 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:10.195218 16570 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.195616 16570 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:10.153643 16507 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:10.124904 16470 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.156262 13210 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:10.152257 16558 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.127316 16599 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:10.137655 13278 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:10.125249 16497 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:10.212078 16599 raft_consensus.cc:697] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:10.212482 16497 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.212913 16497 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:10.213093 16599 consensus_queue.cc:237] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.164387 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:10.215754 13211 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:10.216776 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:10.218916 16554 raft_consensus.cc:3055] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:10.165738 13887 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:10.219309 16554 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:10.219637 16544 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:10.220141 16544 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:10.220212 16554 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.221395 16554 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:10.127780 16515 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:10.221917 16515 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.168337 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2773) took 1217 ms. Trace:
I20260709 12:20:10.224373 13209 rpcz_store.cc:276] 0709 12:20:08.951109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.389911 (+438802us) service_pool.cc:224] Handling call
0709 12:20:09.532610 (+142699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:09.532815 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:09.550859 (+ 18044us) log.cc:844] Serialized 14 byte log entry
0709 12:20:10.059287 (+508428us) log.cc:844] Serialized 14 byte log entry
0709 12:20:10.059451 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:10.059499 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:10.059546 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.059614 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:10.168106 (+108492us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54002d5850. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:10.168264 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148197,"prepare.queue_time_us":19468,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":149568,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":136,"spinlock_wait_cycles":289042688,"thread_start_us":359627,"threads_started":1,"wal-append.queue_time_us":645201}
I20260709 12:20:10.225950 16515 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:10.117501 16556 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:20:10.185252 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:10.189424 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:10.187062 13841 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:10.193740 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:10.194723 16633 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.244076 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:10.245251 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:10.153558 13206 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:10.177289 16635 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.251859 16635 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:10.253397 16559 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.254122 16506 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.177042 16545 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.198429 16172 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.256024 16558 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:10.255827 16172 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.257233 16545 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:10.257946 16470 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.258059 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:10.215656 16632 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:10.221022 16544 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.187896 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:10.295075 13884 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:10.240765 13211 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:10.165167 13286 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:10.296995 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:10.297791 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:10.298239 13286 raft_consensus.cc:2393] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:10.241812 13887 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:10.243956 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:10.201076 13205 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
W20260709 12:20:10.248502 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 61562.8us
W20260709 12:20:10.251215 16691 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:20:10.302878 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.304302 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:10.305184 13278 raft_consensus.cc:2368] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8.
I20260709 12:20:10.270314 13203 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:10.275182 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:10.299299 13177 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:10.318542 13175 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.320580 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:10.322590 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.258000 16172 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.270850 16527 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:10.335606 13840 leader_election.cc:400] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8.
I20260709 12:20:10.341874 13840 leader_election.cc:403] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:20:10.296162 16545 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.303092 16507 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:10.309862 16312 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:10.205757 16612 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:20:10.340404 13175 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.319939 16524 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.362049 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.331409 16506 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:10.391782 16506 raft_consensus.cc:697] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:10.392954 16506 consensus_queue.cc:237] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.319764 16462 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:20:10.340458 16304 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:10.344313 16507 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.384898 16524 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.385763 16172 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:10.390635 16631 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:10.390944 13130 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:10.399806 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.375370 13175 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.343070 16470 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:10.453125 13175 leader_election.cc:400] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 9.
I20260709 12:20:10.453503 13175 leader_election.cc:403] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:10.402870 13103 connection.cc:256] RPC call timeout handler was delayed by -1.6330777160001162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:20:10.454208 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 43974.9us
I20260709 12:20:10.403113 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.456104 13131 raft_consensus.cc:2393] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:10.331534 16494 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:20:10.330840 16495 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:20:10.351197 16688 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8.
W20260709 12:20:10.401654 13284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.015s	sys 0.048s
W20260709 12:20:10.458666 13284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.015s	sys 0.048s
I20260709 12:20:10.409878 13136 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:20:10.446305 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:10.459527 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 361654us
I20260709 12:20:10.457772 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.397257 16304 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:10.460024 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.464164 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.407867 16507 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:10.351941 16545 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.375438 16312 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.472635 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.457405 16435 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:10.409355 16457 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:10.467200 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.469163 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.474706 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.482472 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.483600 13137 raft_consensus.cc:2368] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8.
I20260709 12:20:10.462440 16633 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:10.498783 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.499720 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.500013 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.502749 13128 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:10.503010 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.498880 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.504375 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.467602 16304 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:10.507525 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.503968 13131 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:10.474216 16470 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:10.512038 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.509250 13100 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:10.514477 13130 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:10.516873 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.517831 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.470537 16695 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.520696 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.536566 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.499002 16172 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:10.523692 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.537503 13135 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:10.537722 13175 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.528044 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.528770 16524 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.541494 13128 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:20:10.542443 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.531041 16545 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.530929 16457 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.507354 16688 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.461951 16489 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.542325 13175 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.529224 16556 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:10.541558 16695 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.554203 13175 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.543941 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.544394 13129 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:10.546088 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.547446 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.556211 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.551945 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.549075 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:10.557539 13128 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:10.559309 13883 raft_consensus.cc:2410] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:10.552544 16556 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.561743 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.563102 13136 raft_consensus.cc:2393] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:20:10.566179 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.566411 13128 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:10.566934 13175 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.568318 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.569690 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.569741 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.546039 16542 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:10.570554 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.571245 13135 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:10.553015 16470 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:10.573201 13130 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:10.577280 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.574777 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.577986 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.559064 16503 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:10.581506 13128 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:10.595077 13135 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:10.595676 13137 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:10.585271 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.598310 13206 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:10.598448 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.599239 13128 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:10.600121 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.546940 16673 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.603272 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.578073 13130 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:10.610473 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.606630 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.609827 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:10.611454 13209 raft_consensus.cc:2376] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10. Re-sending same reply.
I20260709 12:20:10.611519 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.610045 13211 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:10.577350 16602 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:10.601358 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.615336 13129 raft_consensus.cc:2376] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5. Re-sending same reply.
I20260709 12:20:10.612058 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.613292 13135 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:10.606830 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.617364 16602 raft_consensus.cc:697] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:10.617820 13130 raft_consensus.cc:1240] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:10.619356 13130 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:20:10.553495 16688 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.621155 13130 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:20:10.571209 16556 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:10.600560 16172 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:10.639330 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.603857 13137 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
W20260709 12:20:10.645432 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 309998us
I20260709 12:20:10.618572 16602 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.657397 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.607967 16470 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:10.658897 13135 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:10.658160 13137 raft_consensus.cc:2376] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6. Re-sending same reply.
I20260709 12:20:10.669617 13129 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:10.669459 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:10.673046 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.669617 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.673735 13206 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:10.670626 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.673779 13209 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:10.669885 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.675630 13203 raft_consensus.cc:2410] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:20:10.677106 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.680835 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.631412 16612 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.687608 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.689312 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.690248 13206 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:10.691604 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.692891 16695 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.693306 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.658336 16697 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.696054 16612 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.695194 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.710091 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.710758 13137 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
I20260709 12:20:10.710989 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.711760 13203 raft_consensus.cc:2393] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:10.714039 13211 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 5.
W20260709 12:20:10.716620 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 368412us
I20260709 12:20:10.737443 13841 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.740451 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.752276 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.754650 13133 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:10.755702 13206 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:20:10.765686 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:10.767264 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 250385us
I20260709 12:20:10.741459 16312 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:10.768841 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.769882 13133 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:10.755448 16687 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:10.773707 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:10.774242 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.712639 16697 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.776099 13203 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:10.776553 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.787322 13133 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:10.789945 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:10.791738 13211 raft_consensus.cc:1240] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:10.754113 16495 consensus_queue.cc:1059] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:20:10.773838 16545 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.804471 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.805508 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.806253 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.810418 13130 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:10.773782 16489 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.807519 13252 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:10.812765 13130 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:10.813123 13252 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:10.814687 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.821667 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.822516 13134 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:10.824999 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.827124 13135 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:10.827066 13175 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.829867 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:10.820894 16506 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:10.791040 16687 raft_consensus.cc:697] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:10.800730 16688 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:10.843200 16700 log.cc:927] Time spent T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 12:20:10.846101 16699 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:20:10.841027 16542 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:10.840785 16506 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:10.848583 16497 consensus_meta.cc:287] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.000s
I20260709 12:20:10.848973 16497 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:10.849426 16506 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:10.837440 16172 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:20:10.852103 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 586) took 1121 ms. Trace:
I20260709 12:20:10.853107 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.850091 13210 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:10.823787 16559 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:10.855046 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 117703us
I20260709 12:20:10.856107 13841 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:10.852522 13282 rpcz_store.cc:276] 0709 12:20:09.730304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.908178 (+177874us) service_pool.cc:224] Handling call
0709 12:20:09.908616 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:09.948814 (+ 40198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:09.948845 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:09.949397 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 12:20:10.371252 (+421855us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:10.371315 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.371421 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:10.851870 (+480449us) raft_consensus.cc:1685] finished
0709 12:20:10.851894 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:10.852041 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":16058,"thread_start_us":362755,"threads_started":1,"wal-append.queue_time_us":602204}
I20260709 12:20:10.771591 16470 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.859066 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.837852 16435 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:10.865695 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:10.871775 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2764) took 1380 ms. Trace:
I20260709 12:20:10.871925 13282 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:10.872191 13284 rpcz_store.cc:276] 0709 12:20:09.491115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.491240 (+   125us) service_pool.cc:224] Handling call
0709 12:20:09.491550 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:09.731220 (+239670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:09.731254 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:09.731740 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:20:09.897740 (+166000us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b48001a01d8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f9db6aa1 00007f70f9dadb37 00007f70f9dad9ca 00007f70f9ea526f 00007f70f9ea4f37 00007f70f9eb955c 00007f70f9eb9508 00007f70f9eb9488 00007f70f9eb9443 00007f70f9eb86ec 00007f70f8de2a96
0709 12:20:10.459065 (+561325us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:10.459124 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.459218 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:10.853186 (+393968us) raft_consensus.cc:1685] finished
0709 12:20:10.853206 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:10.871708 (+ 18502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":239304,"raft.queue_time_us":330841,"raft.run_cpu_time_us":2029,"raft.run_wall_time_us":70459,"spinlock_wait_cycles":22180992,"thread_start_us":726956,"threads_started":1,"wal-append.queue_time_us":905440}
I20260709 12:20:10.874667 13175 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.843621 16489 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:10.881704 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:10.858523 16570 consensus_meta.cc:287] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.005s
I20260709 12:20:10.820266 16545 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:10.860812 16707 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:20:10.857825 16172 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:10.875232 16688 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:10.896360 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:10.915581 13133 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:10.904021 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.897194 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.860234 16559 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:10.913784 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:10.918713 13130 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
W20260709 12:20:10.920526 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 53484us
I20260709 12:20:11.008811 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 599) took 1053 ms. Trace:
I20260709 12:20:11.159965 16688 raft_consensus.cc:697] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:11.485278 13132 rpcz_store.cc:276] 0709 12:20:09.955144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.955248 (+   104us) service_pool.cc:224] Handling call
0709 12:20:09.962776 (+  7528us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:10.304331 (+341555us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:10.656029 (+351698us) log.cc:844] Serialized 14 byte log entry
0709 12:20:10.837927 (+181898us) log.cc:844] Serialized 14 byte log entry
0709 12:20:10.838162 (+   235us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:10.851683 (+ 13521us) log.cc:844] Serialized 52 byte log entry
0709 12:20:10.851835 (+   152us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:10.852099 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 12:20:10.874275 (+ 22176us) log.cc:844] Serialized 14 byte log entry
0709 12:20:10.874439 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.874505 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:11.008499 (+133994us) raft_consensus.cc:1685] finished
0709 12:20:11.008528 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:11.008731 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37417,"prepare.queue_time_us":241677,"prepare.run_cpu_time_us":177,"prepare.run_wall_time_us":11145,"raft.queue_time_us":54632,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":21098,"spinlock_wait_cycles":33572608,"thread_start_us":809198,"threads_started":3,"wal-append.queue_time_us":239560}
I20260709 12:20:11.263164 16545 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:11.278226 16716 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.443s	user 0.004s	sys 0.000s
W20260709 12:20:10.929664 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 91341.9us
I20260709 12:20:11.544222 13252 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:10.979604 13128 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:10.876407 16542 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:20:10.997397 16543 consensus_meta.cc:287] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.813s	user 0.010s	sys 0.002s
I20260709 12:20:11.172959 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 584) took 1443 ms. Trace:
I20260709 12:20:10.967159 16687 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:10.997700 16635 consensus_meta.cc:287] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.000s
I20260709 12:20:11.567759 16635 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:11.570396 16635 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:11.011883 16718 log.cc:927] Time spent T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:20:10.927821 13249 leader_election.cc:336] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.678s (SENT)
W20260709 12:20:11.572232 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 644397us
W20260709 12:20:11.574618 13249 leader_election.cc:336] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.711s (SENT)
I20260709 12:20:11.575049 13249 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:11.229256 16673 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:11.575811 16673 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:11.049058 16697 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:10.903934 16712 log.cc:927] Time spent T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 12:20:11.577105 16556 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.920s	user 0.007s	sys 0.004s
I20260709 12:20:10.906464 16612 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:11.113765 16725 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:20:11.577553 16556 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:10.924086 16559 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:11.176019 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:11.584189 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 408245us
I20260709 12:20:11.585088 13175 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:11.586393 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:10.895411 16570 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:11.588935 16570 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:11.181878 16497 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:11.590037 13131 raft_consensus.cc:2368] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:10.887113 16469 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:11.326637 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.036777 16728 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:20:10.923749 16507 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:11.594894 16507 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:11.088256 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:11.595750 13134 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:11.289364 13133 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
W20260709 12:20:11.003894 16708 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 12:20:11.533912 16489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.022s	sys 0.065s
W20260709 12:20:11.600323 16489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.023s	sys 0.066s
I20260709 12:20:11.600634 16489 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:11.601646 16489 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:11.558499 13840 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:11.603578 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 45190us
I20260709 12:20:11.605000 16723 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:11.605450 16723 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.605790 16723 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:11.621778 16730 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.622462 16730 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:11.628183 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:11.628978 13282 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:20:11.631381 16545 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:11.632287 16545 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:11.634599 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:11.558162 13283 rpcz_store.cc:276] 0709 12:20:09.729771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.850199 (+120428us) service_pool.cc:224] Handling call
0709 12:20:09.925576 (+ 75377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.203759 (+278183us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:10.251203 (+ 47444us) log.cc:844] Serialized 14 byte log entry
0709 12:20:10.575256 (+324053us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:10.575893 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 12:20:10.576037 (+   144us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:10.576070 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.172449 (+596379us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54004097d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:11.172502 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:11.172553 (+    51us) raft_consensus.cc:1685] finished
0709 12:20:11.172672 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:11.172875 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11892,"prepare.queue_time_us":59883,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":4176,"raft.queue_time_us":12398,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":33669,"spinlock_wait_cycles":636693248,"thread_start_us":311445,"threads_started":1,"wal-append.queue_time_us":520172}
I20260709 12:20:11.564179 16688 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:11.567019 16543 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:11.466209 16304 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.926s	user 0.014s	sys 0.000s
W20260709 12:20:11.636570 13129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.016s	sys 0.093s
W20260709 12:20:11.794488 13129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.016s	sys 0.100s
W20260709 12:20:11.688930 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 114333us
W20260709 12:20:11.796007 13249 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.765s (SENT)
W20260709 12:20:11.697449 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 111132us
W20260709 12:20:11.796962 13249 leader_election.cc:336] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.791s (SENT)
I20260709 12:20:11.797441 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:11.797535 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:11.743851 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 109311us
I20260709 12:20:11.799052 13103 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:11.800542 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:11.532714 16601 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.812004 13103 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:11.795184 16457 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:11.828553 16545 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:11.833351 16457 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:11.808281 16697 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:11.814029 16469 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:11.826360 16601 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:11.835942 16469 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.836356 16469 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:11.809618 16570 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:11.813581 16304 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:11.847016 13134 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
W20260709 12:20:11.830008 13249 leader_election.cc:336] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.636s (SENT)
W20260709 12:20:11.855921 13249 leader_election.cc:336] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.852s (SENT)
W20260709 12:20:11.847222 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 49839us
W20260709 12:20:11.850319 13841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.180s	sys 0.298s
I20260709 12:20:11.829846 13282 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
W20260709 12:20:11.858871 13841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.180s	sys 0.298s
I20260709 12:20:11.863060 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:11.863816 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:11.795384 16599 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:11.808710 16497 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:11.796106 16728 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:11.864742 13881 raft_consensus.cc:2410] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:20:11.873198 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 329021us
I20260709 12:20:11.870395 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:11.858357 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:11.873912 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:11.831176 16527 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:11.885885 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 597) took 1633 ms. Trace:
I20260709 12:20:11.886399 13286 rpcz_store.cc:276] 0709 12:20:10.252912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.306554 (+ 53642us) service_pool.cc:224] Handling call
0709 12:20:10.306965 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.320791 (+ 13826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.320836 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:10.330813 (+  9977us) log.cc:844] Serialized 26 byte log entry
0709 12:20:10.744855 (+414042us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:10.744912 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.745016 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:11.259178 (+514162us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:11.880597 (+621419us) raft_consensus.cc:1685] finished
0709 12:20:11.880618 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:11.885795 (+  5177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13412,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":11990,"spinlock_wait_cycles":3176320,"thread_start_us":343807,"threads_started":1,"wal-append.queue_time_us":443372}
I20260709 12:20:11.890494 13883 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:11.870915 16507 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:11.847591 16731 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:11.873659 16457 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:11.871742 16612 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:11.867928 16599 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:11.872610 16497 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:11.884066 16633 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 1.377s	user 0.015s	sys 0.000s
I20260709 12:20:11.871193 16556 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:11.875962 16673 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.891768 16728 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:11.883312 16669 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.867539 16542 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:20:11.882998 16545 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.892819 16601 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:11.915398 16669 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:11.904742 16599 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:11.906286 16497 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:11.909950 16633 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 9.
I20260709 12:20:11.908596 16731 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:11.911643 16304 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:11.899305 16507 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:11.903997 16612 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:11.926247 16697 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:11.942883 13887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 952) took 2250 ms (client timeout 1801 ms). Trace:
W20260709 12:20:11.944947 13887 rpcz_store.cc:269] 0709 12:20:09.682758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.687528 (+  4770us) service_pool.cc:224] Handling call
0709 12:20:11.932440 (+2244912us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54004f1854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:11.932683 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097702272}
I20260709 12:20:11.914162 16673 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:11.916720 16728 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:11.931488 16470 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:11.936141 16731 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:11.953647 16738 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:11.922204 16545 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:11.983989 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 172082us
I20260709 12:20:11.984814 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:11.990530 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:11.995810 16729 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:11.996402 16729 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:11.996913 16715 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:11.997339 16715 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:11.999553 16732 log.cc:927] Time spent T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:20:12.001874 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:12.002532 13284 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:11.956488 16470 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:12.003494 16556 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:12.003769 16470 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:12.003957 16556 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:12.004474 16556 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:12.004868 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1906) took 1120 ms. Trace:
I20260709 12:20:12.005235 13129 rpcz_store.cc:276] 0709 12:20:10.884301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.885752 (+  1451us) service_pool.cc:224] Handling call
0709 12:20:10.886199 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.925378 (+ 39179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.925424 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:10.925988 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 12:20:11.794938 (+868950us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:11.922489 (+127551us) log.cc:844] Serialized 14 byte log entry
0709 12:20:11.923958 (+  1469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.924477 (+   519us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.004650 (+ 80173us) raft_consensus.cc:1685] finished
0709 12:20:12.004670 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.004809 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":566,"raft.queue_time_us":30292,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":20729,"thread_start_us":995777,"threads_started":2,"wal-append.queue_time_us":956721}
I20260709 12:20:12.006650 16604 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:11.962656 16731 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:12.012041 16730 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.013104 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:12.013830 13283 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:12.010928 16559 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:12.023509 13284 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:20:12.025002 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 151158us
I20260709 12:20:12.024103 13103 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:12.025797 13252 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:12.026981 13252 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:12.029130 13252 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:12.029446 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 171144us
I20260709 12:20:12.031178 13252 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:12.032274 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 161993us
I20260709 12:20:12.033018 13249 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:12.043112 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:12.045032 13175 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:12.017158 16457 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:20:12.023535 16559 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:12.028805 16738 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:12.028699 16570 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:12.024992 16527 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:20:12.066598 13252 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:12.056427 16604 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:12.050529 16633 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:20:12.067834 13252 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:12.074021 13249 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:12.063333 16559 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:12.062467 16570 raft_consensus.cc:697] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:12.068537 16738 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:12.064534 16743 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:12.056799 16723 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.074934 16304 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.076812 16604 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.091091 16570 consensus_queue.cc:237] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.091666 16749 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:12.092344 16559 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:12.096005 16728 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.097816 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:12.102123 16673 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.101406 16745 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:12.117903 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.100248 16507 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.102937 16750 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:12.075933 16612 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:12.114673 13284 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:20:12.116497 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.127499 16559 raft_consensus.cc:697] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:12.127652 13129 raft_consensus.cc:2376] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7. Re-sending same reply.
I20260709 12:20:12.117168 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.128854 13133 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:12.125507 16599 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.130370 16556 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.130985 16599 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.104883 16304 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.132445 16750 consensus_queue.cc:1243] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:12.117787 16457 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:12.132597 16470 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.121815 16745 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:12.133468 16745 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:12.133366 16457 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.134779 16470 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.117990 16697 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:12.135951 16697 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.106451 16743 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:12.128464 16559 consensus_queue.cc:237] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.132181 16497 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.060832 16744 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:12.123417 16673 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:12.159816 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 113912us
I20260709 12:20:12.137302 16457 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.152920 16469 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.154772 16731 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.155128 16497 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.155478 16556 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.155931 16743 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.156805 16723 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.158336 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:12.146377 16697 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.163830 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:12.165169 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:12.176347 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:12.176852 13136 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:12.177122 13132 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:12.159291 16744 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.169407 13840 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:12.174422 13284 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:12.174434 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:12.181739 13135 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:12.184120 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1561) took 1550 ms. Trace:
I20260709 12:20:12.184815 16688 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:12.184530 13210 rpcz_store.cc:276] 0709 12:20:10.634167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.634330 (+   163us) service_pool.cc:224] Handling call
0709 12:20:12.183925 (+1549595us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54000730d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:12.184063 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403649792}
W20260709 12:20:12.187420 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 95522us
I20260709 12:20:12.172770 16757 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.189754 13252 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:12.172837 16633 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:12.181423 16497 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:12.196312 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 122352us
I20260709 12:20:12.185832 16744 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:12.197340 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:12.188058 16688 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:12.212699 13284 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:12.213797 13840 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:12.214828 13136 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:12.200178 16688 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:12.217689 16604 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.218900 16731 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:12.199993 16751 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.228582 16751 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.230434 13135 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
W20260709 12:20:12.237987 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.199180 16497 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.241128 16497 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.241446 16745 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.224380 16730 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:12.244009 16730 raft_consensus.cc:697] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:12.246199 16730 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.246773 16469 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.246901 13279 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:12.197419 16633 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.249852 16738 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:12.244220 16545 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.253526 13132 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:12.257663 13280 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:12.198314 16757 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.256448 16494 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:20:12.259321 16745 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:12.274262 16757 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.267808 16751 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.276239 16633 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.282878 16688 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.295825 16688 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.298349 16744 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.307789 16744 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:12.344707 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:12.345011 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.347453 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:12.344705 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.348649 13129 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:12.352898 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 655) took 2224 ms. Trace:
I20260709 12:20:12.346907 13175 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:12.359736 13208 rpcz_store.cc:276] 0709 12:20:10.128795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.129166 (+   371us) service_pool.cc:224] Handling call
0709 12:20:10.145893 (+ 16727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.259784 (+113891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.259813 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:10.260282 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:20:10.564111 (+303829us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:10.564150 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.352098 (+1787948us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002a2bd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:12.352191 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.352270 (+    79us) raft_consensus.cc:1685] finished
0709 12:20:12.352285 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.352660 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4156,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":22506,"spinlock_wait_cycles":261090560,"thread_start_us":303464,"threads_started":1,"wal-append.queue_time_us":508372}
I20260709 12:20:12.369587 16469 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:12.382444 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1895) took 1856 ms. Trace:
I20260709 12:20:12.382378 16469 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.384795 13134 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:12.385143 16635 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:12.386703 16469 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.369848 16633 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:12.387776 16469 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:12.371629 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:12.375384 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.388206 16633 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.388810 16635 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:12.381081 16704 log.cc:927] Time spent T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 1.680s	user 0.005s	sys 0.008s
I20260709 12:20:12.383037 13128 rpcz_store.cc:276] 0709 12:20:10.525540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.622169 (+ 96629us) service_pool.cc:224] Handling call
0709 12:20:10.622531 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.545298 (+922767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.381827 (+836529us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400060c54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:12.382222 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820639488}
I20260709 12:20:12.395552 16633 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.400610 13129 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:12.404394 13285 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:12.406347 13841 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:12.407217 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 654) took 2289 ms. Trace:
I20260709 12:20:12.407778 13207 rpcz_store.cc:276] 0709 12:20:10.117962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.118078 (+   116us) service_pool.cc:224] Handling call
0709 12:20:10.137973 (+ 19895us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.204120 (+ 66147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.204164 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:10.206764 (+  2600us) log.cc:844] Serialized 26 byte log entry
0709 12:20:10.626421 (+419657us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:10.626465 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.406457 (+1779992us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b5400073ad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:12.406545 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.406634 (+    89us) raft_consensus.cc:1685] finished
0709 12:20:12.406654 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.407012 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31793,"raft.queue_time_us":2605,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":35760,"spinlock_wait_cycles":135724928,"thread_start_us":418522,"threads_started":1,"wal-append.queue_time_us":592222}
I20260709 12:20:12.413244 13285 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:12.413770 16507 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:12.414384 16507 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.414822 16507 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:12.389379 16635 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:12.419983 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:12.421039 13278 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:12.433590 16497 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:12.434222 16497 raft_consensus.cc:697] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:12.435765 16760 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:12.436605 16760 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:12.436694 16497 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.438124 16760 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:12.439077 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 67855.7us
I20260709 12:20:12.452670 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:12.454352 13285 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:12.428025 16469 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:12.785872 16771 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:12.788364 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:12.635205 16693 log.cc:927] Time spent T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 2.153s	user 0.006s	sys 0.011s
I20260709 12:20:12.786994 16771 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:12.641412 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 141237us
I20260709 12:20:12.765729 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:12.796316 13285 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:12.771371 16507 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.543093 16635 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.754174 16695 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:12.737805 16709 log.cc:927] Time spent T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 1.913s	user 0.009s	sys 0.006s
I20260709 12:20:12.812126 16695 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.815174 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1551) took 4545 ms. Trace:
I20260709 12:20:12.774354 16688 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.815997 16469 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.816851 16688 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.825379 16601 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:12.826336 16601 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.829325 16635 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.799358 13282 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:12.455993 16599 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:12.832670 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:12.832403 16599 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.834299 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:12.555620 13103 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.520s (SENT) [suppressed 44 similar messages]
I20260709 12:20:12.802104 16507 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.844041 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:12.841578 16695 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.843844 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:12.846789 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:12.837401 16599 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.849349 13278 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:12.860183 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.861301 13132 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 7: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:12.862279 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.862825 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.815645 13204 rpcz_store.cc:276] 0709 12:20:08.269749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.112958 (+843209us) service_pool.cc:224] Handling call
0709 12:20:09.113523 (+   565us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:10.003125 (+889602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.003162 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:10.011870 (+  8708us) log.cc:844] Serialized 52 byte log entry
0709 12:20:10.247796 (+235926us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b18003fc940. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1 00007f70f4e48a0f
0709 12:20:10.670885 (+423089us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:10.713325 (+ 42440us) log.cc:844] Serialized 14 byte log entry
0709 12:20:10.713641 (+   316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.713735 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.736573 (+2022838us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:12.814770 (+ 78197us) raft_consensus.cc:1685] finished
0709 12:20:12.814791 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.815003 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":889044,"prepare.queue_time_us":42210,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":51,"raft.queue_time_us":936750,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":12513,"spinlock_wait_cycles":52128384,"thread_start_us":422821,"threads_started":1,"wal-append.queue_time_us":754706}
W20260709 12:20:12.865136 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 53734.2us
I20260709 12:20:12.867915 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.868925 13137 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:20:12.869637 16601 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.874457 13136 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:12.874500 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 663) took 2012 ms. Trace:
I20260709 12:20:12.875660 13282 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:12.875098 13206 rpcz_store.cc:276] 0709 12:20:10.862405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.862548 (+   143us) service_pool.cc:224] Handling call
0709 12:20:10.862856 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.873474 (+ 10618us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:10.905598 (+ 32124us) log.cc:844] Serialized 14 byte log entry
0709 12:20:12.350491 (+1444893us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18000a3780. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d23a 00007f70f4e97a2a
0709 12:20:12.382877 (+ 32386us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.384201 (+  1324us) log.cc:844] Serialized 26 byte log entry
0709 12:20:12.384492 (+   291us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:12.384528 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.384662 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.726673 (+342011us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b18000a3780. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:12.874092 (+147419us) raft_consensus.cc:1685] finished
0709 12:20:12.874114 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.874309 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11781,"prepare.queue_time_us":32070,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":6156,"raft.queue_time_us":75215,"raft.run_cpu_time_us":468,"raft.run_wall_time_us":9755,"spinlock_wait_cycles":48155776,"thread_start_us":8901,"threads_started":1,"wal-append.queue_time_us":1420613}
I20260709 12:20:12.881292 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:12.882678 13129 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:12.755163 16715 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.883637 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:12.884282 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:12.884627 13135 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:12.884393 16715 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:12.885893 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.878312 16771 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.883749 13133 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:12.891881 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2745) took 3633 ms. Trace:
I20260709 12:20:12.892251 13277 rpcz_store.cc:276] 0709 12:20:09.258309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.331674 (+ 73365us) service_pool.cc:224] Handling call
0709 12:20:09.332048 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:09.727018 (+394970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:09.727048 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:09.727536 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:20:10.164808 (+437272us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:10.198952 (+ 34144us) log.cc:844] Serialized 14 byte log entry
0709 12:20:10.199363 (+   411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.199703 (+   340us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.633941 (+2434238us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:12.891383 (+257442us) raft_consensus.cc:1685] finished
0709 12:20:12.891501 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.891691 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":394534,"prepare.queue_time_us":17564,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":397176,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":5725,"spinlock_wait_cycles":37545344,"thread_start_us":436877,"threads_started":1,"wal-append.queue_time_us":681124}
I20260709 12:20:12.895063 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:12.874558 16737 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 1.037s	user 0.002s	sys 0.000s
W20260709 12:20:12.934201 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 378786us
I20260709 12:20:12.883682 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:12.943125 13129 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
W20260709 12:20:12.949312 13838 connection.cc:256] RPC call timeout handler was delayed by -1.3514354139999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 12:20:12.951862 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:12.952994 16601 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:12.953701 16601 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.956233 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:12.956629 16470 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:12.957088 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:12.958016 16462 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.958608 16497 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:12.958820 16462 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.959539 16497 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:12.959859 16778 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.960629 16778 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.960846 16497 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.961489 16462 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.962839 16635 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.963209 16470 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.963578 16599 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.964013 16470 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:12.964334 16599 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.966388 16470 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.966671 16599 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.968254 16635 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:12.971352 16776 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:12.972087 16776 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:12.973212 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:12.974406 16776 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:12.974711 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:12.975236 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:12.976043 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:20:12.976326 16784 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 12:20:12.941210 16688 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.978111 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:12.981961 16743 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:12.983786 13130 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:12.984167 16751 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:12.988648 13211 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:12.989917 13206 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:12.990563 16778 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:12.927419 16771 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:13.001045 16771 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:13.002192 16542 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.972455 16635 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:13.003923 13879 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:13.008373 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.002849 16542 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:13.011389 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.012048 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.012300 13210 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:13.026965 16771 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:13.019201 16304 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:13.014369 16542 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:13.376277 13100 connection.cc:256] RPC call timeout handler was delayed by -1.9921630190001451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
I20260709 12:20:13.033749 16601 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:13.092556 16729 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:13.096588 13131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1360) took 2618 ms (client timeout 1765 ms). Trace:
W20260709 12:20:13.378631 13131 rpcz_store.cc:269] 0709 12:20:10.483499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.527792 (+ 44293us) service_pool.cc:224] Handling call
0709 12:20:13.096109 (+2568317us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400060754. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:13.096381 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417611008}
I20260709 12:20:13.197367 13135 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:13.205547 13210 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:13.284775 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:13.381048 13210 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:13.381258 13130 raft_consensus.cc:2393] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:20:13.381822 16773 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.567s	user 0.001s	sys 0.004s
I20260709 12:20:13.286494 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:13.382714 13133 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:13.303921 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:13.307351 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.388716 13100 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:13.389364 16757 raft_consensus.cc:1064] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:20:13.322078 15995 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:20:13.325366 16772 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.531s	user 0.003s	sys 0.000s
I20260709 12:20:13.327833 16788 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:13.323653 13838 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:13.391270 16788 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:13.391393 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 67946.6us
I20260709 12:20:13.391914 16757 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:13.330648 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.394543 13208 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:13.329262 13206 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:13.336167 13207 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:13.396593 16757 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:13.400565 16729 consensus_queue.cc:1059] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:13.402361 16788 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:13.403195 16788 raft_consensus.cc:3055] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:13.403585 16788 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:13.404903 13882 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:13.405856 13880 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:13.406131 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.406469 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.406837 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:13.407312 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.407688 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.407908 13882 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:13.407992 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.408541 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.408782 13880 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:13.409898 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.414662 16529 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:13.415326 13881 raft_consensus.cc:2410] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:13.415546 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.350582 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 608) took 1373 ms. Trace:
I20260709 12:20:13.333571 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.419993 13212 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:13.419845 16788 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:13.418483 13286 rpcz_store.cc:276] 0709 12:20:11.977079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.977239 (+   160us) service_pool.cc:224] Handling call
0709 12:20:11.983651 (+  6412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.984532 (+   881us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:12.071772 (+ 87240us) log.cc:844] Serialized 14 byte log entry
0709 12:20:12.164302 (+ 92530us) log.cc:844] Serialized 14 byte log entry
0709 12:20:12.635082 (+470780us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b1800040d80. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d6e2a6 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1
0709 12:20:12.636075 (+   993us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b1800040d80. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:13.349532 (+713457us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b1800040d80. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d1ac0a 00007f70fb45a219 00007f70f1da2a40 00007f70f1d9d4e4 00007f70f1d9d455 00007f70f4e85060 00007f70f4e97716 00007f70f4ea8287 00007f70f4ea8208
0709 12:20:13.349835 (+   303us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.349914 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:13.349992 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.350152 (+   160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.350362 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1741,"prepare.queue_time_us":119780,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":833,"raft.queue_time_us":1188284,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":6803,"spinlock_wait_cycles":33149440,"thread_start_us":154561,"threads_started":2,"wal-append.queue_time_us":110621,"wal-append.run_cpu_time_us":1789,"wal-append.run_wall_time_us":1001775}
I20260709 12:20:13.412956 13879 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:13.409241 13207 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:20:13.358255 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.410657 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.422932 13883 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:13.423400 13206 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:20:13.409241 13878 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:13.426781 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:13.428907 16497 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.429719 16751 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.429517 16497 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:13.430289 16751 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:13.428280 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:13.432554 16730 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:13.431770 16497 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:13.439517 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.440672 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.442158 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.442620 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:13.443598 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.443993 13208 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:13.437332 16743 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.460624 16743 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:13.462198 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.463126 13208 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:13.454075 13207 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:13.463001 16743 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:20:13.467384 13212 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:13.446003 13133 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:13.444197 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:13.445560 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.439095 16542 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.443118 16723 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:13.465739 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.442581 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.431788 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:13.489020 13208 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:20:13.489297 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 45215.5us
I20260709 12:20:13.447094 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:13.433528 16751 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:13.517642 13212 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:13.492400 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.556880 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.535944 13210 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:13.535606 16724 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:13.538466 16730 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:13.578151 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.580606 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.575968 16724 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:13.582224 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 92240.6us
I20260709 12:20:13.445861 16779 consensus_queue.cc:1059] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 12:20:13.500896 16542 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:13.584265 16724 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:13.592763 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.593824 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.594478 13209 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:13.607815 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.595414 16542 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:13.596028 13206 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:13.613582 16497 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.614135 16497 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:13.615751 16632 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:13.616439 16779 raft_consensus.cc:3055] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:13.616901 16779 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:13.617664 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:13.617803 16779 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:13.619222 16779 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:13.620733 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 1.42323e+06us
I20260709 12:20:13.618331 13885 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:13.615763 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 168801us
I20260709 12:20:13.593386 13207 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:13.653995 16724 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:13.655815 13210 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:13.656018 13841 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:13.656842 16724 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:13.656985 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.657795 13210 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:13.657898 13841 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:13.658492 13885 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:13.658658 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.664265 13841 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:13.669231 13209 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:13.680766 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.726186 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.751685 16494 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:13.897240 16494 raft_consensus.cc:697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:13.897756 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.898330 16494 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:13.899009 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:13.854811 13841 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:13.900044 16669 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:13.900192 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 219659us
I20260709 12:20:13.900650 16669 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:13.901036 16669 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:13.901453 16669 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:13.857561 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:13.858197 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 211846us
I20260709 12:20:13.903988 13203 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:13.904704 13838 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:13.906350 13203 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:20:13.711618 16688 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:13.859583 16507 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:13.907693 16493 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:13.907967 16507 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:13.908164 16493 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.908455 16507 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:13.908557 16493 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:13.909682 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.860803 16457 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.859172 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.910526 13211 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:13.910334 16457 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:13.912073 13211 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:13.912606 16457 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:13.697031 16730 consensus_queue.cc:1059] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:20:13.913424 16730 consensus_queue.cc:1243] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:13.643818 16723 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:20:13.913875 16304 raft_consensus.cc:3055] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:13.914248 16304 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:13.914646 16723 raft_consensus.cc:3055] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:13.915021 16723 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:13.915104 16304 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:13.916378 16304 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:13.918676 13209 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:13.920495 13886 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:13.922104 13886 raft_consensus.cc:1240] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:13.907320 16688 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:13.922405 16495 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:20:13.952569 16495 consensus_queue.cc:1243] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:13.958914 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 614) took 1844 ms. Trace:
I20260709 12:20:13.959688 13204 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:13.960953 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 616) took 1735 ms. Trace:
I20260709 12:20:13.961932 16512 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:13.961308 13284 rpcz_store.cc:276] 0709 12:20:12.225706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.227541 (+  1835us) service_pool.cc:224] Handling call
0709 12:20:12.227951 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:12.228236 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:12.348761 (+120525us) log.cc:844] Serialized 14 byte log entry
0709 12:20:13.960418 (+1611657us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.960495 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:13.960569 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.960654 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.960776 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1611144,"prepare.queue_time_us":76683,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"thread_start_us":75607,"threads_started":1}
I20260709 12:20:13.931695 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:13.962688 16512 consensus_queue.cc:1059] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:13.963066 13133 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:20:13.938989 13034 catalog_manager.cc:5697] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 4, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:13.965655 16796 log.cc:927] Time spent T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.377s	user 0.003s	sys 0.000s
I20260709 12:20:13.923211 16688 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:13.944558 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.949885 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1960) took 1548 ms. Trace:
I20260709 12:20:13.947670 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:13.971673 13279 rpcz_store.cc:276] 0709 12:20:12.401985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.404126 (+  2141us) service_pool.cc:224] Handling call
0709 12:20:12.404676 (+   550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.949431 (+1544755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.949461 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.949503 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:13.949541 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.949605 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.949727 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1544163,"raft.queue_time_us":1559144,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81}
I20260709 12:20:13.972781 16503 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:13.950901 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:13.973328 16513 raft_consensus.cc:3055] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:20:13.941392 13033 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42062 (request call id 294) took 20106 ms (client timeout 15000 ms). Trace:
I20260709 12:20:13.867903 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:13.868121 16497 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:13.875819 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:13.879004 16777 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 1.087s	user 0.004s	sys 0.000s
I20260709 12:20:13.881790 13207 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:13.858662 16632 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:13.890218 16695 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.892607 16788 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:13.892724 16604 consensus_queue.cc:1059] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:13.896152 16697 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:20:13.793586 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.973796 13131 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:13.986362 16755 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
I20260709 12:20:14.000983 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.051793 13203 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:14.165207 16457 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.170603 16457 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:14.098445 16495 consensus_queue.cc:1059] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:20:14.172415 16726 raft_consensus.cc:3055] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:14.172623 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:14.172791 16726 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:14.172801 16457 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:13.989441 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 1.79947e+06us
I20260709 12:20:14.173940 13128 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:14.174590 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:14.175097 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:14.108016 16493 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:13.985764 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 321553us
I20260709 12:20:14.176623 13883 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:14.173961 16726 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.177362 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:14.177577 16726 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:14.178326 16744 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:14.178716 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:14.178987 16673 raft_consensus.cc:2764] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:20:14.102831 16715 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:20:14.180225 16493 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:14.178740 16744 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:14.159026 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:14.180925 16744 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:14.175849 16604 raft_consensus.cc:3055] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:14.181461 13881 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:14.181896 16604 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:14.001833 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.182722 13280 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:14.182827 16604 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.180321 16697 consensus_queue.cc:1243] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:13.966477 13034 catalog_manager.cc:5697] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:14.160866 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 213484us
W20260709 12:20:14.160696 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.194332 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.206315 13286 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:14.001309 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.207945 13277 raft_consensus.cc:2410] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:20:14.133118 16507 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.208869 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:14.184907 13033 rpcz_store.cc:269] 0709 12:19:53.835748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:53.846807 (+ 11059us) service_pool.cc:224] Handling call
0709 12:20:13.941062 (+20094255us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:04.675125 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:04.931084 (+255959us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:04.947107 (+ 16023us) write_op.cc:435] Acquired schema lock
0709 12:20:04.961061 (+ 13954us) tablet.cc:662] Decoding operations
0709 12:20:05.143263 (+182202us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:05.143348 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:05.143383 (+    35us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:20:05.144884 (+  1501us) tablet.cc:701] Row locks acquired
0709 12:20:05.144929 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:20:05.145111 (+   182us) write_op.cc:270] Start()
0709 12:20:05.145269 (+   158us) write_op.cc:276] Timestamp: P: 1783599605145045 usec, L: 0
0709 12:20:05.145295 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:20:05.146067 (+   772us) log.cc:844] Serialized 7217 byte log entry
0709 12:20:05.362652 (+216585us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f1d830ac 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b
0709 12:20:06.451905 (+1089253us) op_driver.cc:464] REPLICATION: finished
0709 12:20:07.098894 (+646989us) write_op.cc:301] APPLY: starting
0709 12:20:07.107599 (+  8705us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:07.212910 (+105311us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:07.212958 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:07.471328 (+258370us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:07.471855 (+   527us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 12:20:07.471925 (+    70us) write_op.cc:312] APPLY: finished
0709 12:20:07.472536 (+   611us) log.cc:844] Serialized 125 byte log entry
0709 12:20:08.273618 (+801082us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:08.316662 (+ 43044us) write_op.cc:454] Released schema lock
0709 12:20:08.336628 (+ 19966us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:08.367045 (+ 30417us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:08.367084 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":525916,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":534978,"apply.run_cpu_time_us":54630,"apply.run_wall_time_us":1300164,"num_ops":18,"prepare.queue_time_us":627536,"prepare.run_cpu_time_us":32687,"prepare.run_wall_time_us":1189222,"raft.queue_time_us":304536,"raft.run_cpu_time_us":14314,"raft.run_wall_time_us":123854,"replication_time_us":1306373,"spinlock_wait_cycles":34320768,"thread_start_us":2230460,"threads_started":5,"wal-append.queue_time_us":1883329,"wal-append.run_cpu_time_us":38700,"wal-append.run_wall_time_us":2278898}]]}
I20260709 12:20:14.209456 13885 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:14.210734 16457 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:13.986101 16738 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.990015 16728 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:14.017406 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:13.973878 16513 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:13.983780 16723 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.002532 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.002552 13282 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:14.188134 13212 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:14.188194 16695 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:13.951256 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:13.999322 16731 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:14.065469 13066 debug-util.cc:398] Leaking SignalData structure 0x7b080008ab00 after lost signal to thread 11919
I20260709 12:20:14.175678 13252 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:13.922345 13103 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:13.999691 16750 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:14.210736 16507 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:13.996032 16512 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.016867 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:14.006703 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:13.950197 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:14.151736 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 50121.5us
I20260709 12:20:14.117650 16669 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.195796 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:13.959316 13283 rpcz_store.cc:276] 0709 12:20:12.114160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.114315 (+   155us) service_pool.cc:224] Handling call
0709 12:20:12.127748 (+ 13433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:12.127930 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:12.128181 (+   251us) log.cc:844] Serialized 14 byte log entry
0709 12:20:13.958328 (+1830147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.958406 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:13.958472 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.958581 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.958769 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1772866,"prepare.queue_time_us":1177,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":29,"raft.queue_time_us":1787463,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"thread_start_us":56885,"threads_started":1,"wal-append.queue_time_us":104412,"wal-append.run_cpu_time_us":1402,"wal-append.run_wall_time_us":1011966}
I20260709 12:20:14.193698 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.199986 13034 catalog_manager.cc:5697] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:14.236384 16604 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:14.200380 16703 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:14.202703 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.203184 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:14.205426 13280 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:14.125283 13878 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:14.264334 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:14.219295 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.207333 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.227708 16559 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:14.228572 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:14.228812 13211 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:14.190770 13208 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:14.151013 16688 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.259349 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:14.268560 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:20:14.264496 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 61406.1us
I20260709 12:20:14.260769 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:14.268563 13133 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:14.269052 13879 raft_consensus.cc:2393] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:20:14.254263 13066 debug-util.cc:398] Leaking SignalData structure 0x7b080008a7a0 after lost signal to thread 13069
W20260709 12:20:14.270300 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 348002us
I20260709 12:20:14.207309 16744 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:14.277034 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:14.272822 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:14.273138 13128 raft_consensus.cc:2410] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:20:14.250023 16755 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.272877 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:14.275207 13066 debug-util.cc:398] Leaking SignalData structure 0x7b0800322ce0 after lost signal to thread 13161
I20260709 12:20:14.276335 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:14.314167 13277 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:14.257023 13100 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:14.300436 16545 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:14.302906 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:14.317384 13881 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:14.309723 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:14.300618 16489 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:14.318169 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.303925 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:14.319308 16609 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:14.270372 16751 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:14.316730 13066 debug-util.cc:398] Leaking SignalData structure 0x7b08003c9520 after lost signal to thread 13236
W20260709 12:20:14.321463 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 142821us
W20260709 12:20:14.317274 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 45475.8us
I20260709 12:20:14.301753 13886 raft_consensus.cc:2393] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:20:14.306089 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 130544us
W20260709 12:20:14.325103 13066 debug-util.cc:398] Leaking SignalData structure 0x7b0800269220 after lost signal to thread 13310
I20260709 12:20:14.325703 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:14.326232 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:14.326277 13210 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:14.234886 16738 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:14.323504 13280 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:14.276603 16697 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:14.326431 13883 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:14.326876 13878 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
W20260709 12:20:14.328790 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54111.6us
I20260709 12:20:14.252779 16673 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:14.314225 13887 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:14.330636 13282 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:14.331766 13066 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8be0 after lost signal to thread 13311
I20260709 12:20:14.331228 13135 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:20:14.333207 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 81154.1us
I20260709 12:20:14.273908 16512 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:14.339460 13066 debug-util.cc:398] Leaking SignalData structure 0x7b0800411b60 after lost signal to thread 13911
W20260709 12:20:14.339752 13066 debug-util.cc:398] Leaking SignalData structure 0x7b08003461a0 after lost signal to thread 13912
I20260709 12:20:14.336890 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:14.346393 16755 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:14.353798 13286 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:14.355180 13879 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:14.309438 16503 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:14.331497 16723 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:14.359542 13128 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:14.359690 16697 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:14.302294 16750 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.360872 13277 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:14.361894 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.363221 13884 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:14.360881 13034 catalog_manager.cc:5697] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.324061 16751 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:14.369441 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:14.369436 16497 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:14.377988 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:14.373906 13133 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
W20260709 12:20:14.378788 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 48558.3us
I20260709 12:20:14.269913 16731 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.378823 13883 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
W20260709 12:20:14.382680 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 63125.7us
I20260709 12:20:14.361231 16457 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:14.386375 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:14.380702 13034 catalog_manager.cc:5697] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 4 to 6, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 6 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:14.378197 16751 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:14.415000 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:14.416508 16512 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:14.337960 16545 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.421855 16545 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:14.422411 13284 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:14.423064 16695 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:14.408787 13177 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:14.436291 16697 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:14.436827 13177 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:14.437733 13177 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:14.439410 16771 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:14.409294 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 620) took 2093 ms. Trace:
I20260709 12:20:14.412070 16688 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:14.386632 16457 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:14.420027 16669 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:14.407968 13034 catalog_manager.cc:5697] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:14.424437 16755 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:14.395780 16542 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:14.426167 16750 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:14.371344 16673 raft_consensus.cc:697] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:14.426892 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.428529 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:14.429014 13203 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:14.475353 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:14.429831 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:14.475955 13133 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:14.420042 13135 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:14.402311 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:14.441998 13210 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:14.405381 13279 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:14.444528 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:14.427170 16738 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:14.386186 16503 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:14.489213 16503 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.493342 13841 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:14.495406 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:14.496592 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:14.497757 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.498361 13279 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:14.499111 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.440455 13281 rpcz_store.cc:276] 0709 12:20:12.274568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.274726 (+   158us) service_pool.cc:224] Handling call
0709 12:20:12.275054 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:13.950753 (+1675699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.950799 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:13.951338 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:20:14.243051 (+291713us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:14.243097 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.246302 (+  3205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.363810 (+117508us) raft_consensus.cc:1685] finished
0709 12:20:14.363828 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.367872 (+  4044us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1675278,"raft.queue_time_us":1697254,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":291246,"threads_started":1,"wal-append.queue_time_us":291608}
I20260709 12:20:14.455807 16816 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:14.330562 16513 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:14.514966 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.464391 16542 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.487895 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.451632 16771 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:14.458487 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:14.517100 13882 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:14.424085 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:14.457170 16457 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:14.518373 13280 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:14.518253 13284 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:14.526244 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:14.529053 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:14.532387 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 170967us
I20260709 12:20:14.536064 13280 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:14.537519 13034 catalog_manager.cc:5697] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 4 to 7, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 7 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:14.528849 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 145274us
I20260709 12:20:14.450322 16489 consensus_queue.cc:1059] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:20:14.513684 16816 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.538240 13279 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
I20260709 12:20:14.459170 16497 consensus_queue.cc:1059] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:20:14.520529 16771 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.524770 16495 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:14.520581 16542 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:14.557664 13100 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:14.566351 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:14.574277 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 135318us
I20260709 12:20:14.576359 13282 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:20:14.576689 13103 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:14.528416 16669 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:20:14.562496 16771 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:14.552376 16816 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:14.583537 16495 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:14.584694 13103 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:14.584597 16495 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.567094 16738 raft_consensus.cc:3055] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:14.571164 13034 catalog_manager.cc:5697] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:14.592193 13880 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:14.518764 16728 consensus_queue.cc:1059] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:20:14.595080 13280 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:14.598897 13135 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:20:14.605423 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.590546 16695 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:14.631232 13131 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:14.595582 16744 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:14.592548 16738 raft_consensus.cc:740] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:14.640197 16833 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:14.648824 16695 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:14.649236 16731 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:14.606628 16604 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:14.649912 16695 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.638549 13034 catalog_manager.cc:5697] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 6, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 6 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:14.671789 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 294072us
I20260709 12:20:14.602700 16819 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:14.671558 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:14.677618 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 151155us
I20260709 12:20:14.687680 13034 catalog_manager.cc:5697] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 5, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 5 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.695895 13840 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:14.698761 13034 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:14.699254 13840 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:14.703496 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 127875us
I20260709 12:20:14.688787 16688 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:14.715675 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:14.705880 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:14.726064 13840 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:14.672290 16833 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:14.704985 16723 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:14.768898 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:14.772977 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 171449us
I20260709 12:20:14.641263 16673 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:14.785415 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:14.773556 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 45226.6us
I20260709 12:20:14.719676 16688 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.774632 16507 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:14.733062 16632 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:14.774180 16304 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:14.793998 13034 catalog_manager.cc:5697] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 5, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 5 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:14.792070 16820 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:14.806890 16821 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:20:14.807297 16632 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.807914 16632 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:14.805605 16695 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:20:14.820809 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 133147us
I20260709 12:20:14.821228 16497 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:14.821676 13249 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:14.822178 16497 consensus_queue.cc:1243] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:14.822557 16820 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:14.823000 16820 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:14.823400 16820 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:14.834021 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 185523us
I20260709 12:20:14.808967 13034 catalog_manager.cc:5697] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 4 to 5, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 5 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:14.787562 16542 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:14.750108 16804 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 12:20:14.818354 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 231868us
I20260709 12:20:14.794747 16723 raft_consensus.cc:697] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:14.810423 13100 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:14.837426 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:14.801076 16688 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:14.840417 16542 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:14.841073 16542 raft_consensus.cc:3055] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:14.841401 16542 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:14.841547 16804 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:14.842190 16819 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:14.842736 16819 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:14.843937 13103 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:14.844652 16833 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:14.802757 16507 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:14.738036 16818 consensus_queue.cc:1059] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 12:20:14.859637 16817 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:14.861946 16632 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:14.864022 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 54146us
W20260709 12:20:14.867774 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:14.868757 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.838610 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:14.732782 16738 consensus_queue.cc:260] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:14.879482 13249 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:14.881462 16697 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:14.882571 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:14.883338 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:14.873799 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:14.855767 16507 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:14.802361 16834 consensus_queue.cc:1059] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:20:14.875959 16495 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:20:14.895205 16542 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.903666 13285 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:14.895658 13034 catalog_manager.cc:5697] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.855746 16703 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:20:14.896538 13133 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:14.896978 16738 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:14.871529 16828 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:20:14.899420 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 194282us
I20260709 12:20:14.877022 16833 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:14.907081 16744 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:14.908218 13131 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:20:14.906056 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:14.913223 11921 debug-util.cc:398] Leaking SignalData structure 0x7b080000fee0 after lost signal to thread 13252
I20260709 12:20:14.882287 16632 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:14.850692 16457 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:14.850490 16838 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:20:14.878733 16788 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:20:14.915341 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 69743.1us
I20260709 12:20:14.986778 13177 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:14.986528 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 80613.5us
I20260709 12:20:14.893044 16697 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.946677 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:14.900327 16826 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:14.955971 16834 raft_consensus.cc:3055] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:20:14.946308 16822 log.cc:927] Time spent T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:20:15.019045 13128 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:14.931842 16744 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:15.024370 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 169474us
I20260709 12:20:15.028263 16842 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:15.029853 16513 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:15.030791 16835 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:15.032157 16771 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:15.033157 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:15.036675 16820 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:15.038077 13133 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:15.051859 13135 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:15.039037 13103 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:15.024052 16818 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:15.053378 13103 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:14.889389 16751 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.012421 16697 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:14.948104 16845 raft_consensus.cc:3055] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:14.909338 16831 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 12:20:15.040560 16834 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:15.042160 16703 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.051703 16744 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:15.061028 16842 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.060398 16833 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:15.065121 16829 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:15.112725 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 119375us
I20260709 12:20:15.119822 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:15.119967 13249 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:15.125735 13133 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:15.117853 13208 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:15.117731 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:14.952064 16723 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:15.121160 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 134457us
I20260709 12:20:15.127372 13177 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:15.128466 13177 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:15.130744 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:15.085476 16845 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:15.099193 16695 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:15.139657 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:15.146763 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:15.108204 16831 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:15.124392 16833 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:15.121322 16842 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:15.168330 16827 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:15.100152 16846 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:15.172607 13130 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:15.197172 13135 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:15.147502 16673 raft_consensus.cc:2764] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:20:15.199937 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 117750us
I20260709 12:20:15.121830 16703 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.188289 16833 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:15.219689 13136 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:15.248479 13133 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:15.219352 16835 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:15.251710 16669 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.269647 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 149917us
I20260709 12:20:15.207408 16831 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.218012 16840 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:15.227562 16695 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.314527 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:15.318862 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 188787us
I20260709 12:20:15.187789 16834 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:15.322825 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 53033.2us
I20260709 12:20:15.215752 16846 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:15.267259 16835 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:15.363142 13838 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:15.364946 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1983) took 1160 ms. Trace:
I20260709 12:20:15.367413 13278 rpcz_store.cc:276] 0709 12:20:14.204437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.318537 (+114100us) service_pool.cc:224] Handling call
0709 12:20:14.332645 (+ 14108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:14.364873 (+ 32228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:14.364905 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:14.369884 (+  4979us) log.cc:844] Serialized 26 byte log entry
0709 12:20:14.780963 (+411079us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:14.839092 (+ 58129us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.839302 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.325571 (+486269us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b540023c154. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:15.325627 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:15.325667 (+    40us) raft_consensus.cc:1685] finished
0709 12:20:15.364712 (+ 39045us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:15.364874 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24625,"prepare.queue_time_us":310334,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":17592,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":29522,"spinlock_wait_cycles":50098560,"thread_start_us":443831,"threads_started":2,"wal-append.queue_time_us":447938}
W20260709 12:20:15.371757 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 49344.5us
I20260709 12:20:15.320906 16840 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.323664 16826 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:15.319566 16457 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:15.367270 16816 consensus_meta.cc:287] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.769s	user 0.013s	sys 0.009s
I20260709 12:20:15.251971 16825 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 12:20:15.275007 16669 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.370303 16835 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:15.434428 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:15.376420 16828 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:15.230705 16845 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.416055 16844 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.459916 16844 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.462234 16845 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:15.463064 16503 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:15.463553 16503 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:15.463716 16859 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:20:15.464906 16788 raft_consensus.cc:3055] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:15.464574 16503 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:15.465302 16788 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:15.465346 16703 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:15.466367 16788 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.459106 16828 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:15.325224 16695 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.446882 16489 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:15.479691 13137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:15.449620 16857 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:15.480568 13137 raft_consensus.cc:606] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:20:15.484341 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:15.485044 13278 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:15.486552 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:15.381026 16840 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:15.446537 13249 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:15.492363 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:15.416810 16771 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:15.548810 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.554708 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:15.554699 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:15.557898 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:15.428556 16751 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:15.453974 16849 log.cc:927] Time spent T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 12:20:15.561259 13279 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:15.563841 13284 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:20:15.564118 13882 raft_consensus.cc:1240] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:15.434542 16834 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:15.568341 13886 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:15.415608 16728 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.136s
I20260709 12:20:15.488327 16542 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:15.454919 16673 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:15.572530 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 80272.2us
I20260709 12:20:15.423125 16820 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:15.575183 13277 raft_consensus.cc:3055] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:15.580242 13277 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:15.580354 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:15.495069 16723 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.564250 13284 pending_rounds.cc:85] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 5
I20260709 12:20:15.454639 16819 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:15.488767 16604 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:15.579085 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 699) took 1151 ms. Trace:
I20260709 12:20:15.438489 16457 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.593911 13208 rpcz_store.cc:276] 0709 12:20:14.427849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.440681 (+ 12832us) service_pool.cc:224] Handling call
0709 12:20:14.460154 (+ 19473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:15.126343 (+666189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.578776 (+452433us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b540002dad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:15.579008 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504151936}
I20260709 12:20:15.596616 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:15.597452 13885 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:15.600184 13883 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:15.604708 13100 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:15.605118 16738 consensus_meta.cc:287] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.000s
I20260709 12:20:15.605870 16851 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:15.606223 13278 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:15.607617 16846 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:15.607733 16853 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:15.608238 16853 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.608356 16730 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.608661 16853 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:15.609215 16730 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.610057 16669 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:15.613191 13131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
W20260709 12:20:15.613412 16513 consensus_meta.cc:287] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.000s
I20260709 12:20:15.613781 13131 raft_consensus.cc:606] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:20:15.613976 16513 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.614199 13131 raft_consensus.cc:614] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:15.614589 16513 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.616446 13204 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:20:15.623044 16697 consensus_meta.cc:287] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 12:20:15.606952 16819 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:15.619616 16457 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:15.621323 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:15.622021 16730 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:15.623056 16844 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:15.623572 16304 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:15.599051 16673 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:15.603418 16723 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.625626 16604 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:15.627702 16503 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:15.630550 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:15.582629 13284 pending_rounds.cc:107] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:20:15.687059 13284 raft_consensus.cc:2889] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:15.587353 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.428380 16816 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.606302 16851 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:15.576758 16788 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:15.634979 13277 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:15.617424 16827 consensus_queue.cc:1059] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:15.645040 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:15.641088 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:15.649453 13879 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:15.652532 13206 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 5.
W20260709 12:20:15.660964 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 297881us
W20260709 12:20:15.670830 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 224405us
I20260709 12:20:15.627818 16835 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.656241 13883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:20:15.697798 13838 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:15.695070 13885 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:15.642040 16817 consensus_queue.cc:1059] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:20:15.700644 13883 raft_consensus.cc:606] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:15.711153 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:15.711401 13100 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:15.713078 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:15.720249 13279 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
W20260709 12:20:15.762228 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 50874.5us
I20260709 12:20:15.763296 13212 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:15.763242 13100 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:15.716081 13841 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:15.669490 16697 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.700297 16844 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:15.767558 13177 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:15.769321 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:15.767470 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 56409.7us
I20260709 12:20:15.767504 13205 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:15.769763 13277 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:15.700678 16851 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:15.704254 16831 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:15.713567 16669 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:20:15.801915 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 676055us
I20260709 12:20:15.810576 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:15.761699 16738 raft_consensus.cc:2764] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:20:15.773425 16818 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:20:15.801216 16821 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:20:15.699930 16493 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 12:20:15.825562 16493 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:15.826174 16493 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.826596 16493 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:15.827636 16855 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:20:15.830353 16867 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:20:15.832768 16835 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:15.814033 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 46521.3us
W20260709 12:20:15.815232 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.815462 13838 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:15.809442 16604 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:15.819607 13176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.005s	sys 0.008s
W20260709 12:20:15.839658 13176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.005s	sys 0.009s
W20260709 12:20:15.810652 16688 consensus_meta.cc:287] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.935s	user 0.012s	sys 0.000s
I20260709 12:20:15.772891 16703 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:15.805191 16872 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.808936 16507 consensus_meta.cc:287] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.899s	user 0.013s	sys 0.000s
I20260709 12:20:15.708128 16857 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
W20260709 12:20:15.813383 16804 consensus_meta.cc:287] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.971s	user 0.013s	sys 0.000s
I20260709 12:20:15.856555 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:15.842765 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 129778us
I20260709 12:20:15.811337 16495 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:15.851207 16872 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:15.865434 13102 leader_election.cc:336] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.655s (SENT)
I20260709 12:20:15.874768 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:15.766929 16860 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:20:15.834022 16864 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:15.886626 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:15.886831 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 121666us
I20260709 12:20:15.879860 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:15.843297 16497 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:15.891381 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:15.890517 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:15.898768 13209 raft_consensus.cc:2376] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11. Re-sending same reply.
I20260709 12:20:15.843483 16703 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.899582 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:15.894907 13206 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:15.811823 16844 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:15.849042 16818 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:15.904354 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 188361us
W20260709 12:20:15.908872 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 98364.5us
I20260709 12:20:15.884943 16669 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:15.880451 16804 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:15.884331 16715 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:20:15.917641 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 52265us
I20260709 12:20:15.909965 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:15.850531 16688 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.929956 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:15.930369 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:15.903729 16604 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:15.898509 16497 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.904649 16703 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:15.877619 16507 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:15.918955 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:15.883322 16632 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:20:15.907855 16751 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.933391 13203 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:15.934032 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:15.940514 13280 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:15.873049 16840 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:15.938062 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 101405us
I20260709 12:20:15.931031 16835 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:15.916206 16513 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:15.939142 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:15.936764 13206 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:15.955698 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:15.957137 13279 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:15.924998 16715 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:15.943310 13880 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:20:15.976608 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.991025 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:15.992378 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:15.995319 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 76688.9us
I20260709 12:20:15.963776 13884 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:15.996956 13208 raft_consensus.cc:2368] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9.
I20260709 12:20:15.935820 16497 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:15.962411 13279 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:16.002988 13209 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:15.936439 16771 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:16.081719 16877 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.106s	user 0.001s	sys 0.004s
I20260709 12:20:16.083328 16513 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:16.083999 16513 raft_consensus.cc:697] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:16.084798 16715 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.085142 16513 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.086187 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.087304 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:16.087930 13102 leader_election.cc:336] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.798s (SENT)
W20260709 12:20:16.088112 16879 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:20:16.088402 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:16.088593 16870 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:16.088426 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.097148 16870 raft_consensus.cc:697] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:15.963075 16816 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.103026 13280 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:15.961977 16723 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:16.106746 13206 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:20:16.046732 16831 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:15.996968 16457 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:16.047171 16817 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.080109 16673 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:16.099186 16867 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:20:15.943333 16804 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.164s
I20260709 12:20:15.962457 16669 raft_consensus.cc:697] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:16.126466 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 78428.8us
I20260709 12:20:15.954452 16865 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.158s
I20260709 12:20:15.957641 16751 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:16.114658 16833 consensus_meta.cc:287] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.863s	user 0.010s	sys 0.000s
I20260709 12:20:15.992033 16493 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:16.126456 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 170839us
I20260709 12:20:16.120630 13279 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:16.124310 16853 consensus_meta.cc:287] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.002s
W20260709 12:20:16.127794 16828 consensus_meta.cc:287] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.005s
I20260709 12:20:16.154247 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:16.157323 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 187513us
I20260709 12:20:16.128449 16457 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:16.126621 16697 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.162169 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:16.169278 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:16.155453 16842 consensus_meta.cc:287] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.931s	user 0.007s	sys 0.004s
I20260709 12:20:16.171285 13175 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:16.172070 13279 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:16.173792 16542 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:16.174079 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:16.174762 16886 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:20:16.176157 16825 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:16.177091 16669 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.178206 16816 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:16.178345 16751 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:16.179020 16882 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:20:16.180325 16493 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:16.157532 16833 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.178303 16883 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:16.182461 16883 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.183068 16833 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.180423 16840 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:16.189013 16851 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:16.184742 16883 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.195264 16833 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:16.195530 16840 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:16.197108 16851 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:16.162616 16864 raft_consensus.cc:697] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:16.192739 16816 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:16.184294 16673 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:16.197695 16840 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:16.197999 16673 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.184828 13207 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:16.183660 16823 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:16.198436 16870 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:16.198465 16673 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:16.199223 16864 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:16.204690 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.205051 16507 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:16.205821 16844 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:16.208354 13249 connection.cc:256] RPC call timeout handler was delayed by -4.0141494970000622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 12:20:16.217317 13249 connection.cc:256] RPC call timeout handler was delayed by -2.7546584379999786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 12:20:16.217880 13249 connection.cc:256] RPC call timeout handler was delayed by -2.7195584379999218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 12:20:16.219771 13249 connection.cc:256] RPC call timeout handler was delayed by -1.8196134649999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4249s for a response
I20260709 12:20:16.221124 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:16.222476 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:16.225003 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.225857 13137 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:16.163707 16494 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.168026 16771 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:16.231647 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.223943 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:16.231645 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:16.099032 16818 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:16.235474 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 273455us
I20260709 12:20:16.239580 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.243607 13131 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:16.244064 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:16.244273 13136 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:16.239693 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:16.248992 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.249567 13133 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:16.139561 16817 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.241856 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.240325 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.264180 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.160604 16853 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.265727 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:16.265810 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 177904us
I20260709 12:20:16.160835 16828 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.267088 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:16.267802 13137 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 6: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:16.271270 13133 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:16.277652 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.278535 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:16.272238 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.237812 16494 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.279480 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.214694 16842 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.274276 13277 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:20:16.273475 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:16.272629 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 51983.4us
I20260709 12:20:16.289036 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.267793 16804 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:16.289829 16804 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:16.290267 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.292040 13204 raft_consensus.cc:2368] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10.
I20260709 12:20:16.292132 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.267338 16883 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:16.288086 13277 pending_rounds.cc:85] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 4
I20260709 12:20:16.295370 13277 pending_rounds.cc:107] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:20:16.295687 13277 raft_consensus.cc:2889] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:16.276379 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.281208 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.288579 13279 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:16.281267 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.299214 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:16.286542 16503 consensus_meta.cc:287] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 12:20:16.292088 16804 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:16.304667 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.310949 13135 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:16.307962 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.311595 16880 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.311832 13879 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:16.312189 16880 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.286972 16872 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.322942 13881 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:16.328212 13879 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:16.285184 16494 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:16.340677 13129 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:16.344162 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.346486 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:16.286509 16673 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:16.353752 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 46587.3us
W20260709 12:20:16.360190 16788 consensus_meta.cc:287] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 12:20:16.363967 16874 consensus_queue.cc:1059] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:20:16.364898 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:16.365527 16878 log.cc:927] Time spent T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 12:20:16.366042 13886 raft_consensus.cc:2393] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:16.365119 16892 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:16.374938 16457 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.379506 16457 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:16.381523 16457 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:16.391541 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.394816 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.397037 13136 raft_consensus.cc:1217] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-7.5]   Dedup: 5.4->[7.5-7.5]
I20260709 12:20:16.397593 13136 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:20:16.364933 16874 raft_consensus.cc:3055] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:16.397779 13211 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:16.387009 16703 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.400624 16853 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.401427 16695 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.407923 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.409173 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.410213 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:16.393208 16834 consensus_meta.cc:287] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.814s	user 0.007s	sys 0.002s
W20260709 12:20:16.375245 16744 consensus_meta.cc:287] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.251s	user 0.015s	sys 0.000s
W20260709 12:20:16.378748 16836 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 1.255s	user 0.002s	sys 0.029s
I20260709 12:20:16.415419 13249 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:16.415521 13133 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:20:16.411127 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.418679 13131 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:16.421260 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:16.423381 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.424063 13881 raft_consensus.cc:2410] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:16.424494 13134 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:16.383397 16828 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.384522 16846 raft_consensus.cc:3055] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:16.430441 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.397230 16842 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.399561 16874 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:16.438692 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.437709 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.428779 16738 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:16.425064 16771 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:16.420073 16817 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.377429 16892 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:16.442895 13881 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:16.433198 16846 raft_consensus.cc:740] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:16.450510 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 75615us
I20260709 12:20:16.451800 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.415840 16497 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.425874 16744 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:16.455695 16703 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.458230 16831 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:16.459753 13209 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:20:16.466629 16744 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:16.467367 13282 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:16.468981 16846 consensus_queue.cc:260] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.470139 16846 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:16.471501 16874 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.472859 16874 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:16.476563 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.483560 13279 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:16.485263 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.486516 13204 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:16.488302 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.489645 13136 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:16.490424 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:16.491225 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.492260 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.480062 16817 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.491879 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.502009 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.503327 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.503933 13132 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:16.504470 16892 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:16.504791 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.508491 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 1998) took 1022 ms. Trace:
I20260709 12:20:16.508929 13278 rpcz_store.cc:276] 0709 12:20:15.486162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.486318 (+   156us) service_pool.cc:224] Handling call
0709 12:20:16.508299 (+1021981us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540023cb54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:16.508403 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273813760}
I20260709 12:20:16.510686 16688 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:16.512791 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 978) took 1425 ms. Trace:
I20260709 12:20:16.513188 13880 rpcz_store.cc:276] 0709 12:20:15.087370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.088953 (+  1583us) service_pool.cc:224] Handling call
0709 12:20:15.089342 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:15.992006 (+902664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.512508 (+520502us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54004f1854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:16.512706 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959812352}
I20260709 12:20:16.514619 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.519582 16842 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:16.524653 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.527354 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.528162 13278 raft_consensus.cc:2393] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:16.529279 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.529541 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.529865 13880 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:16.525766 13132 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:16.528340 16817 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.535651 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 980) took 1045 ms. Trace:
I20260709 12:20:16.536111 13884 rpcz_store.cc:276] 0709 12:20:15.489792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.489914 (+   122us) service_pool.cc:224] Handling call
0709 12:20:15.564480 (+ 74566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:15.996490 (+432010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.535394 (+538904us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54004d3354. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:16.535593 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917779840}
I20260709 12:20:16.537294 16817 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.538059 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 706) took 1470 ms. Trace:
I20260709 12:20:16.538631 13203 rpcz_store.cc:276] 0709 12:20:15.067580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.068134 (+   554us) service_pool.cc:224] Handling call
0709 12:20:15.105870 (+ 37736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:15.942109 (+836239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.537767 (+595658us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54002ee854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:16.537984 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1902609792}
W20260709 12:20:16.538651 16873 log.cc:927] Time spent T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Append to log took a long time: real 0.706s	user 0.004s	sys 0.000s
I20260709 12:20:16.543295 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:16.490581 16497 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.540099 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.537324 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.545792 13211 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:16.546244 13884 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:16.546604 13878 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:16.547586 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.548069 13881 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:16.549649 13203 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:16.548720 13175 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:16.551389 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.552212 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:16.552951 13211 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:16.553522 13175 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:16.550783 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:16.526443 16673 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:16.557507 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:16.551083 16831 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:16.560724 16831 raft_consensus.cc:697] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:16.558238 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.563205 13278 raft_consensus.cc:2393] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:16.561712 16831 consensus_queue.cc:237] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:16.565414 16835 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:16.566217 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.567757 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.569865 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:16.574494 13884 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:16.577708 13211 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:16.580418 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:16.572791 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.562533 16688 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:16.582759 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.557868 16892 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:16.562611 16497 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:16.585291 13100 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:16.589048 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.589521 13211 raft_consensus.cc:2376] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8. Re-sending same reply.
I20260709 12:20:16.593025 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.587673 16688 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.601408 13881 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:16.598603 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.601787 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:16.602654 13100 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:16.602705 13887 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:16.604841 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.604775 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:16.606178 13137 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:16.609650 16903 log.cc:927] Time spent T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:20:16.611215 13882 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:20:16.612028 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.613862 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.591717 16817 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:16.619812 13134 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:16.616485 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:16.620513 13881 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:16.581224 16703 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:20:16.623241 16673 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:16.623838 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.624181 16726 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:16.596603 16497 raft_consensus.cc:697] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:16.586651 16827 consensus_queue.cc:1059] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:20:16.637308 13103 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:16.606952 16688 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:16.629739 13100 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:16.639521 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.617296 16894 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:16.642261 13278 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:16.635669 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.645067 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.646327 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.656095 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.657313 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.657879 13211 raft_consensus.cc:2376] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10. Re-sending same reply.
I20260709 12:20:16.658658 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.659520 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.661067 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.669348 13132 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:16.668478 13137 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:16.671236 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.672314 13137 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:20:16.672111 16497 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.672895 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.673445 13137 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:16.674352 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:16.678642 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 49035us
I20260709 12:20:16.679807 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:16.680918 16884 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.566s	user 0.001s	sys 0.000s
I20260709 12:20:16.681085 16893 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:16.681604 16893 raft_consensus.cc:697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:16.682583 16893 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:16.683833 16913 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:20:16.685050 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.687083 13880 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:16.689491 13132 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:16.690621 16835 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:16.693308 16703 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:16.693563 16880 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:16.693517 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 56311.1us
I20260709 12:20:16.695268 16907 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:16.698477 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.711288 13279 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:16.711939 13280 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:20:16.746109 13280 pending_rounds.cc:85] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 6
I20260709 12:20:16.746456 13280 pending_rounds.cc:107] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:20:16.746511 13284 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:16.746981 13280 raft_consensus.cc:2889] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:16.717919 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.734282 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.741741 16845 raft_consensus.cc:3055] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:16.729485 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 715) took 1117 ms. Trace:
W20260709 12:20:16.746783 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.748915 13207 rpcz_store.cc:276] 0709 12:20:15.612488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.615418 (+  2930us) service_pool.cc:224] Handling call
0709 12:20:15.615725 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:16.198647 (+582922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.729155 (+530508us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400215cd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:16.729401 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308333312}
I20260709 12:20:16.643270 16673 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:16.754885 13840 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:16.756462 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.643810 16817 raft_consensus.cc:697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:16.707713 13203 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:16.763456 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:16.679248 16854 raft_consensus.cc:3055] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:16.764755 13283 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:16.764853 13281 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:16.758839 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:16.759958 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.768257 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.760353 13278 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:16.760982 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:16.748132 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.770509 13208 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:16.713472 16827 raft_consensus.cc:3055] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:16.775920 13284 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:20:16.745880 16867 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:20:16.769070 13280 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:16.775796 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.775879 13211 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:16.723591 16703 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.712930 16894 raft_consensus.cc:697] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:16.780813 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:16.781287 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.756026 16845 raft_consensus.cc:740] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:16.831840 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 105336us
I20260709 12:20:16.785136 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:16.866940 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.867654 13283 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:16.763038 16738 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.869774 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:16.788519 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.872987 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:16.873518 13284 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:16.873906 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2828) took 1015 ms. Trace:
I20260709 12:20:16.774899 16726 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:16.876622 13208 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:16.878083 13281 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:16.872643 13207 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:16.874442 13211 rpcz_store.cc:276] 0709 12:20:15.858388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.827855 (+969467us) service_pool.cc:224] Handling call
0709 12:20:16.873239 (+ 45384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:16.873466 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.873509 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:16.873569 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:16.873618 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.873690 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.873836 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:16.774842 16857 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.772763 16854 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:16.928630 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:16.776889 16827 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:16.994709 13203 raft_consensus.cc:2393] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:16.870630 16703 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:17.010798 13203 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:17.014882 16894 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:16.876863 16738 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:17.016129 16892 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:17.016207 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:17.017079 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:17.021325 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.036156 16673 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:17.037727 16817 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:17.038864 16867 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:20:17.044410 13207 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:20:17.048038 16854 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:16.999481 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.061841 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2834) took 1170 ms. Trace:
I20260709 12:20:17.082808 13203 rpcz_store.cc:276] 0709 12:20:15.897749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.010263 (+1112514us) service_pool.cc:224] Handling call
0709 12:20:17.010578 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.061464 (+ 50886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.061777 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:17.084897 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 720) took 1174 ms. Trace:
I20260709 12:20:17.085319 13203 rpcz_store.cc:276] 0709 12:20:15.910738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.083847 (+1173109us) service_pool.cc:224] Handling call
0709 12:20:17.084222 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.084451 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.084488 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:17.084564 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:17.084626 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.084697 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.084828 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:17.067517 13278 raft_consensus.cc:2393] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 6: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:17.088258 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:17.002909 16909 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 12:20:17.078526 13283 raft_consensus.cc:2393] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:17.128343 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:17.128865 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36412 (request call id 721) took 1208 ms. Trace:
I20260709 12:20:17.080499 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2832) took 1220 ms. Trace:
I20260709 12:20:17.134186 13206 rpcz_store.cc:276] 0709 12:20:15.920789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.088206 (+167417us) service_pool.cc:224] Handling call
0709 12:20:17.090754 (+1002548us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b54001c3754. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:17.128772 (+ 38018us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19277056}
I20260709 12:20:17.135016 13207 rpcz_store.cc:276] 0709 12:20:15.859998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.008588 (+1148590us) service_pool.cc:224] Handling call
0709 12:20:17.044092 (+ 35504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:17.080213 (+ 36121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.080443 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:17.138116 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:17.147584 13135 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:17.009616 16857 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.090147 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:17.129663 13210 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:17.152877 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:17.153023 13883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47544 (request call id 4) took 1478 ms. Trace:
I20260709 12:20:17.153825 13283 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:20:17.078608 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 213060us
I20260709 12:20:17.150750 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:17.160099 16862 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 1.553s	user 0.005s	sys 0.008s
I20260709 12:20:17.160429 13207 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:20:17.161195 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2836) took 1227 ms. Trace:
I20260709 12:20:17.161521 13207 rpcz_store.cc:276] 0709 12:20:15.934231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.159736 (+1225505us) service_pool.cc:224] Handling call
0709 12:20:17.160087 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.160922 (+   835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.161134 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:17.164145 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:17.165165 13281 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:17.153580 13883 rpcz_store.cc:276] 0709 12:20:15.632501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.634097 (+  1596us) service_pool.cc:224] Handling call
0709 12:20:17.088302 (+1454205us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b5400457520. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e0a520 00007f70f4e87652 00007f70f9e5560a 00007f70f33db7d4 00007f70f33db762 00007f70f33db691 00007f70f33db60c 00007f70f33da8c2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:17.110661 (+ 22359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209201920}
I20260709 12:20:17.170751 16854 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:17.177212 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 717) took 1564 ms. Trace:
I20260709 12:20:17.177634 13205 rpcz_store.cc:276] 0709 12:20:15.613152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.616813 (+  3661us) service_pool.cc:224] Handling call
0709 12:20:15.617090 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:15.814179 (+197089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.176955 (+1362776us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54002d5354. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:17.177145 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345474432}
I20260709 12:20:17.178984 13205 raft_consensus.cc:1240] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:17.181218 13103 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:17.183393 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2839) took 1079 ms. Trace:
I20260709 12:20:17.183851 13205 rpcz_store.cc:276] 0709 12:20:16.104235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.178513 (+1074278us) service_pool.cc:224] Handling call
0709 12:20:17.178810 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.179351 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.183336 (+  3985us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:17.185446 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2840) took 1060 ms. Trace:
I20260709 12:20:17.185813 13205 rpcz_store.cc:276] 0709 12:20:16.125240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.184639 (+1059399us) service_pool.cc:224] Handling call
0709 12:20:17.184936 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.185117 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.185143 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:17.185198 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:17.185236 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.185289 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.185391 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:17.190493 13284 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:17.192332 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:17.211711 13284 raft_consensus.cc:2410] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 9 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:17.212821 13284 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:17.216576 16921 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:20:17.225574 16864 raft_consensus.cc:3055] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:17.226228 16864 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:17.226930 13284 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:17.227360 13284 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:17.228121 16497 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:17.228236 13284 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:17.228789 16497 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.229384 13284 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:17.229562 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:17.234567 13278 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:20:17.180117 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:17.148526 16494 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.078711 16892 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.206620 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:17.208308 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 52205.8us
I20260709 12:20:17.245779 13283 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
W20260709 12:20:17.209332 16918 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:20:17.209234 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:17.253235 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.253528 13206 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:17.254804 13278 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:17.255236 13206 pending_rounds.cc:85] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 4
I20260709 12:20:17.256152 13206 pending_rounds.cc:107] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:20:17.256453 13206 raft_consensus.cc:2889] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:17.199141 13205 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:20:17.238183 13281 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:20:17.080462 16845 consensus_queue.cc:260] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.261533 13205 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:17.231240 16497 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:17.300314 13103 leader_election.cc:400] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10.
W20260709 12:20:17.302522 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 46704.5us
I20260709 12:20:17.304102 13103 leader_election.cc:400] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9.
W20260709 12:20:17.306741 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 482148us
W20260709 12:20:17.306329 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 481379us
I20260709 12:20:17.304641 13284 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:20:17.310272 13284 pending_rounds.cc:85] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 5
I20260709 12:20:17.310873 13284 pending_rounds.cc:107] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:20:17.311555 13284 raft_consensus.cc:2889] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:17.164857 16827 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.316320 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:17.316507 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:20:17.317309 13102 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 2.130s (SENT)
I20260709 12:20:17.321220 13879 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:17.291312 16893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.035s	sys 0.038s
I20260709 12:20:17.252936 16494 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.227224 16864 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:17.337520 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:17.340909 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.342561 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:17.343559 13881 raft_consensus.cc:2368] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8.
I20260709 12:20:17.319685 16853 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:17.358989 16919 log.cc:927] Time spent T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:17.360641 16703 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.354908 16854 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:20:17.355170 16827 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:17.368607 13879 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:17.371850 16703 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:17.378104 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1999) took 1891 ms. Trace:
I20260709 12:20:17.378626 13282 rpcz_store.cc:276] 0709 12:20:15.486501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.486623 (+   122us) service_pool.cc:224] Handling call
0709 12:20:15.486943 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:16.467809 (+980866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.377816 (+910007us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b5400230fd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:17.378034 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254254464}
I20260709 12:20:17.381496 13212 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:17.355329 16845 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:17.337939 16893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.035s	sys 0.038s
W20260709 12:20:17.414222 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 166573us
I20260709 12:20:17.415325 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:17.370507 16853 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:17.413836 16874 consensus_meta.cc:287] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.941s	user 0.012s	sys 0.002s
I20260709 12:20:17.484231 13279 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:20:17.484782 13279 pending_rounds.cc:85] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 7
I20260709 12:20:17.485051 13279 pending_rounds.cc:107] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:20:17.485339 13279 raft_consensus.cc:2889] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:17.424325 16723 consensus_queue.cc:1175] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b190224a708b4f068a6dda4006c3a133" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 9 index: 9 } }
I20260709 12:20:17.517273 16853 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:17.518096 16853 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:17.518507 16853 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:17.520226 16892 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:17.529528 16494 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:17.530339 16857 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:17.424829 16497 consensus_queue.cc:1059] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:20:17.537436 16497 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:17.538072 16497 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:17.542240 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2831) took 1682 ms. Trace:
I20260709 12:20:17.542848 13211 rpcz_store.cc:276] 0709 12:20:15.859708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.994318 (+1134610us) service_pool.cc:224] Handling call
0709 12:20:16.994722 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.996315 (+  1593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.996360 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:17.008129 (+ 11769us) log.cc:844] Serialized 26 byte log entry
0709 12:20:17.400601 (+392472us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:17.400675 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.400783 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:17.541925 (+141142us) raft_consensus.cc:1685] finished
0709 12:20:17.541956 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.542158 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1077,"raft.queue_time_us":7466,"spinlock_wait_cycles":49052544,"thread_start_us":317152,"threads_started":1,"wal-append.queue_time_us":466988}
I20260709 12:20:17.544507 16934 raft_consensus.cc:3055] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:17.545288 16934 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:17.414778 16930 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 12:20:17.567978 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:17.486994 16835 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:17.567615 16922 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 12:20:17.543030 16926 log.cc:927] Time spent T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:20:17.591848 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 273480us
W20260709 12:20:17.572188 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 235707us
W20260709 12:20:17.574244 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.592803 13840 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:17.593622 16893 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:20:17.572870 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.577832 13281 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:17.595297 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:17.595017 16857 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:17.596185 16494 consensus_queue.cc:1059] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:17.597811 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:17.597767 16494 consensus_queue.cc:1059] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:17.601130 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:17.603948 13282 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:20:17.605306 16929 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:17.546602 16934 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.663731 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2829) took 1805 ms. Trace:
I20260709 12:20:17.664248 13208 rpcz_store.cc:276] 0709 12:20:15.859056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.992726 (+1133670us) service_pool.cc:224] Handling call
0709 12:20:16.993224 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.995660 (+  2436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.995706 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:17.008201 (+ 12495us) log.cc:844] Serialized 26 byte log entry
0709 12:20:17.411835 (+403634us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:17.411876 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.411946 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:17.663404 (+251458us) raft_consensus.cc:1685] finished
0709 12:20:17.663453 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:17.663647 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1770,"raft.queue_time_us":8853,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":27203,"thread_start_us":329596,"threads_started":1,"wal-append.queue_time_us":555352}
I20260709 12:20:17.539227 16497 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:17.673887 16688 consensus_meta.cc:287] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.995s	user 0.010s	sys 0.003s
I20260709 12:20:17.674400 16688 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.676833 16688 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:17.612059 16853 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:17.677989 16853 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:17.678151 16688 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:20:17.679106 16916 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.986s	user 0.012s	sys 0.022s
I20260709 12:20:17.679651 13883 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:17.574209 16835 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.682633 16835 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:17.695485 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.705252 16304 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:17.683115 16934 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:17.683197 16835 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:17.718133 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.725020 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2825) took 1867 ms. Trace:
I20260709 12:20:17.733431 13209 rpcz_store.cc:276] 0709 12:20:15.857565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.117669 (+260104us) service_pool.cc:224] Handling call
0709 12:20:16.118059 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:16.460139 (+342080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.724741 (+1264602us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54002d4e54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:17.724953 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785070336}
I20260709 12:20:17.752005 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:17.753435 13279 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:17.755039 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:17.755944 13283 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:17.762456 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:17.751596 16874 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:17.769237 16874 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.771960 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:17.772843 13282 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:17.773528 16907 consensus_queue.cc:1059] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:17.794255 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:17.799041 16874 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:17.803076 16853 raft_consensus.cc:3055] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:17.803639 16853 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:17.804462 16853 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:17.779042 16828 consensus_queue.cc:1059] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:20:17.847455 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.741035 16835 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:17.854652 13249 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:17.890630 13839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.001s	sys 0.014s
W20260709 12:20:17.891223 13839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.001s	sys 0.014s
I20260709 12:20:17.839104 13282 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:17.902496 13283 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
W20260709 12:20:17.906080 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 490785us
I20260709 12:20:17.909437 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:17.926867 13209 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:17.890148 16941 raft_consensus.cc:993] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:20:17.865648 16946 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.155s
W20260709 12:20:18.023926 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 424801us
I20260709 12:20:18.018766 16934 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.024452 16937 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.050573 16497 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:18.062963 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 469085us
I20260709 12:20:18.062412 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1592) took 1607 ms. Trace:
W20260709 12:20:18.062325 16673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.004s	sys 0.012s
W20260709 12:20:18.099800 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.109167 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.067971 13205 rpcz_store.cc:276] 0709 12:20:16.455033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.262825 (+807792us) service_pool.cc:224] Handling call
0709 12:20:17.263138 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.263383 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:17.570817 (+307434us) log.cc:844] Serialized 14 byte log entry
0709 12:20:18.061962 (+491145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:18.062030 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:18.062099 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.062182 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.062340 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":564441,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"thread_start_us":709011,"threads_started":2}
I20260709 12:20:18.111421 16457 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:18.057077 16937 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.118369 16958 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:18.052389 16934 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:18.052320 16945 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:20:18.120867 16937 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:18.194375 16827 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.194897 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:18.174018 13175 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.582s (SENT) [suppressed 38 similar messages]
W20260709 12:20:18.131958 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.137064 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:18.228224 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:18.228866 13205 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:18.228801 13280 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:18.205211 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:18.230243 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:18.208313 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:18.127519 16964 consensus_queue.cc:1059] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 12:20:18.211804 13208 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:20:18.108474 16673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.004s	sys 0.012s
I20260709 12:20:18.214249 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:18.122593 16935 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:20:18.232806 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2810) took 1474 ms. Trace:
W20260709 12:20:18.231317 13102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.010s	sys 0.038s
I20260709 12:20:18.098933 16874 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:18.238358 13102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.011s	sys 0.038s
I20260709 12:20:18.237346 13280 rpcz_store.cc:276] 0709 12:20:16.754891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.820309 (+ 65418us) service_pool.cc:224] Handling call
0709 12:20:18.136948 (+1316639us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800183f98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68f8c 00007f70f1d68ef6 000000000036eb39 00007f70f9ddc1e0 00007f70f9ea50c4 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:20:18.229372 (+ 92424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30528640}
I20260709 12:20:18.239355 13277 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:18.138424 16955 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:18.239804 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 645919us
I20260709 12:20:18.132305 16632 raft_consensus.cc:1081] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:20:18.134101 16835 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:18.242660 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.243741 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 349327us
I20260709 12:20:18.245368 16954 raft_consensus.cc:3055] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:18.245913 16954 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:18.247669 16943 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.248324 16943 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.249064 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:18.251643 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:18.232692 16827 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.254324 16827 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:18.255263 16730 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:18.255786 16730 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.258131 16730 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:18.258585 16730 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.260373 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:18.261679 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:18.262450 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:18.263054 13880 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:18.244681 16955 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.265213 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:18.265796 16955 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:18.265813 13880 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:18.243522 16673 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.267997 16673 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.271157 16673 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:18.241683 16880 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.246850 16954 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:18.296913 13132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3642b79a5a004395947fefe912c71406"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:18.299983 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:18.298036 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:18.300611 13128 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:18.300887 13134 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:18.298599 13136 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:18.300495 13132 raft_consensus.cc:606] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:20:18.299995 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:18.302635 13132 raft_consensus.cc:614] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:18.302630 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:18.304087 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 253887us
I20260709 12:20:18.306430 13841 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:18.069924 16497 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:18.258993 16730 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:18.287637 16873 log.cc:927] Time spent T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:20:18.311971 13840 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:18.325707 13280 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:18.322798 13205 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:18.278257 16738 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:18.287544 16943 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:18.291416 16934 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:18.278254 16857 consensus_queue.cc:1175] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a99436c294734e5cbc3657b2517cefca" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 7 index: 7 } }
I20260709 12:20:18.276938 16955 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.339360 13102 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:18.368342 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 722) took 2403 ms. Trace:
I20260709 12:20:18.332686 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:18.312605 16846 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:18.300532 16964 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:18.371726 16964 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.372280 16738 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.372818 16738 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:18.373642 16885 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 2.224s	user 0.004s	sys 0.004s
I20260709 12:20:18.374014 16964 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:18.374900 16738 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:18.375859 16969 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:18.313119 16673 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:18.376287 16969 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:18.376730 16969 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:18.376538 16673 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.378821 16673 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:18.366119 16457 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:20:18.380445 16980 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:18.380666 16457 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.380964 16980 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.381270 16973 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:18.381352 16457 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.382429 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1396) took 2025 ms. Trace:
I20260709 12:20:18.382778 13129 rpcz_store.cc:276] 0709 12:20:16.357400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.357601 (+   201us) service_pool.cc:224] Handling call
0709 12:20:16.375701 (+ 18100us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.399096 (+ 23395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.399142 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:17.803327 (+1404185us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b1800342460. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d6e2a6 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a
0709 12:20:17.804256 (+   929us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b2c00000c88. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:20:17.804782 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:20:18.300655 (+495873us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:18.300706 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.300771 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.382225 (+ 81454us) raft_consensus.cc:1685] finished
0709 12:20:18.382246 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.382372 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3480,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":8777,"spinlock_wait_cycles":13347328,"thread_start_us":495518,"threads_started":1,"wal-append.queue_time_us":575822}
I20260709 12:20:18.370453 13280 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:18.382787 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 1994) took 2898 ms. Trace:
I20260709 12:20:18.312397 16887 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:18.384544 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 45281.1us
I20260709 12:20:18.368927 13207 rpcz_store.cc:276] 0709 12:20:15.964859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.162255 (+1197396us) service_pool.cc:224] Handling call
0709 12:20:17.162583 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:17.166506 (+  3923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.166551 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:17.181016 (+ 14465us) log.cc:844] Serialized 26 byte log entry
0709 12:20:17.573389 (+392373us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:17.573443 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.573519 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.368079 (+794560us) raft_consensus.cc:1685] finished
0709 12:20:18.368106 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.368267 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":29998,"thread_start_us":314333,"threads_started":1,"wal-append.queue_time_us":613628}
I20260709 12:20:18.386417 13102 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:18.388046 13102 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:18.389460 13128 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:18.383533 16955 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.384678 13285 rpcz_store.cc:276] 0709 12:20:15.484648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.485803 (+  1155us) service_pool.cc:224] Handling call
0709 12:20:15.566314 (+ 80511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:15.703759 (+137445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:15.703789 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:15.772892 (+ 69103us) log.cc:844] Serialized 26 byte log entry
0709 12:20:15.941923 (+169031us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:15.941969 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:17.493139 (+1551170us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54004083d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:17.493209 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.373024 (+879815us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:18.382572 (+  9548us) raft_consensus.cc:1685] finished
0709 12:20:18.382595 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.382725 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321575424,"thread_start_us":102457,"threads_started":1,"wal-append.queue_time_us":288819}
I20260709 12:20:18.369827 16954 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:18.312618 16880 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.400959 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:18.389202 16980 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:18.403173 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 229179us
I20260709 12:20:18.391148 16953 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:18.409195 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.433339 13880 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:18.397019 16964 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:18.435361 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:18.451324 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 116278us
W20260709 12:20:18.453303 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.460887 13134 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
W20260709 12:20:18.461979 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.463059 13209 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:18.463171 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:18.463824 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:18.464767 13209 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:18.466333 13102 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:18.434580 16604 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:18.468719 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:18.469231 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:18.434386 16936 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:18.450129 16946 consensus_queue.cc:1243] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer cbc6af7757ec459ab451e47724fdf44b log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:18.392115 16887 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.464350 16943 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:18.468371 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 142852us
I20260709 12:20:18.475287 13880 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:18.486603 13283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:42730
I20260709 12:20:18.487257 13283 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:18.491746 13283 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:18.497221 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:18.476050 13102 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:18.467904 16738 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.468782 16953 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:18.504163 13175 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:18.473892 16697 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:18.507247 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.509054 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:18.516216 13249 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:18.516659 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:18.517654 13840 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:18.524809 13102 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:18.525858 13203 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:20:18.493162 16978 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.527549 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:18.531988 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:18.528884 13204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1582) took 2194 ms (client timeout 1615 ms). Trace:
I20260709 12:20:18.530117 13102 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:20:18.533087 13204 rpcz_store.cc:269] 0709 12:20:16.327881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.394042 (+ 66161us) service_pool.cc:224] Handling call
0709 12:20:18.521854 (+2127812us) spinlock_profiling.cc:243] Waited 65 ms on lock 0x7b540032bed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:18.522008 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149601536}
I20260709 12:20:18.527892 13283 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.505512 16771 raft_consensus.cc:2764] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:20:18.549136 13249 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:18.550447 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:18.521241 16604 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:18.521309 16817 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:18.528743 16828 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:18.556591 13283 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:18.557364 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.504134 16738 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:18.537304 16827 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:18.535125 16946 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:18.539215 16831 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:18.541139 16845 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:20:18.554101 16972 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:18.560279 16730 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:18.555806 16673 consensus_queue.cc:1059] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:20:18.534673 16703 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:20:18.525334 16964 consensus_queue.cc:1059] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:20:18.545372 16953 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:18.492403 16936 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.545819 16697 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:18.539836 16978 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.586591 16986 consensus_queue.cc:1059] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:20:18.573081 16738 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:18.555984 16970 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:18.584969 13249 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:18.564329 16497 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:18.541173 16934 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:20:18.589829 16981 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:18.595451 16887 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:18.571086 16771 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:20:18.581634 16831 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.617484 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:18.573339 16827 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.613147 13281 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
W20260709 12:20:18.623515 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.609002 16974 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:20:18.615252 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:18.624632 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:18.624920 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:18.603067 16730 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:18.597532 16975 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:18.575965 16946 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:18.620792 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:18.599289 16953 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:18.625468 13249 leader_election.cc:400] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8.
I20260709 12:20:18.625528 13134 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:18.631846 13249 leader_election.cc:403] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:18.621971 16831 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:18.626214 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:18.632436 16981 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:18.633500 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:18.665125 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:18.658476 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:18.669652 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:18.670112 13134 raft_consensus.cc:2393] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:18.670392 13281 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:18.670053 13878 raft_consensus.cc:3055] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:18.671772 13878 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:18.670990 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:18.672217 13281 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:20:18.670946 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 45668.7us
I20260709 12:20:18.673378 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:18.635898 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.675814 13135 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:18.675886 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:18.676785 13281 raft_consensus.cc:2410] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 12 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:20:18.678014 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 160452us
I20260709 12:20:18.613996 16835 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:18.627660 16827 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:18.608304 16697 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.680019 13129 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 5. Current term is 6. Ops: []
W20260709 12:20:18.680922 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 136754us
I20260709 12:20:18.630016 16975 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.693022 13883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 702) took 1378 ms. Trace:
W20260709 12:20:18.694291 16912 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 2.023s	user 0.003s	sys 0.009s
I20260709 12:20:18.634400 16946 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:18.700713 13137 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:18.634208 16934 raft_consensus.cc:3055] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:18.630360 16738 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:18.702464 13883 rpcz_store.cc:276] 0709 12:20:17.314848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.314975 (+   127us) service_pool.cc:224] Handling call
0709 12:20:17.315269 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.680123 (+364854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.692797 (+1012674us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54005f0354. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:18.692965 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837511552}
W20260709 12:20:18.710911 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 180847us
I20260709 12:20:18.677167 16953 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:18.634783 16730 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.721374 16730 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:18.722404 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:18.736675 13280 raft_consensus.cc:2393] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:18.675079 16970 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8.
I20260709 12:20:18.738220 16970 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:18.738791 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2778) took 2285 ms. Trace:
I20260709 12:20:18.739228 13286 rpcz_store.cc:276] 0709 12:20:16.453748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.453884 (+   136us) service_pool.cc:224] Handling call
0709 12:20:16.459968 (+  6084us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:16.460362 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.460392 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:16.460967 (+   575us) log.cc:844] Serialized 52 byte log entry
0709 12:20:16.582924 (+121957us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:16.727358 (+144434us) log.cc:844] Serialized 14 byte log entry
0709 12:20:16.728765 (+  1407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.728844 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.693659 (+1964815us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:18.738493 (+ 44834us) raft_consensus.cc:1685] finished
0709 12:20:18.738596 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.738735 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":497182,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":7752,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":164,"spinlock_wait_cycles":72312064,"thread_start_us":256523,"threads_started":2,"wal-append.queue_time_us":170993}
I20260709 12:20:18.690646 13878 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.744007 13878 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:18.704802 16975 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:18.722021 16964 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:18.748852 16964 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:18.703572 16835 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:18.708488 16981 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:20:18.754730 13177 connection.cc:256] RPC call timeout handler was delayed by -1.6966445089999524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
I20260709 12:20:18.756441 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:18.757282 13880 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:18.768178 13878 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:18.710085 16934 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:18.768221 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:18.774585 13177 connection.cc:256] RPC call timeout handler was delayed by -1.2646551539999109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 12:20:18.786103 13881 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:18.776335 16947 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:18.790149 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:18.790105 16947 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.790848 13882 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:18.791706 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:18.792388 13882 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:18.793139 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:18.796339 13881 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:20:18.796816 13252 connection.cc:256] RPC call timeout handler was delayed by -1.8248730020000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.284s for a response
W20260709 12:20:18.801308 16977 log.cc:927] Time spent T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.340s	user 0.001s	sys 0.001s
I20260709 12:20:18.782187 13880 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:18.792273 16947 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:18.771071 16996 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.827244 16863 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:18.833463 13177 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:20:18.835237 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.786070 16981 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:18.847206 16936 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:18.848546 16961 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.586s	user 0.000s	sys 0.001s
I20260709 12:20:18.779536 17005 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.823580 16835 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:18.872033 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.872583 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.932092 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.971401 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:18.972563 13212 raft_consensus.cc:2410] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:20:18.974618 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.975876 13204 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:18.979866 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1954) took 2703 ms. Trace:
W20260709 12:20:18.980142 16969 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.001s
I20260709 12:20:18.980763 16969 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.982087 13878 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:18.980461 13130 rpcz_store.cc:276] 0709 12:20:16.276791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.276909 (+   118us) service_pool.cc:224] Handling call
0709 12:20:16.277239 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:16.306285 (+ 29046us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:16.373007 (+ 66722us) log.cc:844] Serialized 14 byte log entry
0709 12:20:16.688605 (+315598us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b18003ddbc0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f4a354bc 00007f70f1d8348b 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d23a
0709 12:20:16.726037 (+ 37432us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:16.758721 (+ 32684us) log.cc:844] Serialized 52 byte log entry
0709 12:20:16.758922 (+   201us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:16.758962 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.979419 (+2220457us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b540010d1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:18.979519 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.979573 (+    54us) raft_consensus.cc:1685] finished
0709 12:20:18.979591 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.979768 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57258,"prepare.queue_time_us":128981,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":1199,"raft.queue_time_us":74394,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":22373,"spinlock_wait_cycles":8620160,"thread_start_us":81439,"threads_started":2,"wal-append.queue_time_us":67113,"wal-append.run_cpu_time_us":7073,"wal-append.run_wall_time_us":1716466}
I20260709 12:20:18.984202 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:18.985183 13212 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:18.985651 16969 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:18.986891 13212 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:18.987604 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.967154 16703 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:18.877381 17005 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:18.989732 16703 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.977319 16845 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.991080 16845 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:18.991634 17005 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:18.987313 16999 consensus_queue.cc:1059] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:20:18.993589 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:18.994313 13129 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:18.994011 16981 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:18.845028 16947 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.129s
I20260709 12:20:18.968099 16835 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:20:19.000231 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 161687us
I20260709 12:20:19.001662 17012 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:18.970408 16955 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:19.007097 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:19.007979 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:19.008684 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:19.006297 16937 raft_consensus.cc:3055] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:18.976774 16738 raft_consensus.cc:697] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:19.015555 13212 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
W20260709 12:20:19.077880 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 69292.1us
I20260709 12:20:19.022297 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:19.032955 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.078797 13204 raft_consensus.cc:2393] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:19.078691 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:19.074381 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 397792us
I20260709 12:20:19.080058 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:18.839710 16996 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.083251 13177 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:19.083382 13880 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:18.856642 16934 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.008527 16964 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:19.089659 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.012863 17013 raft_consensus.cc:3055] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:19.008353 16835 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:19.091953 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.059540 16937 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:19.091212 16673 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:19.095984 16978 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:19.093582 17013 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:19.142208 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:19.093014 16697 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:19.097589 16835 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:19.159528 13252 connection.cc:256] RPC call timeout handler was delayed by -1.5109087839998665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
I20260709 12:20:19.146642 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:19.160295 13209 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:19.168926 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1589) took 2719 ms. Trace:
I20260709 12:20:19.103662 16497 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:19.175935 13209 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:19.169788 13206 rpcz_store.cc:276] 0709 12:20:16.449165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.254567 (+805402us) service_pool.cc:224] Handling call
0709 12:20:17.254992 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:17.611217 (+356225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.611274 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:17.611915 (+   641us) log.cc:844] Serialized 52 byte log entry
0709 12:20:18.056574 (+444659us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:18.111914 (+ 55340us) log.cc:844] Serialized 14 byte log entry
0709 12:20:18.112142 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.112426 (+   284us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.847943 (+735517us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:19.158439 (+310496us) raft_consensus.cc:1685] finished
0709 12:20:19.163306 (+  4867us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.168851 (+  5545us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54669,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":170374,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":46715,"spinlock_wait_cycles":37425536,"thread_start_us":709058,"threads_started":2,"wal-append.queue_time_us":605163}
I20260709 12:20:19.174697 13841 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:19.171712 13252 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:19.162672 16947 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:19.175595 16874 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:19.219839 16874 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.222160 16874 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:19.228013 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 56470.8us
I20260709 12:20:19.229075 13252 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:19.200713 16887 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:19.160210 16673 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.079488 17012 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.253134 16853 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:19.253363 17012 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:19.256085 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.258702 13285 raft_consensus.cc:3055] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:19.230296 16703 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:19.259222 13285 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:19.260058 13285 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.261152 13285 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:19.242389 17016 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:19.242542 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:19.242728 16673 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:19.235072 17013 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.225420 16874 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:19.243263 16987 consensus_queue.cc:1059] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:20:19.200889 16953 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.243825 17003 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:19.247684 16971 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.842s	user 0.000s	sys 0.002s
W20260709 12:20:19.306663 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 64166us
I20260709 12:20:19.321251 13252 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:19.325284 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.314551 17012 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:19.236596 16978 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:19.180238 16969 consensus_queue.cc:1059] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:20:19.305929 17016 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:19.235972 16887 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.180047 16738 consensus_queue.cc:237] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.330399 17013 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.350337 13252 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:19.353009 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.353847 13285 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:20:19.354225 13285 pending_rounds.cc:85] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 3
I20260709 12:20:19.354444 13285 pending_rounds.cc:107] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:20:19.354693 13285 raft_consensus.cc:2889] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:19.183818 16937 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.355487 16937 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:19.357965 13884 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:19.359635 16946 consensus_meta.cc:287] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.005s
I20260709 12:20:19.360080 16946 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.362109 16880 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:19.365687 16953 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:19.341943 17003 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:19.367208 17003 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.371686 16978 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:19.372035 16980 consensus_meta.cc:287] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.938s	user 0.011s	sys 0.000s
I20260709 12:20:19.337633 17015 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:19.372457 16980 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.372787 16978 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:19.375042 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.348907 17016 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:19.375887 13879 raft_consensus.cc:2393] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:20:19.376654 16954 consensus_meta.cc:287] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.975s	user 0.009s	sys 0.003s
W20260709 12:20:19.365773 16827 consensus_meta.cc:287] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.001s
I20260709 12:20:19.353739 16874 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:19.378522 16969 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.380716 16969 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.382335 16846 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:19.382833 16846 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:19.382884 16969 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:19.362550 16996 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:19.390405 13252 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:19.362257 16946 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:19.353343 16887 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:19.387624 16975 consensus_meta.cc:287] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.640s	user 0.008s	sys 0.006s
I20260709 12:20:19.378827 16827 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.403904 16874 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:19.421124 16831 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.000s
I20260709 12:20:19.421623 16831 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.408841 16975 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.431995 16831 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:19.433064 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:19.442057 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:19.443712 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:19.445019 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.445602 13100 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:19.449815 13886 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:19.451331 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:19.451987 13100 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:19.452000 13887 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:19.453991 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:19.457192 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:19.446264 16996 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.434017 16835 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.464605 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.449031 16953 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:19.466447 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.448222 16954 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:19.467024 13137 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 6.
I20260709 12:20:19.469003 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.469789 13130 raft_consensus.cc:2393] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:19.450024 17026 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.474786 16864 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.477561 13134 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:19.461602 16703 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:19.453629 16980 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:19.479230 16703 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:19.479596 16715 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:19.474519 17026 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.480187 16703 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.482292 17026 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:19.460072 16604 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:20:19.472059 16827 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:19.483731 16881 raft_consensus.cc:3055] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:19.462483 16975 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:19.415386 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 332169us
I20260709 12:20:19.431296 17016 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.493891 13177 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:19.470337 16953 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.500509 13177 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:19.491827 16881 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:19.519868 13177 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:19.467990 16996 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.484067 16954 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.501588 16831 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:19.499209 16953 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.502045 16955 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.526170 13177 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:19.517980 17029 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:19.528939 17027 consensus_queue.cc:1059] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:20:19.529870 13212 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:19.530054 16831 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:19.530086 16996 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:19.531303 16831 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:19.534720 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.535189 17029 raft_consensus.cc:697] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:19.535617 16881 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.536268 17029 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.537071 16881 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.537266 16835 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:19.539136 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.540269 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.541181 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.544034 17027 raft_consensus.cc:3055] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:19.544991 17027 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:19.545451 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.546113 13131 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:19.545863 17027 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.546989 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:19.548365 16936 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:19.549495 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.550654 13177 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:19.551664 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.557075 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.559017 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.559914 13285 raft_consensus.cc:2410] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:20:19.567179 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:19.571893 13838 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:19.576721 13100 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:19.547192 17027 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:19.578452 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:19.587903 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:19.589668 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.590394 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.592535 13285 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:19.592724 13280 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:19.593775 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:19.594537 13280 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:19.594058 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.596357 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.599468 13131 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:19.600162 13838 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:19.602129 13838 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:19.606915 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.616870 13102 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:19.591784 13886 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:19.536307 17016 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:19.618752 13249 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:19.614674 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:19.619836 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:19.620888 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.621668 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:19.622356 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.621912 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:19.626041 13881 raft_consensus.cc:2393] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:19.621430 13102 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:19.628525 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.630272 17028 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:19.632006 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:19.633466 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.634157 13286 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:19.637948 13885 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:19.642859 16996 consensus_queue.cc:1059] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:19.643270 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2835) took 3720 ms. Trace:
I20260709 12:20:19.643886 16996 raft_consensus.cc:3055] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:19.644548 16996 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:19.645547 16996 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.646807 16996 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:19.649402 13279 raft_consensus.cc:3055] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:19.649932 13279 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:19.651566 16928 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:19.614617 16860 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:19.619405 16604 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.653821 16604 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.656697 16604 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:19.657335 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2789) took 2968 ms. Trace:
I20260709 12:20:19.555349 16846 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.657711 13277 rpcz_store.cc:276] 0709 12:20:16.689368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.699247 (+  9879us) service_pool.cc:224] Handling call
0709 12:20:16.699641 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.239892 (+1540251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.657115 (+1417223us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54002648d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:19.657277 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3540492672}
I20260709 12:20:19.658265 16953 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.659641 16951 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.660212 16846 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:19.660158 16951 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.661093 17003 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:19.578554 17012 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.661669 17003 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.661880 17012 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.643869 13203 rpcz_store.cc:276] 0709 12:20:15.922780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.086420 (+1163640us) service_pool.cc:224] Handling call
0709 12:20:18.522113 (+1435693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:18.526381 (+  4268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.643016 (+1116635us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540032bed0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:19.643188 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3300267904}
I20260709 12:20:19.664602 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:19.664921 13129 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:19.665624 13841 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:19.662212 17003 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:19.659147 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:19.635169 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.666931 13286 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:19.588548 16958 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:19.599063 16835 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:20:19.692610 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 667) took 1382 ms. Trace:
I20260709 12:20:19.695971 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.727394 13283 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:19.727172 13282 rpcz_store.cc:276] 0709 12:20:18.310638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.311783 (+  1145us) service_pool.cc:224] Handling call
0709 12:20:18.319816 (+  8033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.385192 (+ 65376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:18.385221 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:18.385258 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:18.385285 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.692322 (+1307037us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b54004097d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:19.692374 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.692530 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149881728}
I20260709 12:20:19.623858 16669 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:19.669911 16969 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.657725 16997 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:19.699681 16857 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:19.631266 17008 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:19.699753 13133 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:19.552325 16955 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.704732 13280 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:19.709375 16494 raft_consensus.cc:2955] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:19.597440 16946 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
W20260709 12:20:19.724282 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 59769us
I20260709 12:20:19.724649 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:19.591017 16999 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:20:19.733809 13131 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:19.597729 16943 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:19.736738 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:19.615852 16827 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:20:19.742005 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.741636 13203 raft_consensus.cc:2955] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:19.758234 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:19.760528 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.764292 13133 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:19.768111 13102 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:19.737712 17005 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.772428 17000 consensus_queue.cc:1059] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:20:19.747049 16997 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:19.759689 16938 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.776198 13285 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:20:19.788257 13285 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:19.762053 16857 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:19.780447 13283 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:20:19.793305 13283 pending_rounds.cc:85] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 6
I20260709 12:20:19.793569 13283 pending_rounds.cc:107] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:20:19.793812 13283 raft_consensus.cc:2889] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:19.746711 16969 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.782220 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:19.773638 16846 raft_consensus.cc:2764] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:20:19.797122 13284 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:19.777854 16946 consensus_queue.cc:1243] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer cbc6af7757ec459ab451e47724fdf44b log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:19.799789 13102 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:19.782531 16853 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:19.800474 16953 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:19.800680 13282 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:20:19.805402 17010 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.643s	user 0.000s	sys 0.002s
W20260709 12:20:19.802788 13885 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 693) took 3550 ms (client timeout 2201 ms). Trace:
I20260709 12:20:19.807240 16669 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:19.800704 16703 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:19.808120 17035 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:20:19.812081 16970 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:19.816085 16857 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.821864 16969 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:19.798475 16938 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.831483 13177 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:19.837487 16996 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:19.836158 16874 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:19.782461 17008 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:19.779066 16604 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:19.785869 17005 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:19.786299 16997 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:19.844156 13885 rpcz_store.cc:269] 0709 12:20:16.252181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.256425 (+  4244us) service_pool.cc:224] Handling call
0709 12:20:19.802566 (+3546141us) spinlock_profiling.cc:243] Waited 3.36 s on lock 0x7b54007517d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:19.802683 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7716552064}
I20260709 12:20:19.852592 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:19.875331 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:19.876338 13282 raft_consensus.cc:2410] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:20:19.829084 17012 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:19.773376 16943 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.844308 16853 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.871124 16835 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:19.901051 16835 raft_consensus.cc:697] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:19.870958 16996 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.904558 16996 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:19.873584 17003 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:19.908120 16887 consensus_meta.cc:287] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.500s	user 0.005s	sys 0.005s
I20260709 12:20:19.908712 16887 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.910292 17003 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:19.910719 16887 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:19.917065 17005 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:20:19.874248 16970 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:19.921516 13277 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:19.919106 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 1965) took 1292 ms. Trace:
I20260709 12:20:19.924470 16970 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:19.923623 13128 rpcz_store.cc:276] 0709 12:20:18.626448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.626602 (+   154us) service_pool.cc:224] Handling call
0709 12:20:18.626954 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:18.633265 (+  6311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:18.633300 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:18.633869 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 12:20:19.002182 (+368313us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:19.002230 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.002321 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:19.804807 (+802486us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:19.918759 (+113952us) raft_consensus.cc:1685] finished
0709 12:20:19.918815 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.919047 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":203,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":38974,"spinlock_wait_cycles":19143040,"thread_start_us":367893,"threads_started":1,"wal-append.queue_time_us":454172}
I20260709 12:20:19.876792 16928 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:19.921111 16853 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:19.876380 17008 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:19.871485 16999 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:20:19.927740 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:19.937070 13203 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.899902 16943 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:19.948061 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 146244us
W20260709 12:20:19.956039 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.956511 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.956915 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.957427 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.958256 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.902365 16835 consensus_queue.cc:237] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:19.960041 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.960665 13131 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:19.962095 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:19.964229 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.965430 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.965517 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.966554 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.967794 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.966516 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:19.971351 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.977039 13133 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:19.978037 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:19.981901 13203 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:19.981518 13249 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:19.985803 13249 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:19.986626 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:19.987262 13128 raft_consensus.cc:2376] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9. Re-sending same reply.
W20260709 12:20:19.989099 17042 log.cc:927] Time spent T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:20:19.992827 16938 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:19.994143 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:19.994797 13132 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:19.994580 17008 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:20.022594 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.987006 16946 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:20.048053 16946 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.048538 16946 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:20.053413 16457 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:20.054273 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.066211 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.953131 16929 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.347s	user 0.009s	sys 0.029s
I20260709 12:20:20.016085 16978 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:20.085889 16929 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.480s	user 0.009s	sys 0.029s
I20260709 12:20:20.180980 16894 raft_consensus.cc:3055] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:20.181531 16894 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:20.182461 16894 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:20.085985 16457 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.185107 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:20.186481 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:20.188395 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 202671us
I20260709 12:20:20.191015 13132 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:20.195629 13128 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:20.204113 13249 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:20.210114 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:20.212471 13132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:20.213169 13132 raft_consensus.cc:606] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:20:20.213578 13132 raft_consensus.cc:614] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:20.219218 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:20.322741 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.322540 13134 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 1972) took 1545 ms (client timeout 1993 ms). Trace:
I20260709 12:20:20.329510 16996 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:20.184669 16929 raft_consensus.cc:697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:20.332206 16929 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:20.205565 16457 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:20.195007 16874 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:20.336532 16874 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:20.337867 16457 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:20.338522 16874 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:20.341522 16703 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:20.348939 13132 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:20:20.323230 13134 rpcz_store.cc:269] 0709 12:20:18.665013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.670765 (+  5752us) service_pool.cc:224] Handling call
0709 12:20:20.210126 (+1539361us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54001374d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:20.210233 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850902784}
I20260709 12:20:20.356568 13132 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:20:20.369576 16874 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:20.370321 16874 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:20.371881 13132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:20.372144 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:20.372494 13132 raft_consensus.cc:606] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:20.372740 13283 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:20.374190 16996 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:20.372846 13132 raft_consensus.cc:614] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:20.379825 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:20.353015 16894 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:20.355770 16703 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.403021 13131 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:20.411007 13128 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
W20260709 12:20:20.441159 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.665019 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.461117 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.666401 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.667757 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.472445 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.669957 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.509362 16494 consensus_meta.cc:287] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.000s
I20260709 12:20:20.518509 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1001) took 1749 ms. Trace:
I20260709 12:20:20.550148 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 652) took 1095 ms. Trace:
I20260709 12:20:20.671108 13884 rpcz_store.cc:276] 0709 12:20:18.768812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.769442 (+   630us) service_pool.cc:224] Handling call
0709 12:20:19.357784 (+588342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.358379 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.518240 (+1159861us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54006194d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:20.518429 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285147392}
I20260709 12:20:20.403452 16703 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:20.566569 13280 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.021s	sys 0.062s
W20260709 12:20:20.702450 13280 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.026s	sys 0.063s
W20260709 12:20:20.573992 13251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.028s	sys 0.083s
I20260709 12:20:20.406719 16853 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:20.629251 17052 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:20:20.689555 16854 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:20.720804 16946 consensus_meta.cc:287] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.002s
W20260709 12:20:20.707940 13282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.000s	sys 0.017s
W20260709 12:20:20.706845 13251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.028s	sys 0.084s
W20260709 12:20:20.752385 13282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.000s	sys 0.018s
I20260709 12:20:20.671241 13135 rpcz_store.cc:276] 0709 12:20:19.454433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.454556 (+   123us) service_pool.cc:224] Handling call
0709 12:20:19.464719 (+ 10163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.531081 (+ 66362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.531112 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:19.531153 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:19.531192 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.549760 (+1018568us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b540010c2d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:20.549836 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.550054 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":370,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":151905024}
I20260709 12:20:20.722903 16688 raft_consensus.cc:3055] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:20.714790 16942 raft_consensus.cc:3055] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:20.756151 16688 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:20.778543 13211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.000s	sys 0.015s
W20260709 12:20:20.778996 13211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.000s	sys 0.016s
I20260709 12:20:20.796381 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:20.797101 13282 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:20.726114 16854 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:20.801386 16854 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:20.802299 16954 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:20.771760 16942 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:20.772701 17003 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:20.765651 16946 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:20.829353 16990 log.cc:927] Time spent T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 2.237s	user 0.005s	sys 0.007s
I20260709 12:20:20.825332 16929 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:20.858390 13284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.016s	sys 0.061s
W20260709 12:20:20.858899 13284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.017s	sys 0.061s
I20260709 12:20:20.859608 13282 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:20:20.859681 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2030) took 1275 ms. Trace:
I20260709 12:20:20.860283 13284 rpcz_store.cc:276] 0709 12:20:19.584040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.830843 (+246803us) service_pool.cc:224] Handling call
0709 12:20:19.846868 (+ 16025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.847110 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:19.950599 (+103489us) log.cc:844] Serialized 14 byte log entry
0709 12:20:20.859281 (+908682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:20.859335 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:20.859387 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.859484 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.859614 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20860,"prepare.queue_time_us":193922,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":198520,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":967453,"threads_started":3,"wal-append.queue_time_us":738624}
W20260709 12:20:20.863711 17054 log.cc:927] Time spent T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 12:20:20.864784 17059 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:20:20.871845 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2825) took 1310 ms. Trace:
I20260709 12:20:20.872259 13280 rpcz_store.cc:276] 0709 12:20:19.561587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.756469 (+194882us) service_pool.cc:224] Handling call
0709 12:20:19.756978 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:19.765068 (+  8090us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:19.871140 (+106072us) log.cc:844] Serialized 14 byte log entry
0709 12:20:20.704619 (+833479us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.705605 (+   986us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.705823 (+   218us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:20.705870 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.705962 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:20.871625 (+165663us) raft_consensus.cc:1685] finished
0709 12:20:20.871645 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.871785 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7605,"prepare.queue_time_us":190772,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":16697,"raft.queue_time_us":313195,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":13607,"thread_start_us":886748,"threads_started":3,"wal-append.queue_time_us":516433}
W20260709 12:20:20.869846 17012 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.000s	sys 0.021s
W20260709 12:20:20.888612 17012 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.000s	sys 0.021s
I20260709 12:20:20.888504 17055 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.889369 17055 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:20.895140 13249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.014s	sys 0.007s
I20260709 12:20:20.838666 17003 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:20.895539 13249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.015s	sys 0.007s
W20260709 12:20:20.898873 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 679689us
W20260709 12:20:20.900429 13840 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.015s
W20260709 12:20:20.900825 13840 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.007s	sys 0.015s
W20260709 12:20:20.901134 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 534298us
W20260709 12:20:20.902315 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.902778 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.822973 16688 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:20.896505 16835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.006s	sys 0.017s
W20260709 12:20:20.907033 16835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.006s	sys 0.017s
I20260709 12:20:20.907039 16688 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:20.914132 13283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.011s	sys 0.011s
I20260709 12:20:20.862565 16929 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:20.917290 13283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.012s	sys 0.011s
I20260709 12:20:20.923648 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:20.925014 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:20.901043 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:20.925833 13134 raft_consensus.cc:2368] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
I20260709 12:20:20.915329 16726 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.933768 13134 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:20.940438 13132 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:20.941437 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:20.941619 13135 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:20.945983 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:20.946861 13249 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:20.924654 16703 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:20.873224 16942 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:20.917727 16853 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:20.918059 16835 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:20.956377 13284 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:20:20.942265 16972 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:20:20.956480 17012 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:20.967094 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:20.938366 16726 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:20.949991 17061 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:20.973934 13136 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:20.975402 17012 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:20.967057 16835 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:20.977193 16845 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:20.978801 16726 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:20.979053 16951 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:21.021173 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2036) took 1151 ms. Trace:
I20260709 12:20:21.021597 13285 rpcz_store.cc:276] 0709 12:20:19.869392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.502766 (+633374us) service_pool.cc:224] Handling call
0709 12:20:20.503269 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.503779 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.503825 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.504456 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.916888 (+412432us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:20.916948 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.917020 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.020964 (+103944us) raft_consensus.cc:1685] finished
0709 12:20:21.020983 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.021114 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12195,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":286230,"threads_started":1,"wal-append.queue_time_us":440488}
I20260709 12:20:20.982702 16771 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:21.023373 16771 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:21.025578 16771 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:20.984508 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 749) took 1890 ms. Trace:
I20260709 12:20:21.026489 13211 rpcz_store.cc:276] 0709 12:20:19.094010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.094187 (+   177us) service_pool.cc:224] Handling call
0709 12:20:19.094492 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:19.105103 (+ 10611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.105132 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:19.139752 (+ 34620us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.186779 (+1047027us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b18003f3220. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1 00007f70f4e48a0f
0709 12:20:20.779531 (+592752us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:20.779574 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.779643 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:20.984196 (+204553us) raft_consensus.cc:1685] finished
0709 12:20:20.984225 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.984438 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10255,"raft.queue_time_us":86840,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":25614,"spinlock_wait_cycles":43719936,"thread_start_us":592539,"threads_started":1,"wal-append.queue_time_us":1777469}
W20260709 12:20:20.995668 13880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 1013) took 1421 ms (client timeout 1846 ms). Trace:
W20260709 12:20:21.028466 13880 rpcz_store.cc:269] 0709 12:20:19.573925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.574108 (+   183us) service_pool.cc:224] Handling call
0709 12:20:20.995409 (+1421301us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54004f1854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:20.995580 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2717846400}
I20260709 12:20:21.000653 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2031) took 1416 ms. Trace:
I20260709 12:20:21.029445 13277 rpcz_store.cc:276] 0709 12:20:19.584284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.658892 (+ 74608us) service_pool.cc:224] Handling call
0709 12:20:21.000460 (+1341568us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540029dbd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:21.000592 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585918336}
W20260709 12:20:21.007504 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.003695 16934 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:21.013612 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:21.036967 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:21.014106 13103 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:21.039942 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:20.952366 17060 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:20:21.041160 17060 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:21.041673 17060 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.014101 17012 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:21.017812 16835 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.018880 16907 consensus_queue.cc:1059] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:20.972904 16942 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:20.957151 17056 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:20:21.052207 13841 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:21.022781 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:42890 (request call id 0) took 1481 ms. Trace:
I20260709 12:20:21.057756 13209 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:21.058940 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.051947 13203 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:20.974561 16972 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:21.065423 13211 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:21.006744 17061 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:21.064615 13137 rpcz_store.cc:276] 0709 12:20:19.540876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.541982 (+  1106us) service_pool.cc:224] Handling call
0709 12:20:21.022437 (+1480455us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400136fd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e93735 00007f70f4e8b9fa 00007f70f9e534c9 00007f70f33cfc54 00007f70f33cfbe2 00007f70f33cfb11 00007f70f33cfa8c 00007f70f33ced42 00007f70f31c848c 00007f70f31c78c6
0709 12:20:21.022675 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308434816}
I20260709 12:20:21.013955 16703 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:21.067121 16854 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:21.085705 16854 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:21.086212 16854 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:21.087910 16978 consensus_meta.cc:287] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.930s	user 0.012s	sys 0.000s
I20260709 12:20:21.088379 16978 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:21.073689 16951 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:21.091547 16703 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.093154 16854 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.077507 17061 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:21.096550 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2035) took 1227 ms. Trace:
I20260709 12:20:21.096994 13283 rpcz_store.cc:276] 0709 12:20:19.868944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.373376 (+504432us) service_pool.cc:224] Handling call
0709 12:20:20.373694 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.374037 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.374064 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.374548 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.925769 (+551221us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:20.925810 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.925882 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.096333 (+170451us) raft_consensus.cc:1685] finished
0709 12:20:21.096356 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.096492 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1379,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":544367,"threads_started":1,"wal-append.queue_time_us":720296}
W20260709 12:20:21.103825 17067 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:20:21.060663 16954 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:21.059720 17029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.406s	user 0.035s	sys 0.050s
I20260709 12:20:21.063779 16946 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:21.075141 16943 consensus_meta.cc:287] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.121s	user 0.010s	sys 0.003s
I20260709 12:20:21.094362 16703 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.124245 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:21.127206 13137 raft_consensus.cc:2368] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7.
I20260709 12:20:21.110913 17055 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:21.130613 17029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.493s	user 0.035s	sys 0.050s
I20260709 12:20:21.122193 17060 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.126866 17063 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:21.134145 16997 consensus_meta.cc:287] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.236s	user 0.013s	sys 0.000s
I20260709 12:20:21.129710 17003 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.129462 16951 raft_consensus.cc:697] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:21.138988 16993 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.130158 16943 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:21.189867 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 271960us
I20260709 12:20:21.190840 13177 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:21.137418 16992 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 12:20:21.200369 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.200901 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.189090 16929 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:21.205415 17084 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.172713 17063 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.180965 16997 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:21.192691 16993 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.206897 16907 consensus_queue.cc:1243] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:20:21.212514 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 157277us
I20260709 12:20:21.203954 17029 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:21.203262 13177 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:21.226045 13019 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica af3f42f0797349058724e0cb2e637d24 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:20:21.228282 13019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 93014.1us
I20260709 12:20:21.229341 16604 consensus_queue.cc:1059] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:21.237076 16955 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:21.240216 16993 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:21.209514 17084 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:21.216964 17029 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.230237 16943 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:21.250873 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 47676.6us
I20260709 12:20:21.212332 16972 raft_consensus.cc:697] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:21.260293 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.266351 13283 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:21.261695 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:21.250115 17029 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:21.262005 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.224640 16934 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:21.268132 16934 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.263243 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.267302 17003 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:21.269819 17003 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:21.270174 16934 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:21.271881 16894 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.872s	user 0.010s	sys 0.003s
I20260709 12:20:21.272531 17003 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:21.221973 16951 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.272914 17083 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:21.273459 17083 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.258529 16845 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.279124 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:21.279296 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.279974 13284 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:21.278367 13136 raft_consensus.cc:2410] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:20:21.282315 13252 leader_election.cc:336] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 2.330s (SENT)
W20260709 12:20:21.281867 13249 leader_election.cc:336] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.861s (SENT)
I20260709 12:20:21.283006 13252 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:21.285238 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 154758us
I20260709 12:20:21.286101 13841 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:21.287058 16726 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:21.287494 16726 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.287845 16726 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:21.291177 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:21.291894 13880 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:21.296422 16771 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.297108 16771 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.304121 17003 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:21.304920 17003 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.275985 16972 consensus_queue.cc:237] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:21.308153 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.310050 13283 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:21.310845 16771 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.311610 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.312521 17003 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.316186 13277 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:21.316406 13880 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:21.306432 16726 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.283274 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:21.319199 13137 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:21.336774 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.275849 16943 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:21.265699 16978 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:21.265895 16835 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:21.275394 17083 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:21.330575 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 131999us
I20260709 12:20:21.276465 16997 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:21.334885 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.333853 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 52031.9us
W20260709 12:20:21.343660 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.351375 13284 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:21.333715 17056 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:21.353521 16929 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.340786 16943 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:21.354283 16835 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.276759 16845 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.334496 17003 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:21.420837 13887 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:21.364005 16934 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.334566 17082 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:20:21.366572 17091 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:21.432794 17091 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:21.434937 16726 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:21.435325 17091 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:21.426879 16929 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.437673 16929 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:21.438459 16934 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:21.440552 16934 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:21.443907 16943 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.445057 16943 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:21.445734 17097 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.446229 17097 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.421759 16835 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:21.452036 17063 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.366091 16978 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.457497 16978 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.458518 17101 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:21.437597 17061 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:21.459991 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 150768us
I20260709 12:20:21.461972 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:21.462301 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.462550 13284 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:20:21.462924 13283 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:21.463186 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:21.463446 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.463737 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.463778 13280 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:21.465040 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.465597 13283 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:21.465915 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.466208 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:21.466456 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.459107 17101 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:21.469972 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.471064 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.472680 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:21.473762 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:21.474452 13209 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:21.474953 13204 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:21.475001 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.475742 13210 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:21.476926 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.477595 13207 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:21.483180 13280 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:21.484570 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:21.485129 13886 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:21.490458 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:21.490571 13284 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:21.491909 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:21.492717 13880 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:21.495805 13100 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:21.496614 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:21.496919 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:21.497547 13204 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:21.497859 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.499531 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:21.502298 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.477790 17099 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.503688 17099 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:21.505857 17099 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:21.512818 13841 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:21.514086 13841 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:21.475914 17078 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.524211 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.552755 13277 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:21.553265 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:21.586117 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.590422 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:21.635509 13204 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:21.593842 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.635715 13210 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:21.556838 16975 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:21.643867 13177 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:21.642701 13841 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:21.591632 17095 log.cc:927] Time spent T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:20:21.553151 17092 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.645277 13284 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:21.523623 16894 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:21.648583 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:21.656891 13204 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:20:21.553526 16304 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:21.644980 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.668776 13283 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:21.666847 13204 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:21.675146 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.644184 17094 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.649618 16975 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.684580 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.686285 13284 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:21.687093 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.687860 13284 raft_consensus.cc:2410] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:21.668064 16304 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.653012 17076 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:21.689498 13210 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:21.689738 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:21.673491 17091 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:21.677685 17080 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.319s	user 0.001s	sys 0.001s
I20260709 12:20:21.706252 13284 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:21.713476 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.716053 13175 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:21.716915 13204 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:21.676456 17083 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.586329 17078 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:21.691756 17090 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:20:21.679162 17098 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:20:21.689247 17094 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:21.675532 17097 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.689292 16975 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:21.706817 16304 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:21.685180 16894 raft_consensus.cc:697] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:21.679531 17088 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:21.688405 17107 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:21.785701 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:22.071041 13205 raft_consensus.cc:2376] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8. Re-sending same reply.
I20260709 12:20:22.071978 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:22.072988 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.670684 17092 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:22.051369 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 290064us
W20260709 12:20:21.955691 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.053467 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:22.077390 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:22.077745 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:22.078771 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:21.963512 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.079831 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.735620 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:22.081261 13137 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:20:22.052888 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.044463 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:22.082574 13284 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:22.053941 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:22.054180 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:22.083756 13204 raft_consensus.cc:2376] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10. Re-sending same reply.
I20260709 12:20:22.084316 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:22.084796 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:22.085623 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:22.052309 13252 leader_election.cc:336] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 2.504s (SENT)
I20260709 12:20:22.086210 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:22.086820 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:22.087021 13204 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:21.978029 13886 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:21.739156 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:22.088660 13134 raft_consensus.cc:2376] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7. Re-sending same reply.
I20260709 12:20:21.738349 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:21.782333 16835 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.821337 16943 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.717967 17084 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:21.821449 17012 consensus_meta.cc:287] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.000s
W20260709 12:20:21.778287 17064 log.cc:927] Time spent T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:22.078855 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:21.784478 17075 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.690701 17099 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:20:21.784631 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:22.119738 13210 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:22.120352 16970 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:22.122264 13207 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:20:22.091502 13204 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:22.125460 16304 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:21.787442 17101 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.760382 17097 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.726608 17083 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.127633 17097 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.129107 17083 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:22.129599 17097 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.731655 16845 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:21.735595 17079 log.cc:927] Time spent T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 12:20:22.105047 13284 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:22.132584 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:22.133127 13284 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:22.077028 17107 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:22.135526 17107 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:22.136556 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:22.137974 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:22.107067 16835 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:21.785315 17109 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:21.718703 17076 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:22.141587 17076 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:22.090538 17088 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:22.142728 17088 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.143254 13210 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:22.144114 17094 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:22.144454 17099 raft_consensus.cc:3055] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:22.144881 17099 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:22.139321 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:22.129992 17012 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.131757 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2822) took 2571 ms. Trace:
I20260709 12:20:22.148396 13285 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:21.720742 17091 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.070546 17061 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:22.107707 16943 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.148665 13281 rpcz_store.cc:276] 0709 12:20:19.560778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.560892 (+   114us) service_pool.cc:224] Handling call
0709 12:20:19.561211 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:19.561563 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.561594 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:19.562054 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:20:21.018561 (+1456507us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b1800023b00. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1 00007f70f4e48a0f
0709 12:20:21.289806 (+271245us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:21.289848 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.289915 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:22.131489 (+841574us) raft_consensus.cc:1685] finished
0709 12:20:22.131510 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:22.131700 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2005,"raft.queue_time_us":16071,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":28410,"spinlock_wait_cycles":10586368,"thread_start_us":271036,"threads_started":1,"wal-append.queue_time_us":1755113}
I20260709 12:20:22.147104 13284 raft_consensus.cc:2410] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:20:22.121465 16894 consensus_queue.cc:237] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.152204 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:22.151345 13136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 1986) took 1189 ms. Trace:
I20260709 12:20:22.154524 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:22.154536 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:22.171358 13284 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:22.172366 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:22.172905 13284 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:22.174562 13284 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:22.157552 13136 rpcz_store.cc:276] 0709 12:20:20.962150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.036675 (+ 74525us) service_pool.cc:224] Handling call
0709 12:20:22.146766 (+1110091us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540011c954. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:22.151263 (+  4497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553135360}
I20260709 12:20:22.178601 13285 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:22.182360 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:22.184523 17092 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:22.145685 17099 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:22.188185 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.192519 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:22.193902 13284 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:22.193288 13281 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 5.
I20260709 12:20:22.195127 13284 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:22.146138 17084 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:20:22.181560 16854 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:22.148916 17075 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:22.204216 13838 connection.cc:256] RPC call timeout handler was delayed by -1.8388721010001063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 12:20:22.205020 13838 connection.cc:256] RPC call timeout handler was delayed by -1.0971175539998512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28900000000000003s for a response
I20260709 12:20:22.207468 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:22.208200 13883 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:22.201901 13281 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:22.210222 13886 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:22.190811 13285 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:22.207821 16863 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:22.216981 17099 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:22.217216 16863 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.221354 13882 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:22.222710 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:22.223989 16988 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 3.631s	user 0.003s	sys 0.021s
I20260709 12:20:22.225292 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 664) took 3915 ms. Trace:
I20260709 12:20:22.226255 17091 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:22.227038 17089 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.869s	user 0.003s	sys 0.000s
W20260709 12:20:22.204664 17029 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.937s	user 0.006s	sys 0.005s
I20260709 12:20:22.201181 16854 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:22.240775 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2039) took 1469 ms. Trace:
I20260709 12:20:22.241339 13282 rpcz_store.cc:276] 0709 12:20:20.771349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.797893 (+ 26544us) service_pool.cc:224] Handling call
0709 12:20:20.798180 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.860223 (+ 62043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.240485 (+1380262us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b54000e6d54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:22.240703 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140690304}
W20260709 12:20:22.247229 13280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.009s	sys 0.020s
W20260709 12:20:22.247663 13280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.010s	sys 0.020s
I20260709 12:20:22.229741 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:22.228714 13209 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:22.225680 13278 rpcz_store.cc:276] 0709 12:20:18.309651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.319458 (+  9807us) service_pool.cc:224] Handling call
0709 12:20:18.365112 (+ 45654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:18.365557 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:18.365592 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:18.371138 (+  5546us) log.cc:844] Serialized 26 byte log entry
0709 12:20:18.488033 (+116895us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:18.488084 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.488156 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:22.198365 (+3710209us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:22.224978 (+ 26613us) raft_consensus.cc:1685] finished
0709 12:20:22.225002 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:22.225231 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9991,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":2205,"spinlock_wait_cycles":19891072,"thread_start_us":111911,"threads_started":1,"wal-append.queue_time_us":221760}
I20260709 12:20:22.152833 16304 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:22.254282 13282 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:22.255878 13282 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:22.259366 13175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.003s	sys 0.028s
W20260709 12:20:22.259758 13175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.003s	sys 0.028s
W20260709 12:20:22.260351 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 544331us
W20260709 12:20:22.265482 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.277778 13883 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
W20260709 12:20:22.237373 16934 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.011s	sys 0.040s
I20260709 12:20:22.281320 13282 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:22.284085 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.291137 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:22.302362 13282 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:22.303247 13286 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:22.304783 13129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1423) took 2325 ms (client timeout 1861 ms). Trace:
I20260709 12:20:22.305099 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:22.305209 13129 rpcz_store.cc:269] 0709 12:20:19.979356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.294777 (+2315421us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:22.304712 (+  9935us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:22.307153 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:22.309861 13887 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:20:22.295804 16934 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.011s	sys 0.041s
I20260709 12:20:22.324819 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:22.332669 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:22.334209 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:22.295774 16863 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:22.285645 17078 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:22.314814 16975 consensus_meta.cc:287] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.003s
I20260709 12:20:22.310647 16494 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.310235 17071 raft_consensus.cc:2764] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:20:22.297068 16999 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:20:22.313884 16929 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:22.333545 16304 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.359143 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:22.337944 16892 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:22.357168 13175 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:22.246304 17029 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:22.364162 13175 leader_election.cc:400] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
I20260709 12:20:22.364544 13175 leader_election.cc:403] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:22.366938 13285 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:22.297696 17111 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.072s
W20260709 12:20:22.373703 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 246587us
I20260709 12:20:22.379868 13175 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:22.380234 13100 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:22.383858 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:22.384555 13129 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:22.384732 17078 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.385335 17078 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.385880 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:22.386639 13887 raft_consensus.cc:2368] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7.
I20260709 12:20:22.386973 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:22.387521 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:22.387761 13282 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 7: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:22.388367 13286 raft_consensus.cc:2410] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:22.389170 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:22.389611 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:22.390206 13282 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:22.390447 13285 raft_consensus.cc:2410] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:20:22.390910 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:22.391235 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:22.392000 13137 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:22.393633 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:22.368738 17012 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:22.358369 16975 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.396770 13130 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:22.397347 13134 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:22.407857 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:22.408520 13134 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:22.410497 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:22.375221 13838 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:22.398727 13178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.016s	sys 0.012s
W20260709 12:20:22.415593 13178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.017s	sys 0.012s
I20260709 12:20:22.383168 17091 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:22.421306 13130 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:22.360386 16494 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.395100 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:22.339759 16854 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.404240 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:22.433125 13880 raft_consensus.cc:2410] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:22.405598 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:22.433672 13887 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:22.406260 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:22.434508 13282 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:22.435774 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:22.404829 13132 raft_consensus.cc:2955] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:22.420768 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:22.370273 17102 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:22.421945 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 345842us
W20260709 12:20:22.422443 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 47361.7us
I20260709 12:20:22.444073 13838 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:22.388628 16943 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:22.390215 17005 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8.
I20260709 12:20:22.440163 13134 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
W20260709 12:20:22.456037 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 50051us
I20260709 12:20:22.440330 13133 raft_consensus.cc:2410] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:20:22.448323 13131 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1416) took 2486 ms (client timeout 1825 ms). Trace:
W20260709 12:20:22.457521 13131 rpcz_store.cc:269] 0709 12:20:19.961772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.961875 (+   103us) service_pool.cc:224] Handling call
0709 12:20:22.448081 (+2486206us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54001f2cd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:22.448227 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872930688}
I20260709 12:20:22.369448 16929 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:22.455295 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.433383 13024 maintenance_manager.cc:419] P 98cf96dd74f448d18b23072207e1dc85: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033349
I20260709 12:20:22.460367 13279 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.470090 13279 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:22.371162 16304 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.463449 13100 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:22.468948 13883 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:22.471086 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:22.475186 13203 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:22.472054 13177 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:22.472792 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:22.438481 17002 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:22.442472 17102 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:22.449622 17091 raft_consensus.cc:697] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:22.431138 16738 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.457412 13838 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:22.481681 13102 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:22.504189 13102 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:22.506812 13102 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:22.456943 16854 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:22.486443 13884 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.027s	sys 0.011s
I20260709 12:20:22.453857 17008 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:22.499794 13279 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:22.501012 13203 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
W20260709 12:20:22.488521 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.581000 13175 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:22.623907 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.480894 17071 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:20:22.482713 17094 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:22.486307 17102 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:22.456125 16863 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:20:22.483024 17075 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:22.580013 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:22.494238 17078 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:22.500824 17115 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.479606 16827 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:20:22.480315 16953 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 12:20:22.608659 13884 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.030s	sys 0.019s
I20260709 12:20:22.556993 16835 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:22.557081 16632 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:22.647246 16835 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.647692 16632 raft_consensus.cc:697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:22.649266 16953 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:22.648890 16632 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.649955 16953 raft_consensus.cc:697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:22.493460 16738 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.651053 16953 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.653283 16738 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:22.626943 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 668) took 4312 ms. Trace:
I20260709 12:20:22.653900 16494 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:22.653934 13279 rpcz_store.cc:276] 0709 12:20:18.310904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.311860 (+   956us) service_pool.cc:224] Handling call
0709 12:20:18.313768 (+  1908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.649277 (+1335509us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54004b4720. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e04dc0 00007f70f4e8f1c0 00007f70f4e90231 00007f70f4e8cd8f 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c
0709 12:20:21.025227 (+1375950us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54004b4720. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e0b06f 00007f70f4e83f60 00007f70f4e857de 00007f70f4e8fb49 00007f70f4e90416 00007f70f4e8cd8f 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62
0709 12:20:22.460023 (+1434796us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b54004b4720. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e0a520 00007f70f4e83f70 00007f70f4e857de 00007f70f4e8fb49 00007f70f4e90416 00007f70f4e8cd8f 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62
0709 12:20:22.623103 (+163080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.623304 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841348224}
W20260709 12:20:22.628372 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 47507.9us
W20260709 12:20:22.627197 13252 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.019s	sys 0.040s
I20260709 12:20:22.583547 16943 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:22.647881 16835 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:22.658816 13252 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.020s	sys 0.040s
I20260709 12:20:22.659214 13175 leader_election.cc:400] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7.
I20260709 12:20:22.623226 17060 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:22.634420 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 121223us
W20260709 12:20:22.696583 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 644245us
W20260709 12:20:22.697933 13252 leader_election.cc:336] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 2.602s (SENT)
I20260709 12:20:22.625440 17091 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.712809 16863 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:22.713675 16863 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:22.713743 13252 leader_election.cc:336] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 2.617s (SENT)
I20260709 12:20:22.714356 16863 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.629920 17094 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.716073 17094 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:22.720474 17107 consensus_meta.cc:287] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.002s
I20260709 12:20:22.557927 17117 consensus_queue.cc:1059] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:20:22.677168 17115 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.745687 17115 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:22.637053 17101 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:22.746767 17101 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.747390 17101 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:22.669051 16943 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.754122 16943 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:22.763186 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2048) took 1173 ms. Trace:
I20260709 12:20:22.763768 13280 rpcz_store.cc:276] 0709 12:20:21.589540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.639312 (+ 49772us) service_pool.cc:224] Handling call
0709 12:20:21.639684 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:21.642122 (+  2438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:21.642160 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:21.666599 (+ 24439us) log.cc:844] Serialized 26 byte log entry
0709 12:20:22.248064 (+581465us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:22.248105 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.248181 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:22.762881 (+514700us) raft_consensus.cc:1685] finished
0709 12:20:22.762911 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:22.763107 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1957,"raft.queue_time_us":2123,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5685,"thread_start_us":540711,"threads_started":1,"wal-append.queue_time_us":717722}
I20260709 12:20:22.656038 17111 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:22.731453 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 685) took 1025 ms. Trace:
W20260709 12:20:22.794029 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 310319us
I20260709 12:20:22.824340 13281 rpcz_store.cc:276] 0709 12:20:21.705834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.252082 (+546248us) service_pool.cc:224] Handling call
0709 12:20:22.252408 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:22.252647 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:22.296014 (+ 43367us) log.cc:844] Serialized 14 byte log entry
0709 12:20:22.730940 (+434926us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:22.731017 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:22.731085 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.731178 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:22.731350 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44795,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":688,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":41483,"thread_start_us":433679,"threads_started":1}
I20260709 12:20:22.829347 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1026) took 1092 ms. Trace:
I20260709 12:20:22.829929 13884 rpcz_store.cc:276] 0709 12:20:21.737370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.737842 (+   472us) service_pool.cc:224] Handling call
0709 12:20:21.778267 (+ 40425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:21.778499 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:22.651636 (+873137us) log.cc:844] Serialized 14 byte log entry
0709 12:20:22.828748 (+177112us) log.cc:844] Serialized 14 byte log entry
0709 12:20:22.828922 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:22.828974 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:22.829029 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.829118 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:22.829273 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9843,"prepare.queue_time_us":853524,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"thread_start_us":980228,"threads_started":2}
W20260709 12:20:22.779549 17099 consensus_meta.cc:287] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.562s	user 0.004s	sys 0.008s
I20260709 12:20:22.823508 17029 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:20:22.824119 17111 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.735972 17107 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:22.778172 17060 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:22.876001 17122 log.cc:927] Time spent T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 12:20:22.903517 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.874047 17111 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:22.916222 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 458847us
I20260709 12:20:22.927043 13838 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:22.870076 16975 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:22.930812 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 337748us
W20260709 12:20:22.930364 16931 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:20:22.919625 16929 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:22.958436 17127 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:20:23.038482 17094 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:23.044333 17146 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.088s	user 0.000s	sys 0.004s
I20260709 12:20:23.045325 17102 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.047611 17102 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:23.050756 17094 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:23.085980 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.722164 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 54595.9us
I20260709 12:20:23.175173 13177 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:23.091341 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 422330us
I20260709 12:20:23.177526 17102 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:23.178951 17102 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:23.179615 17102 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:23.094869 13209 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:23.180078 17029 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:22.939467 16304 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:23.182468 17029 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:20:23.098624 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:23.183619 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:23.100256 13879 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.002s	sys 0.057s
W20260709 12:20:23.185168 13879 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.002s	sys 0.058s
I20260709 12:20:22.714382 13252 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:23.102010 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 174880us
W20260709 12:20:23.104941 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 173313us
W20260709 12:20:23.105924 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 271624us
I20260709 12:20:23.112510 16738 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.112645 17121 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:23.113517 17088 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:22.955102 16863 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:23.051666 17107 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:23.198050 17088 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.198593 17088 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:23.200487 13841 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:23.202303 16863 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:20:23.092514 13102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.004s	sys 0.010s
W20260709 12:20:23.203876 13102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.004s	sys 0.011s
I20260709 12:20:23.205469 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:23.192734 16738 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:23.197252 17120 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:23.196918 17121 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:23.205482 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 698682us
W20260709 12:20:23.176606 13132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.012s	sys 0.009s
W20260709 12:20:23.196929 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 483060us
I20260709 12:20:23.207301 13177 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:23.203851 16863 raft_consensus.cc:697] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:23.227648 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.228349 16863 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:23.233826 13132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.012s	sys 0.009s
I20260709 12:20:23.207778 17107 consensus_queue.cc:1059] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:20:23.238166 16738 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:23.248071 13252 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 2.758s (SENT) [suppressed 39 similar messages]
I20260709 12:20:23.250352 13840 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:23.252164 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 768) took 1777 ms. Trace:
I20260709 12:20:23.253589 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2883) took 1226 ms. Trace:
I20260709 12:20:23.256377 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:23.260116 17117 consensus_queue.cc:1059] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:23.261647 17117 consensus_queue.cc:1243] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:23.262609 16827 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:23.263294 16827 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:23.263787 16827 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:23.114856 17098 consensus_queue.cc:1059] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.150s
I20260709 12:20:23.265463 17098 consensus_queue.cc:1059] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:23.266608 17098 raft_consensus.cc:3055] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:23.267012 17098 raft_consensus.cc:740] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:23.268127 16771 raft_consensus.cc:3055] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:23.268648 16771 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:23.268782 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 72407.8us
I20260709 12:20:23.269923 16771 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.270884 17120 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:23.272204 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.272293 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.273288 13211 raft_consensus.cc:2368] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
W20260709 12:20:23.274291 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 67182.7us
I20260709 12:20:23.274964 16938 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:23.276803 16934 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:23.277652 16934 raft_consensus.cc:697] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:23.258922 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:23.289703 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:23.289973 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.289740 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:23.291400 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:23.291853 13280 raft_consensus.cc:2393] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:23.292219 13281 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:23.274338 17115 consensus_queue.cc:1059] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:20:23.293231 17124 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:23.294288 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.295324 17120 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.296097 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:23.298062 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.298717 17092 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:23.299137 17092 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:23.299386 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.299849 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.300216 13205 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:23.300835 13210 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:23.300393 17092 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.302572 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.303905 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.304904 13204 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:23.304956 17109 raft_consensus.cc:3055] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:23.305426 17109 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:23.306639 17109 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.308338 17107 raft_consensus.cc:3055] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:23.308804 17107 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:23.309988 17107 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.302520 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:23.313557 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 54925us
I20260709 12:20:23.301766 17092 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:23.290709 13278 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:23.271345 16771 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:23.284274 16938 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:23.283913 17121 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:23.227188 17142 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:23.372239 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:23.380343 17120 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:23.381142 16726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.007s	sys 0.030s
W20260709 12:20:23.381637 16726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.008s	sys 0.030s
I20260709 12:20:23.383764 13102 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:23.383981 13211 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:20:23.385279 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:23.386142 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:23.388790 13130 consensus_meta.cc:287] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.967s	user 0.005s	sys 0.014s
I20260709 12:20:23.389647 13130 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:23.391707 16953 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:23.392313 16953 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:23.392766 16953 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:23.395502 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.397001 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.397727 13210 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:23.398697 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.312618 17117 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:20:23.400133 16938 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.402823 16938 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:23.372507 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.404146 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:23.405036 13880 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:23.406284 17107 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:23.407747 13205 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:23.252760 13206 rpcz_store.cc:276] 0709 12:20:21.474356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.474503 (+   147us) service_pool.cc:224] Handling call
0709 12:20:21.474773 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:21.494017 (+ 19244us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:21.705370 (+211353us) log.cc:844] Serialized 14 byte log entry
0709 12:20:21.706065 (+   695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:21.706113 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:21.706154 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.251396 (+1545242us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54000b6654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:23.251527 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.251831 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59053,"prepare.queue_time_us":342767,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":500,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":13663,"spinlock_wait_cycles":43788672,"thread_start_us":132857,"threads_started":1}
I20260709 12:20:23.404551 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.413390 13249 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:23.413730 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.415331 17119 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.416132 17119 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.418094 17109 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:23.418817 17119 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:23.423696 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 228310us
I20260709 12:20:23.426499 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:23.429993 17060 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:23.430923 17075 raft_consensus.cc:3055] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:23.441352 17075 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:23.441684 16835 consensus_meta.cc:287] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.010s
I20260709 12:20:23.442199 16835 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.442549 17075 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.443987 17075 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:23.444502 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1033) took 1013 ms. Trace:
I20260709 12:20:23.444937 13879 rpcz_store.cc:276] 0709 12:20:22.430668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.430781 (+   113us) service_pool.cc:224] Handling call
0709 12:20:22.442009 (+ 11228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:22.442222 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:23.189149 (+746927us) log.cc:844] Serialized 14 byte log entry
0709 12:20:23.344596 (+155447us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:23.372967 (+ 28371us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:23.444167 (+ 71200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.444280 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.444444 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":204498,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":1996,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":2409,"thread_start_us":840030,"threads_started":2}
I20260709 12:20:23.446853 17137 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:23.447520 17119 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:23.448354 17137 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:23.448774 17119 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:23.433710 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 680) took 1038 ms. Trace:
W20260709 12:20:23.449353 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:23.449971 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.435146 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.451336 17119 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.254057 13207 rpcz_store.cc:276] 0709 12:20:22.027015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.123225 (+ 96210us) service_pool.cc:224] Handling call
0709 12:20:22.123546 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:22.140813 (+ 17267us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:22.141116 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 12:20:22.582539 (+441423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:22.582708 (+   169us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:22.582764 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.253126 (+670362us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b54002f08d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:23.253192 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.253427 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34557,"prepare.queue_time_us":4391,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":35,"raft.queue_time_us":34669,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":31939,"spinlock_wait_cycles":39104256,"thread_start_us":406389,"threads_started":1,"wal-append.queue_time_us":813834}
I20260709 12:20:23.440543 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.436084 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.448865 17137 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:23.415135 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.454308 13281 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:23.449417 13137 rpcz_store.cc:276] 0709 12:20:22.394782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.394890 (+   108us) service_pool.cc:224] Handling call
0709 12:20:23.433289 (+1038399us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54000c21d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:23.433460 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553225472}
I20260709 12:20:23.432027 16827 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.466130 13205 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
W20260709 12:20:23.463581 13100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.005s	sys 0.003s
I20260709 12:20:23.473361 13841 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:23.475852 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.476657 13208 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:23.477728 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:23.478461 17130 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:23.478823 16827 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:23.483954 17129 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:23.485054 17129 consensus_queue.cc:1243] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:23.485208 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.485787 17129 raft_consensus.cc:3055] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:23.486424 17129 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:23.487251 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:23.488564 13100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.005s	sys 0.004s
I20260709 12:20:23.489241 13205 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:23.486541 13208 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:23.485895 13204 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:23.288444 16934 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.503616 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:23.488270 16996 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:20:23.522575 17101 consensus_meta.cc:287] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.774s	user 0.008s	sys 0.012s
I20260709 12:20:23.523098 17101 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:23.523850 16854 consensus_meta.cc:287] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.999s	user 0.018s	sys 0.002s
W20260709 12:20:23.529052 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 143055us
W20260709 12:20:23.531268 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.537294 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:23.543715 13204 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:23.518949 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.533345 16997 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:23.524720 16973 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:20:23.541599 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.525321 17008 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:23.541944 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.545835 13208 raft_consensus.cc:2368] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:23.535624 17130 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:23.548868 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:23.558378 17101 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:23.560745 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:23.562515 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:23.562753 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:23.565330 16726 consensus_queue.cc:1059] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:23.566951 16688 raft_consensus.cc:3055] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:23.567386 16688 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:23.568424 16688 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.570149 16688 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:23.571897 17084 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.572234 16835 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:23.573292 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 146876us
I20260709 12:20:23.573879 16827 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:23.575800 16457 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.576095 17092 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:23.576547 16457 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.576335 16730 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:23.581362 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:23.582566 17002 consensus_meta.cc:287] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 1.094s	user 0.008s	sys 0.029s
I20260709 12:20:23.574770 16827 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.572772 17084 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:23.589175 17111 consensus_meta.cc:287] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.014s
I20260709 12:20:23.589679 17111 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.590178 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:23.590762 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:23.577210 17092 raft_consensus.cc:3055] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:23.592175 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 782) took 1092 ms. Trace:
I20260709 12:20:23.575344 13838 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:23.583087 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.589890 17084 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:23.589694 13887 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:23.595553 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.596386 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:23.551002 16996 raft_consensus.cc:697] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:23.600566 17130 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:23.601344 13207 raft_consensus.cc:2393] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 8: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:23.595100 13209 rpcz_store.cc:276] 0709 12:20:22.471019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.471157 (+   138us) service_pool.cc:224] Handling call
0709 12:20:22.471464 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.181217 (+709753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.563037 (+381820us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54002f0dd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:23.563374 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431883008}
I20260709 12:20:23.603360 13208 raft_consensus.cc:2368] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:23.605747 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:23.611976 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 72108.4us
I20260709 12:20:23.624305 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.625209 13204 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:23.594776 17092 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:23.583099 17002 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:23.570721 17098 consensus_queue.cc:260] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.638233 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:23.638648 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.644037 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:23.637714 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 389650us
I20260709 12:20:23.644816 13204 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:23.499315 17129 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:23.649158 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.646574 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.649736 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.652034 13177 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:23.602633 17102 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.665962 13208 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:23.606251 17088 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.670356 16893 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:23.670248 16726 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:20:23.670573 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:23.671481 13887 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:23.672945 16494 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:23.667728 17111 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:23.675554 17084 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:23.676268 17098 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:23.678416 16996 consensus_queue.cc:237] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.682469 17092 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.599409 17008 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:23.683475 16943 consensus_meta.cc:287] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.868s	user 0.008s	sys 0.010s
I20260709 12:20:23.683820 17092 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:23.683995 16943 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.655081 16771 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:23.686250 16771 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.686071 17130 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.686764 16771 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:23.688589 13879 raft_consensus.cc:2410] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:20:23.688946 13102 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:23.645994 16827 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:23.695966 13249 leader_election.cc:336] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.825s (SENT)
I20260709 12:20:23.696323 13209 raft_consensus.cc:2393] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 6: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:23.642467 16457 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:23.707127 13211 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:23.707302 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.705585 13100 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:23.705345 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 130067us
I20260709 12:20:23.686259 16943 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:23.706100 17109 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:20:23.728715 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 166122us
I20260709 12:20:23.711890 17111 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:23.735404 13205 raft_consensus.cc:2410] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:20:23.738481 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:23.723872 16457 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:23.755640 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.718909 17008 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:23.748353 13207 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:20:23.732208 17102 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:23.771378 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.769834 13204 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:23.779191 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 308774us
W20260709 12:20:23.780534 13103 connection.cc:256] RPC call timeout handler was delayed by -1.5534328550002101s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 12:20:23.788770 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 121190us
I20260709 12:20:23.789011 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:23.790182 17111 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.791617 16931 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.792711 17111 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:23.792098 13031 catalog_manager.cc:5697] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 8 to 9, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 9 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.767506 17002 consensus_queue.cc:1059] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:20:23.794571 17002 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:23.794963 17002 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:23.795989 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.796460 13885 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:23.796063 17002 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.796927 16953 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:23.797755 17002 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:23.799257 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:23.804845 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:23.805758 13203 raft_consensus.cc:2410] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:20:23.806012 16846 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:23.806519 16846 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.806914 16846 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:23.807724 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:23.807978 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:23.808604 13285 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:23.808810 13137 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:23.812114 13133 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:23.751085 16457 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.750772 17109 raft_consensus.cc:697] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:23.815187 13212 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:23.790514 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:23.814922 13840 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:23.815629 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.812034 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:23.818560 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:23.820441 17088 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:23.822018 13207 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:23.822521 17120 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:23.823053 17121 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:23.833570 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:23.834352 13885 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:23.829200 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.835923 13204 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:23.838063 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:23.838901 13133 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:23.840497 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:23.842811 13208 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
W20260709 12:20:23.848425 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.823637 16457 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:23.792268 16931 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:23.853030 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.854185 13283 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:23.795003 13031 catalog_manager.cc:5697] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 4 to 5, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3), now has a pending config: VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1), VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2), VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3), VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 5 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:23.857252 13277 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:23.830736 16953 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:23.877673 13286 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:23.878749 13887 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:20:23.868088 13103 leader_election.cc:336] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.526s (SENT)
I20260709 12:20:23.877827 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:23.899994 13137 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
W20260709 12:20:23.910782 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 129672us
I20260709 12:20:23.900547 13137 pending_rounds.cc:85] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 9
I20260709 12:20:23.921650 13177 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:23.922582 17029 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:23.923023 17029 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:23.923462 17029 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:23.923570 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:23.924624 13884 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:23.926075 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:23.929675 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:23.930508 13129 raft_consensus.cc:2368] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9.
W20260709 12:20:23.932139 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:23.932659 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.935521 16726 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:23.936066 16863 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.936120 16726 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.936774 16863 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.937826 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:23.938709 16726 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:23.938866 16863 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:23.939157 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:23.939778 13277 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
W20260709 12:20:23.944219 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.893270 16494 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:23.914235 13137 pending_rounds.cc:107] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:20:23.963903 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:23.975489 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:23.976441 13277 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:23.979022 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:23.971963 13137 raft_consensus.cc:2889] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:23.980566 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:23.984144 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:23.985670 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:23.982074 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:23.988129 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:23.990139 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:23.992211 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:23.992975 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:23.995177 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:23.992063 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:24.007884 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 157057us
I20260709 12:20:23.978927 13031 catalog_manager.cc:5697] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 5 to 6, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 6 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:20:24.014364 13212 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:24.018952 13132 raft_consensus.cc:2410] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:23.914971 17120 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:23.993404 17129 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:23.915371 17121 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:24.016834 13279 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:24.033947 13133 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:24.032562 13206 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:24.032034 13884 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:24.042687 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:24.043359 13883 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:24.047513 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:24.049746 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:24.050808 13838 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:24.052495 13210 raft_consensus.cc:2410] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:20:24.055146 13279 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:24.056692 13134 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:24.050407 13886 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
W20260709 12:20:24.055225 13103 leader_election.cc:336] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.583s (SENT)
I20260709 12:20:24.055852 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:24.059118 17137 consensus_meta.cc:287] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.564s	user 0.014s	sys 0.000s
W20260709 12:20:24.067642 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 103154us
I20260709 12:20:24.062373 13103 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:24.073187 17137 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:24.077214 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:24.078267 13133 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:24.042132 16973 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:20:24.069255 16863 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:24.086895 13285 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:24.089236 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:24.090037 13131 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:24.073869 16494 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:24.104848 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:24.089999 13881 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:24.122958 13286 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
I20260709 12:20:24.104826 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:24.121290 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:24.117172 17154 log.cc:927] Time spent T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 12:20:24.132783 13133 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:24.134225 17120 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:24.039947 17109 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:24.131111 13282 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:24.103135 16863 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:24.138635 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:24.102958 16771 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:24.168206 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:24.172569 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:24.169799 13285 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:24.117328 16494 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.157828 13212 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:24.175679 13283 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:24.176718 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:24.150058 17169 log.cc:927] Time spent T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:20:24.131363 16931 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:24.187067 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.190814 16907 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:20:24.190785 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 142231us
I20260709 12:20:24.145267 17137 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:24.146006 17156 log.cc:927] Time spent T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
W20260709 12:20:24.148695 17167 log.cc:927] Time spent T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:20:24.134652 17119 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:24.204416 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:24.205423 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:24.149367 17170 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:20:24.167971 16863 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:24.223201 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.125686 16730 consensus_queue.cc:1059] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:20:24.225521 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.248567 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:24.188083 16494 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:24.249321 13880 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:24.248768 13103 connection.cc:256] RPC call timeout handler was delayed by -1.4630285490000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:20:24.253551 17168 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 12:20:24.257141 17162 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:20:24.150645 16846 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:24.252785 13283 raft_consensus.cc:1217] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 12:20:24.273480 13283 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:20:24.142841 16893 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:20:24.139269 17029 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:24.295275 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.296253 13282 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:24.297231 17029 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:24.297392 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:24.298074 13282 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:24.298334 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.299037 13130 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:24.299950 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:24.301378 17163 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 12:20:24.301851 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.279841 13883 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:24.242425 16457 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:24.304646 16771 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:24.306823 16457 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:24.293789 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:24.270005 13286 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:24.310120 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:24.311525 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:24.317099 13285 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
W20260709 12:20:24.268239 16688 consensus_meta.cc:287] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.698s	user 0.014s	sys 0.001s
I20260709 12:20:24.327659 13130 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:24.337229 13838 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:24.337452 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:24.328526 17170 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:20:24.350773 17107 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.351552 17107 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:24.352181 17137 raft_consensus.cc:3055] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:24.352653 17137 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:24.353576 17137 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:24.354127 17107 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:24.316427 16846 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:24.354964 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.354866 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 234857us
I20260709 12:20:24.339469 16893 consensus_queue.cc:1243] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:24.371134 17071 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:24.371776 17071 raft_consensus.cc:697] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:24.372189 17082 raft_consensus.cc:3055] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:24.372771 17082 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:24.376019 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.379480 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:24.380402 13887 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:24.314841 16863 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:24.384716 13103 connection.cc:256] RPC call timeout handler was delayed by -1.266411448000099s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260709 12:20:24.382190 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.385385 13103 connection.cc:256] RPC call timeout handler was delayed by -1.1087809600001037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
W20260709 12:20:24.385996 13103 connection.cc:256] RPC call timeout handler was delayed by -1.0229285489999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2699s for a response
I20260709 12:20:24.386253 13177 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:24.394699 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:24.396394 13177 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:24.369413 16996 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.322968 17119 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:24.406972 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.411331 13252 leader_election.cc:336] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.604s (SENT)
I20260709 12:20:24.385416 16846 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:24.398922 17002 consensus_meta.cc:287] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.000s
I20260709 12:20:24.417340 13286 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:24.418493 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:24.418625 13840 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:24.420945 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:24.420403 13252 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:24.437230 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.437860 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.403322 17107 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:24.444640 13286 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:24.403746 16457 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.447670 13103 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:24.455253 16892 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:24.455473 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:24.456122 16892 raft_consensus.cc:697] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:24.456772 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.457885 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.457410 16892 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:24.458940 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.459142 13131 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:24.452219 13882 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:24.462345 13285 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:24.466746 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.460495 13132 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:24.372786 17071 consensus_queue.cc:237] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:24.443172 16934 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:24.481133 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:24.481176 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.459815 16846 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:24.485702 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:24.486255 13132 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:24.487030 16846 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:24.493571 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.494879 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.495219 13132 raft_consensus.cc:2410] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:20:24.496551 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 78023.5us
I20260709 12:20:24.459381 16972 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:24.460942 17107 raft_consensus.cc:697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:24.510488 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:24.511219 13128 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:24.512487 17088 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:24.516950 16726 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:24.517613 13880 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
W20260709 12:20:24.520141 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 99444us
I20260709 12:20:24.522082 13103 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:24.522993 17092 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:24.474913 17177 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:24.523643 17166 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 12:20:24.528347 13128 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
W20260709 12:20:24.534551 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 224062us
I20260709 12:20:24.479207 17002 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:24.440496 16996 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:24.537895 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 130082us
I20260709 12:20:24.540956 13210 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:24.542268 13885 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:24.537724 16972 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:24.546590 13131 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:24.555238 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 218113us
I20260709 12:20:24.497656 16457 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:24.560374 13838 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:24.550441 13286 raft_consensus.cc:2955] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:24.566697 13131 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
W20260709 12:20:24.574126 13252 leader_election.cc:336] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.604s (SENT)
I20260709 12:20:24.503350 16934 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:24.533895 16726 consensus_queue.cc:1059] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:20:24.593932 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:24.595074 13283 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:24.596017 13128 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:20:24.626868 13279 consensus_meta.cc:287] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260709 12:20:24.627554 13279 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:24.646049 13282 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
W20260709 12:20:24.646651 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 86377us
W20260709 12:20:24.648904 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 125449us
W20260709 12:20:24.651526 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 89171.1us
I20260709 12:20:24.653007 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:24.654949 13128 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:24.657879 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:24.668635 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:24.630777 16863 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:24.669890 13282 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:20:24.663504 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 172095us
W20260709 12:20:24.673429 13252 leader_election.cc:336] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.706s (SENT)
I20260709 12:20:24.686905 13252 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:24.696607 13279 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:24.693735 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:24.698843 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 50401.2us
I20260709 12:20:24.702131 13283 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:24.690029 16846 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:24.706867 13279 pending_rounds.cc:85] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 6
I20260709 12:20:24.707294 13279 pending_rounds.cc:107] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:20:24.707607 13279 raft_consensus.cc:2889] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:24.688663 16973 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:24.701459 17177 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:24.711938 13282 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:20:24.714800 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 46246.3us
I20260709 12:20:24.716572 16457 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:24.717300 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:24.718822 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:24.723745 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.724571 13135 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
W20260709 12:20:24.728195 17183 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 12:20:24.739843 13175 leader_election.cc:336] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 2.201s (SENT)
I20260709 12:20:24.752565 13175 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:24.755441 13283 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:24.750785 13133 consensus_meta.cc:287] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.003s
I20260709 12:20:24.758585 13133 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:24.760890 13882 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:24.736137 16726 raft_consensus.cc:3055] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:24.773710 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:24.774549 13885 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:24.739593 17092 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:24.752080 16457 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:24.675846 17107 consensus_queue.cc:237] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:24.773362 16726 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:24.788465 16771 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:20:24.822600 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 149197us
W20260709 12:20:24.824374 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 105660us
I20260709 12:20:24.790980 17130 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:24.827775 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.826489 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 124927us
I20260709 12:20:24.780637 16494 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:24.833137 16494 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:24.834447 13103 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:24.835371 16726 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:24.836745 16726 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:24.846680 16934 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:24.850005 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:24.860590 13252 leader_election.cc:336] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.724s (SENT)
I20260709 12:20:24.861250 13252 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:24.864554 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.880865 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:24.881889 13880 raft_consensus.cc:2368] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7.
W20260709 12:20:24.882663 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.886102 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.889406 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.891753 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.896073 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:24.896885 13130 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:24.893210 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:24.903736 13133 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:24.905906 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:24.906107 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:24.907104 13884 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:24.909029 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:24.909428 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:24.911509 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:24.914178 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:24.882186 16457 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:24.914834 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:24.917084 13249 leader_election.cc:336] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 2.081s (SENT)
I20260709 12:20:24.914494 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:24.919673 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.919857 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:24.922205 13133 raft_consensus.cc:2410] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:20:24.924238 13881 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:24.897356 16854 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:24.928936 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:24.929473 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:24.931059 13132 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:24.961751 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 127387us
W20260709 12:20:24.965309 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 46645.1us
I20260709 12:20:24.896347 16846 consensus_queue.cc:1059] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:20:24.967115 13840 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:24.973627 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.973726 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.963171 13135 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:24.979594 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:24.958287 17121 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:24.988482 17129 consensus_meta.cc:287] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.957s	user 0.014s	sys 0.000s
W20260709 12:20:24.989544 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 68421.6us
I20260709 12:20:24.991622 13887 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:24.993863 13885 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:24.995689 17092 raft_consensus.cc:3055] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:24.995949 13132 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:24.996218 17092 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:24.996347 17193 log.cc:927] Time spent T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:20:25.000362 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 102389us
I20260709 12:20:24.998731 17082 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.004014 17082 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:25.004223 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.007643 13103 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:25.013151 16996 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:25.013928 16996 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.014454 16996 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:25.016781 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:25.017308 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.018895 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:25.020628 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:25.021179 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.023025 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:25.024009 13204 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:25.027163 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:25.028075 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:25.028755 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:25.027983 13209 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:25.029559 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:25.027076 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:25.030725 13204 raft_consensus.cc:2393] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:20:25.031817 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 64860.5us
I20260709 12:20:25.031843 13204 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:25.032709 13840 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:25.033811 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:25.034061 13212 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:25.018319 16934 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:25.039083 17184 log.cc:927] Time spent T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.444s	user 0.001s	sys 0.000s
I20260709 12:20:25.041595 16457 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:25.042272 17137 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:25.044343 13281 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:25.046207 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:25.047125 13211 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
W20260709 12:20:25.049898 17201 log.cc:927] Time spent T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:20:25.025337 17178 log.cc:927] Time spent T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.770s	user 0.006s	sys 0.000s
I20260709 12:20:25.052282 17119 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:25.052567 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1040) took 1303 ms. Trace:
I20260709 12:20:25.052984 13284 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:25.052933 13879 rpcz_store.cc:276] 0709 12:20:23.748995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.749212 (+   217us) service_pool.cc:224] Handling call
0709 12:20:23.775113 (+ 25901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:23.820332 (+ 45219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.820366 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:23.821009 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.032975 (+211966us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:24.033034 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.033131 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:25.021075 (+987944us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:25.052233 (+ 31158us) raft_consensus.cc:1685] finished
0709 12:20:25.052268 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.052482 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27171,"raft.queue_time_us":36338,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":39600896,"thread_start_us":201123,"threads_started":1,"wal-append.queue_time_us":359820}
I20260709 12:20:25.055613 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2860) took 1116 ms. Trace:
I20260709 12:20:25.056007 13280 rpcz_store.cc:276] 0709 12:20:23.938916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.010074 (+ 71158us) service_pool.cc:224] Handling call
0709 12:20:24.010512 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:24.063096 (+ 52584us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:24.121960 (+ 58864us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.296115 (+174155us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b48001a01d8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f9db6aa1 00007f70f9dadb37 00007f70f9dad9ca 00007f70f9ea526f 00007f70f9ea4f37 00007f70f9eb955c 00007f70f9eb9508 00007f70f9eb9488 00007f70f9eb9443 00007f70f9eb86ec 00007f70f8de2a96
0709 12:20:24.410119 (+114004us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:24.446483 (+ 36364us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.446683 (+   200us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:24.446939 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.465087 (+ 18148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.465157 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.848681 (+383524us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b18000b76a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:25.038451 (+189770us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:25.055388 (+ 16937us) raft_consensus.cc:1685] finished
0709 12:20:25.055408 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.055541 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29169,"prepare.queue_time_us":64509,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":38525,"raft.run_cpu_time_us":2833,"raft.run_wall_time_us":220242,"spinlock_wait_cycles":82863616,"thread_start_us":259021,"threads_started":1,"wal-append.queue_time_us":435930}
I20260709 12:20:25.060245 16846 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:25.035164 16934 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.043116 13279 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:25.074456 17204 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:25.076387 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 81492.2us
I20260709 12:20:25.076073 17153 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:25.081202 13840 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:25.082682 16973 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:25.086565 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:25.077555 13838 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:25.087579 13208 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:25.094944 13031 catalog_manager.cc:5697] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.097942 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:25.099995 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 75188.1us
W20260709 12:20:25.106926 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 99411us
I20260709 12:20:25.113005 16972 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:25.119899 13205 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:25.096662 16934 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:25.125301 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:25.084707 17082 consensus_queue.cc:1059] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:20:25.124243 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:25.131285 13206 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:25.097558 17098 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.126048 13102 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:25.129937 13103 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:25.140450 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:25.141445 13885 raft_consensus.cc:2410] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:20:25.141973 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:25.113430 17204 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:25.093937 16892 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:20:25.146780 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:25.147140 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:25.147531 13886 raft_consensus.cc:2376] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9. Re-sending same reply.
I20260709 12:20:25.148285 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:25.148999 13880 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:25.150094 13881 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:25.127053 17212 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.144490 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:25.129191 17071 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.147161 13887 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:20:25.152724 13137 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:20:25.170636 13137 pending_rounds.cc:85] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 8
I20260709 12:20:25.171020 13137 pending_rounds.cc:107] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:20:25.171336 13137 raft_consensus.cc:2889] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:25.173470 13206 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:25.175537 16996 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:25.178373 17094 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:25.181375 17098 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.183604 17098 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:25.190568 17071 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:25.129398 17210 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:20:25.193259 17071 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:25.195250 17082 raft_consensus.cc:3055] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:25.195812 17082 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:25.196605 17092 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.197551 17204 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:25.197818 17092 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:25.198603 17204 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.174594 16846 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:25.197119 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 67281.4us
I20260709 12:20:25.202248 13103 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:25.144903 17211 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:25.202895 17211 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.203290 17211 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:25.172295 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:25.174913 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:25.217552 13103 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:25.213383 13838 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:25.227685 13100 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:25.217290 16846 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:25.237891 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 145911us
I20260709 12:20:25.222537 16457 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:25.261942 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:25.262583 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 109075us
I20260709 12:20:25.263017 13887 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:25.225430 17210 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:25.152012 17217 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 12:20:25.224478 16996 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:25.261986 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 54205.2us
I20260709 12:20:25.234566 16892 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.266880 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:25.271055 13879 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:25.196605 17082 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:25.237363 16846 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.235822 16854 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:25.272272 17098 raft_consensus.cc:2764] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:20:25.302289 16457 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:20:25.305253 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 444679us
I20260709 12:20:25.269428 16996 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:25.311650 17120 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:25.312541 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 310755us
I20260709 12:20:25.313138 17119 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:20:25.315652 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 140837us
I20260709 12:20:25.216929 17212 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:25.307482 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:25.258013 17088 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:20:25.328889 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:25.322388 16457 consensus_queue.cc:1243] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer cbc6af7757ec459ab451e47724fdf44b log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:20:25.328851 13252 leader_election.cc:336] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.746s (SENT)
I20260709 12:20:25.329653 17177 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:25.329942 13249 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:25.330433 13103 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:25.332855 17204 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:25.332890 17120 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:25.315928 16854 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:25.353060 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 109673us
W20260709 12:20:25.355227 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:25.358224 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.296321 16846 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:25.316949 17210 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:25.283991 16863 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:25.379086 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 50313.8us
W20260709 12:20:25.383668 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 53832.3us
I20260709 12:20:25.320385 17153 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:25.323088 16996 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:25.386869 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:25.386801 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 65116.8us
W20260709 12:20:25.387630 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.379397 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:25.390955 17219 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:20:25.396027 17210 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.282418 16726 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:20:25.283622 16892 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:25.400080 13249 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:25.401113 16892 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:25.401921 17120 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:25.402407 17120 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.402777 17120 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:25.403519 16972 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:25.404168 16972 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:25.405149 16972 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.408072 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:25.408634 16854 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.409528 16931 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:25.410037 16931 raft_consensus.cc:697] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:25.410984 16931 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.378147 17217 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:25.364056 17082 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:25.444329 13031 catalog_manager.cc:5697] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 5 to 9, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 9 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:20:25.456290 13249 leader_election.cc:400] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7.
I20260709 12:20:25.456828 13249 leader_election.cc:403] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:25.459654 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:25.460572 13279 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
W20260709 12:20:25.486181 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 66880.8us
I20260709 12:20:25.486654 13281 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:25.487094 13031 catalog_manager.cc:5697] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 3 to 7, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 7 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:25.488494 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:25.490156 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.500546 13249 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:25.502081 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 106897us
W20260709 12:20:25.501761 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 172946us
I20260709 12:20:25.414855 16688 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:20:25.504127 13177 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:25.510277 13031 catalog_manager.cc:5697] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:20:25.514873 13252 leader_election.cc:336] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.768s (SENT)
I20260709 12:20:25.438771 16863 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.521488 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:25.527866 13887 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:20:25.505525 17119 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7.
I20260709 12:20:25.521062 13031 catalog_manager.cc:5697] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 6 to 7, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 7 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:25.530808 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 142058us
I20260709 12:20:25.540195 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:25.518556 17098 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:25.523730 17121 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:25.542222 13031 catalog_manager.cc:5697] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 3 to 5, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 5 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:25.555141 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 52166.8us
I20260709 12:20:25.555972 13175 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:25.529664 17224 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:25.559697 13031 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 3 to 6, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 6 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:20:25.570344 13031 catalog_manager.cc:5697] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:25.577967 13102 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:25.583631 13279 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:25.551647 17098 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.591555 13031 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 5 to 6, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 6 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:25.593879 13252 leader_election.cc:336] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.890s (SENT)
W20260709 12:20:25.596055 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 278808us
I20260709 12:20:25.567162 16907 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:20:25.593747 17230 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:25.655778 17230 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.656193 17230 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:25.609763 13034 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42064 (request call id 321) took 31443 ms (client timeout 15000 ms). Trace:
I20260709 12:20:25.616078 17224 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:25.659853 17224 raft_consensus.cc:697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:25.660989 17224 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.618985 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:25.550237 17121 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:25.628242 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 72342.5us
W20260709 12:20:25.665082 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 46190.4us
I20260709 12:20:25.625586 17220 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.631094 17212 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:25.573685 17217 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:25.567447 17153 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.669574 17153 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.672569 17153 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:25.633589 17211 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:25.673393 17109 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:25.621119 17098 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:25.648188 13252 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:25.665812 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:25.665834 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:25.667074 17121 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:25.667169 17220 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:25.668201 17226 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:20:25.676690 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 150383us
I20260709 12:20:25.655197 13103 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:25.668375 13031 catalog_manager.cc:5697] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 7 to 10, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 10 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:25.680218 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:25.659593 13034 rpcz_store.cc:269] 0709 12:19:54.165963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.166208 (+   245us) service_pool.cc:224] Handling call
0709 12:19:54.356721 (+190513us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b5400002210. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d69640 00007f70fac40846 00007f70fad4a90e 00007f70f920b2a4 00007f70f920b232 00007f70f920b161 00007f70f920b0dc 00007f70f920a392 00007f70f31c848c 00007f70f31c78c6
0709 12:20:25.609489 (+31252768us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:15.178128 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:15.179102 (+   974us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:15.179178 (+    76us) write_op.cc:435] Acquired schema lock
0709 12:20:15.179202 (+    24us) tablet.cc:662] Decoding operations
0709 12:20:15.474390 (+295188us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:15.474499 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:15.474542 (+    43us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:20:15.476099 (+  1557us) tablet.cc:701] Row locks acquired
0709 12:20:15.476162 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:20:15.476396 (+   234us) write_op.cc:270] Start()
0709 12:20:15.476593 (+   197us) write_op.cc:276] Timestamp: P: 1783599615476312 usec, L: 0
0709 12:20:15.476623 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:20:15.477558 (+   935us) log.cc:844] Serialized 5499 byte log entry
0709 12:20:16.537239 (+1059681us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:17.364441 (+827202us) op_driver.cc:464] REPLICATION: finished
0709 12:20:17.904267 (+539826us) write_op.cc:301] APPLY: starting
0709 12:20:17.904388 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:17.904817 (+   429us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:17.904863 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:18.113727 (+208864us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:18.114107 (+   380us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:20:18.114159 (+    52us) write_op.cc:312] APPLY: finished
0709 12:20:18.114561 (+   402us) log.cc:844] Serialized 101 byte log entry
0709 12:20:18.114816 (+   255us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:18.115021 (+   205us) write_op.cc:454] Released schema lock
0709 12:20:18.115130 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:19.256585 (+1141455us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b54003633d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8a32a 00007f70f4e0ff14 00007f70f4e0fec3 00007f70f4e0fe38 00007f70f4e0fdf3 00007f70f4e0f0dc 00007f70f4e38e16 00007f70f4e20cbb 00007f70f4e0b39d 00007f70f4e0ed75
0709 12:20:19.476839 (+220254us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b180037da40. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:19.476978 (+   139us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:19.477017 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3569182,"reported_tablets":45,"spinlock_wait_cycles":6876544,"child_traces":[["op",{"apply.queue_time_us":524965,"apply.run_cpu_time_us":5380,"apply.run_wall_time_us":230934,"num_ops":14,"prepare.queue_time_us":143018,"prepare.run_cpu_time_us":43982,"prepare.run_wall_time_us":631683,"raft.queue_time_us":709215,"raft.run_cpu_time_us":54483,"raft.run_wall_time_us":1920769,"replication_time_us":1877200,"spinlock_wait_cycles":236750464,"thread_start_us":1002994,"threads_started":4,"wal-append.queue_time_us":466584,"wal-append.run_cpu_time_us":95991,"wal-append.run_wall_time_us":3427390}]]}
I20260709 12:20:25.675511 17211 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:25.686789 17212 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:25.721876 13031 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 5 to 8, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 8 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.704959 17119 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:25.706102 17109 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:25.716377 17094 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:25.744335 13031 catalog_manager.cc:5697] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 7 to 8, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 8 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
W20260709 12:20:25.745457 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 159115us
I20260709 12:20:25.712635 16457 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:20:25.686918 16846 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:25.707810 17092 consensus_queue.cc:1059] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:20:25.750865 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:25.755609 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 89884.2us
W20260709 12:20:25.757376 13252 leader_election.cc:336] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.962s (SENT)
I20260709 12:20:25.757055 13031 catalog_manager.cc:5697] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 3 to 4, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 4 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:20:25.757820 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:25.754850 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 375500us
I20260709 12:20:25.734366 17211 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:25.721582 17229 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:20:25.769459 13175 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:25.734539 17212 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:25.729507 17120 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.787076 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:25.790926 13278 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:25.794171 13879 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:25.795013 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:25.799707 13284 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:25.774156 16972 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:25.804502 17109 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:25.815634 16863 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:25.775096 17217 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:20:25.816798 17220 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:25.817229 16907 raft_consensus.cc:3055] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:25.842723 16907 raft_consensus.cc:740] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:25.843698 16907 consensus_queue.cc:260] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:25.845086 16907 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:25.845371 17121 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:25.847769 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 94357us
I20260709 12:20:25.818923 16996 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:25.848812 13252 leader_election.cc:336] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 2.202s (SENT)
I20260709 12:20:25.849190 13252 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:25.849769 16996 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:25.825989 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:25.826653 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:25.825127 17029 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:25.835031 16846 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:25.781920 16892 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.828853 13031 catalog_manager.cc:5697] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.865962 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:25.871145 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:25.871986 13879 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:25.875415 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:25.789793 17119 consensus_queue.cc:1059] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:20:25.878345 13031 catalog_manager.cc:5697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 3 to 4, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 4 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:25.888156 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:25.893762 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 124380us
I20260709 12:20:25.895128 13175 leader_election.cc:400] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9.
I20260709 12:20:25.895568 13175 leader_election.cc:403] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:25.874815 16931 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:25.833560 17230 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:25.884269 17220 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:25.935856 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 280782us
I20260709 12:20:25.945237 13103 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:25.936930 17226 raft_consensus.cc:697] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:25.950526 13137 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:25.964540 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:25.941653 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:25.913070 17129 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.932000 17029 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9.
I20260709 12:20:25.975698 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:25.976933 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.880880 16892 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:25.977701 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.981052 13031 catalog_manager.cc:5697] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 3 to 6, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 6 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.984540 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:26.026516 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 62130.1us
W20260709 12:20:26.030230 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 45356.4us
I20260709 12:20:26.029443 13031 catalog_manager.cc:5697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:26.036819 13031 catalog_manager.cc:5697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 6 to 7, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 7 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:26.039245 13031 catalog_manager.cc:5697] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 5 to 6, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 6 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
W20260709 12:20:26.033653 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 84452.5us
I20260709 12:20:25.973294 17121 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:25.986398 17129 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.046144 16892 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:26.043695 17211 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:26.052588 17230 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:26.052470 17071 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:25.971539 17220 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.034539 17240 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:26.043228 17098 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:25.981467 16972 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:20:26.043064 17242 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:25.932615 17212 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:26.065493 17109 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:20:26.067808 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 83378.4us
I20260709 12:20:26.119134 13103 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:26.067927 13278 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:26.068339 17029 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:25.967907 17226 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.073303 13879 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
W20260709 12:20:26.078018 17233 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.325s	user 0.002s	sys 0.005s
W20260709 12:20:26.088804 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 45483.5us
I20260709 12:20:26.125324 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:26.105655 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.123157 13883 raft_consensus.cc:1217] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-10.10]   Dedup: 6.8->[8.9-10.10]
I20260709 12:20:26.126502 13208 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:20:26.132041 17204 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.132584 17204 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.134687 17204 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:26.135179 13838 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:26.135882 17120 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:26.126319 13883 pending_rounds.cc:85] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Aborting all ops after (but not including) 8
I20260709 12:20:26.136547 13883 pending_rounds.cc:107] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:20:26.136783 13883 raft_consensus.cc:2889] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:26.137457 16973 consensus_queue.cc:1059] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:26.138784 17220 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:26.140748 17098 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:26.142304 17243 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:26.143239 13131 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:26.143641 13137 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:26.143784 17153 raft_consensus.cc:3055] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:26.144241 17153 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:26.144345 13879 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:26.144893 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:26.145423 13135 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:26.145606 13136 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:26.146621 13130 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:26.146883 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.147763 13129 raft_consensus.cc:2410] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:20:26.108667 16892 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:26.148479 16892 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.150627 16892 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:26.151794 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:26.152348 13880 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:26.153503 17129 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:26.155905 16972 consensus_queue.cc:1243] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer cbc6af7757ec459ab451e47724fdf44b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:26.156603 17121 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:26.156971 17121 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:26.158272 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.158037 17121 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.160375 17153 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.161759 17153 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:26.163766 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.164398 17211 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:26.166102 17224 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:26.167270 13130 raft_consensus.cc:1217] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 12:20:26.110877 17240 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.167773 13130 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:20:26.168015 17240 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:26.169610 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.170707 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.173682 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:26.174335 13278 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:26.173045 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.156113 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:26.177472 13840 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:26.178393 17188 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:26.178788 17188 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.179144 17188 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:26.191509 17094 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:26.199855 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 402384us
I20260709 12:20:26.200111 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:26.201859 13129 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:26.208616 13880 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:26.209985 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:26.205957 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.232213 13131 raft_consensus.cc:2368] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 9.
I20260709 12:20:26.233358 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:26.233421 13130 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:26.235900 17094 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:26.237664 13130 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:26.238093 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.241743 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:26.243381 13205 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:26.246766 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:26.247159 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:26.249620 13131 raft_consensus.cc:2368] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12.
I20260709 12:20:26.254390 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:26.239460 17137 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.260952 13130 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:26.240679 17071 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.257582 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:26.266553 13283 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:26.267571 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:26.263586 13136 raft_consensus.cc:2410] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:20:26.268378 13133 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:26.265075 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:26.269887 13285 raft_consensus.cc:2393] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:20:26.256848 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.245127 17094 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:26.265789 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:26.283032 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 253958us
W20260709 12:20:26.306473 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 449362us
I20260709 12:20:26.249305 17210 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:20:26.309314 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:26.323570 17242 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.344669 17242 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:26.345726 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:26.346738 17250 consensus_queue.cc:1059] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:26.347496 17242 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:26.348141 17029 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:26.350607 13131 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:26.318570 17002 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:26.352358 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:26.347608 17250 consensus_queue.cc:1243] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:26.353152 16892 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:26.354851 13175 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:26.355512 17231 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:20:26.355737 16892 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:26.356302 16892 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:26.357281 16892 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:26.357987 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.358343 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.358815 13136 raft_consensus.cc:2410] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:20:26.358894 13132 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:26.359831 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.359964 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.360146 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:26.360704 13134 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:26.365833 17250 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.366416 17250 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:26.368729 17250 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:26.265231 17137 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.359865 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.373525 17137 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:26.308903 16726 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:20:26.362989 17094 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.282346 17071 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.378180 17071 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:26.385761 16494 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:26.391822 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:26.403663 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 51899.2us
I20260709 12:20:26.403864 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.404206 13283 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:26.409478 13133 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
W20260709 12:20:26.416744 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 45307.2us
I20260709 12:20:26.453917 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:26.454144 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 73741.4us
I20260709 12:20:26.457088 13880 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:26.457825 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:26.461347 13102 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:26.454169 13131 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:26.477950 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.485240 17254 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:26.486627 13885 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:26.494169 13886 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:20:26.494715 13886 pending_rounds.cc:85] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Aborting all ops after (but not including) 7
I20260709 12:20:26.495021 13886 pending_rounds.cc:107] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:20:26.495338 13886 raft_consensus.cc:2889] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:26.500280 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.418116 16973 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:26.505992 13249 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:26.508793 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:26.510371 13283 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:26.438925 17189 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
W20260709 12:20:26.524335 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.526254 17029 raft_consensus.cc:3055] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:26.526726 17029 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:26.503154 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 148364us
I20260709 12:20:26.503995 13282 raft_consensus.cc:3055] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:26.527652 13282 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:26.528466 13282 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.529330 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.529733 13282 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:26.530999 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:26.531643 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.531800 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:26.532233 13129 raft_consensus.cc:2410] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:20:26.532343 13128 raft_consensus.cc:2376] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9. Re-sending same reply.
I20260709 12:20:26.532845 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.533020 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.533286 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.533674 13136 raft_consensus.cc:2410] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:20:26.531457 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:26.534173 13128 raft_consensus.cc:2410] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:20:26.534432 13134 raft_consensus.cc:2376] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11. Re-sending same reply.
I20260709 12:20:26.534178 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:26.531097 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.472450 17224 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:26.537248 17224 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:26.536742 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.538233 17224 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:26.539849 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:26.540791 17257 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:26.540946 17244 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:20:26.548085 13175 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:26.549073 17257 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:26.549666 17257 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:26.550662 17257 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:26.555606 17071 consensus_queue.cc:1059] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:26.557534 17250 raft_consensus.cc:3055] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:26.557948 17250 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:26.558965 17250 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:26.560526 17250 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:26.563999 17029 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:26.565495 17029 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:26.575001 17153 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.575659 17153 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.577907 13282 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:20:26.578327 13282 pending_rounds.cc:85] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 10
I20260709 12:20:26.578554 13282 pending_rounds.cc:107] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:20:26.578663 17153 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:26.579751 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.582067 17153 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.582717 17153 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.586249 17153 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:26.588053 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:26.589228 13206 raft_consensus.cc:2410] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:20:26.578781 13282 raft_consensus.cc:2889] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:26.593570 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.598556 13879 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
W20260709 12:20:26.607089 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 101191us
I20260709 12:20:26.622179 13177 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:26.648463 13175 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:26.652575 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.652899 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:26.654218 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 79928.8us
W20260709 12:20:26.663902 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 55777.4us
I20260709 12:20:26.667488 13133 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:26.668073 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:26.606822 17153 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.664738 13249 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:26.677856 13283 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
W20260709 12:20:26.676402 13249 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.525s (SENT)
I20260709 12:20:26.682638 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.706213 13131 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:26.663461 17254 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:26.705102 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 112442us
I20260709 12:20:26.650434 17071 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:26.696879 13252 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:26.608826 17188 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.718788 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:26.650374 17251 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:26.674713 17209 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:26.702078 17240 consensus_meta.cc:287] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.001s
I20260709 12:20:26.733731 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:26.675414 17098 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:26.724462 13133 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:26.743752 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:26.744720 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:26.745854 13204 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:26.748592 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:26.683609 17252 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:26.754629 13209 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:26.754995 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:26.761449 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:26.761806 13211 raft_consensus.cc:2376] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10. Re-sending same reply.
I20260709 12:20:26.763013 13131 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:26.765717 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:26.770596 13212 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:26.697064 17120 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:20:26.674175 17119 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:20:26.680910 17153 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.695616 17249 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:20:26.779840 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:26.743570 17098 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.783403 13203 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:26.784598 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:26.697846 17248 consensus_queue.cc:1059] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:20:26.790520 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:26.812353 13206 raft_consensus.cc:2410] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:26.833470 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:26.834184 13212 raft_consensus.cc:2376] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8. Re-sending same reply.
I20260709 12:20:26.845839 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.846583 13131 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:26.847661 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.848603 13134 raft_consensus.cc:2410] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:20:26.855343 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:26.857349 17130 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:26.858094 17130 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.861865 17130 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:26.863824 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:26.722935 17254 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.884490 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:26.915416 17260 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:20:26.917479 13879 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:26.917793 17226 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:26.918947 17246 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.209s
I20260709 12:20:26.922071 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:26.747354 17240 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:26.787199 17098 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:26.925354 13212 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:26.811688 16688 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:26.754015 17209 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.938861 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:26.939996 13203 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:26.941299 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:26.926276 16972 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:26.944741 13135 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:20:26.942039 17188 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:26.964768 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:26.952916 17094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.026s
W20260709 12:20:26.962517 16931 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:20:26.942919 16688 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:26.992524 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:26.975703 17094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.011s	sys 0.026s
I20260709 12:20:26.965646 17119 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:26.998467 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:26.999123 13203 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:26.999485 17254 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:27.003249 13206 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:27.005431 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 334777us
I20260709 12:20:27.007503 13203 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:27.011540 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:27.034432 13210 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
W20260709 12:20:27.051349 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 316025us
I20260709 12:20:27.005829 17119 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:27.059228 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:27.054769 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 372236us
I20260709 12:20:27.056000 13175 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:27.066748 13177 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:27.078155 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 378027us
W20260709 12:20:27.078843 13249 leader_election.cc:336] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.953s (SENT)
W20260709 12:20:27.080102 13249 leader_election.cc:336] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 2.005s (SENT)
I20260709 12:20:27.080521 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:27.081980 13286 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.007s	sys 0.029s
W20260709 12:20:27.082412 13286 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.008s	sys 0.030s
I20260709 12:20:27.073222 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:27.089792 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:27.102840 13249 leader_election.cc:336] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 2.020s (SENT)
I20260709 12:20:27.108539 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:27.085081 13175 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:27.054064 17153 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:27.129715 13283 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:20:27.076079 17266 log.cc:927] Time spent T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:20:27.074946 17257 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.139945 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54977.3us
I20260709 12:20:27.143045 13175 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:27.073544 17254 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.132572 17246 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.161477 17246 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:27.141601 17220 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:27.163151 17220 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.163683 17220 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:27.075565 17250 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:27.134416 17224 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:20:27.151943 17217 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.160698 17121 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:27.158870 17254 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:27.180774 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:27.166410 17029 consensus_meta.cc:287] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.585s	user 0.015s	sys 0.002s
W20260709 12:20:27.192800 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 408251us
I20260709 12:20:27.135519 17240 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:27.141377 17209 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:27.202618 13103 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:27.210079 13205 raft_consensus.cc:2410] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:20:27.210367 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 340485us
I20260709 12:20:27.166508 17251 raft_consensus.cc:697] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:27.214882 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 69676.1us
W20260709 12:20:27.213951 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 517082us
I20260709 12:20:27.220856 13252 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:27.222992 13252 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:27.223752 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:27.231211 13252 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:27.223922 17284 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:27.166774 17257 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:27.225045 17279 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:27.226652 17277 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.227341 17029 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:27.227809 13128 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:20:27.228117 16688 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:27.228426 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:27.229183 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:27.246912 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2106) took 1002 ms. Trace:
I20260709 12:20:27.174510 17071 raft_consensus.cc:697] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:27.243228 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:27.249091 13135 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:27.250586 13132 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:27.178705 17217 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:27.247291 13278 rpcz_store.cc:276] 0709 12:20:26.244375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.244547 (+   172us) service_pool.cc:224] Handling call
0709 12:20:26.244887 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.254780 (+  9893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.254824 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.270556 (+ 15732us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.728581 (+458025us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:26.728625 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.728799 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:27.246697 (+517898us) raft_consensus.cc:1685] finished
0709 12:20:27.246728 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.246853 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":194,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":408652,"threads_started":1,"wal-append.queue_time_us":625737}
I20260709 12:20:27.255760 13131 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:27.245929 13128 pending_rounds.cc:85] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 6
I20260709 12:20:27.258615 13128 pending_rounds.cc:107] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 12:20:27.254988 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:27.259351 13136 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:27.263836 13128 raft_consensus.cc:2917] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 12:20:27.264448 13128 raft_consensus.cc:2889] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:27.265895 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 398449us
I20260709 12:20:27.240583 17246 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:27.281275 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 427071us
I20260709 12:20:27.316082 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:27.319367 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:27.321798 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:27.322619 13278 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:27.323575 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:27.324462 13210 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:27.287217 17240 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:27.327744 13885 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:20:27.328838 17269 log.cc:927] Time spent T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:20:27.329226 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:27.330022 13207 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:27.330411 17273 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:20:27.327157 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:27.252645 17277 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:27.344342 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:27.348590 13882 raft_consensus.cc:2393] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:27.356208 13278 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:27.359666 13886 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
W20260709 12:20:27.333155 17282 log.cc:927] Time spent T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:20:27.366473 13886 pending_rounds.cc:85] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Aborting all ops after (but not including) 6
W20260709 12:20:27.365731 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 154468us
I20260709 12:20:27.314057 17002 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.368824 13838 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:27.369114 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:27.374290 13879 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:27.371073 13886 pending_rounds.cc:107] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 12:20:27.375027 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:27.329276 17098 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:27.370842 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 168328us
I20260709 12:20:27.375341 13886 raft_consensus.cc:2917] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 12:20:27.399896 13103 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:27.403700 13886 raft_consensus.cc:2889] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:27.413354 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:27.414312 13882 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:27.415762 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:27.416608 13282 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
W20260709 12:20:27.419801 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 47809.7us
I20260709 12:20:27.421307 13100 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:27.359946 17286 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:27.428402 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:27.312841 17246 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 12:20:27.429581 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.441907 13103 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:27.442107 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:27.443342 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:27.436282 13280 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
W20260709 12:20:27.411583 17120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.026s	sys 0.049s
I20260709 12:20:27.448639 13129 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:27.452679 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:27.319650 17071 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:27.432487 17294 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:20:27.456404 17120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.027s	sys 0.049s
I20260709 12:20:27.502610 13281 raft_consensus.cc:2410] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:20:27.448658 13212 raft_consensus.cc:2393] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 7: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:27.457702 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:27.535630 13128 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:27.406059 17002 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:27.319959 17251 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:27.446267 17296 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:27.550659 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 108938us
I20260709 12:20:27.522609 17286 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:27.532449 16972 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:27.557981 13285 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:27.558054 13880 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:27.558530 13285 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:27.501528 17240 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:20:27.554210 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:27.447491 17295 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:27.526300 17300 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:27.562413 13840 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:27.453716 17242 consensus_queue.cc:1059] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 12:20:27.539324 17289 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:27.540189 17094 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:27.552095 17120 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:27.550232 17257 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:27.555820 17296 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.591382 17281 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.298s	user 0.001s	sys 0.001s
I20260709 12:20:27.553488 17294 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:27.593966 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 219045us
I20260709 12:20:27.591740 17098 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:27.565301 17286 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:27.610174 17292 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:27.610807 17290 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:27.611672 17267 log.cc:927] Time spent T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.682s	user 0.004s	sys 0.000s
W20260709 12:20:27.612035 17297 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 12:20:27.612427 17276 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 12:20:27.560781 16972 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:27.608688 13838 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:27.645148 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 413965us
I20260709 12:20:27.615876 13285 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:27.589429 17217 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:27.701187 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 92583.6us
I20260709 12:20:27.703534 13252 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:27.572171 17300 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:27.710006 13838 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:27.731784 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:27.732584 13175 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:27.732852 13886 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:27.734136 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:27.667784 16973 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:20:27.734843 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 172495us
I20260709 12:20:27.759634 13285 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:27.714962 17281 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:20:27.761121 13840 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:27.700922 17212 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:27.709007 16972 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:27.649194 17094 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:27.794806 13207 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:27.694077 17246 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:20:27.594625 17289 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:27.882509 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 328370us
W20260709 12:20:28.109843 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:27.875185 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 171938us
I20260709 12:20:27.893903 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 721) took 1658 ms. Trace:
W20260709 12:20:27.855883 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.761897 17204 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:28.150424 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.150837 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2914) took 1151 ms. Trace:
I20260709 12:20:28.075601 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2910) took 1081 ms. Trace:
I20260709 12:20:28.155058 13285 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:20:28.155704 13285 pending_rounds.cc:85] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 7
I20260709 12:20:28.156164 13285 pending_rounds.cc:107] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:20:28.156598 13285 raft_consensus.cc:2889] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:28.009932 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 275873us
I20260709 12:20:28.155205 13212 rpcz_store.cc:276] 0709 12:20:26.981823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.982243 (+   420us) service_pool.cc:224] Handling call
0709 12:20:28.063222 (+1080979us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540041d2d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:28.063410 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042710272}
I20260709 12:20:28.167982 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:28.152905 13209 rpcz_store.cc:276] 0709 12:20:26.999300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.010753 (+ 11453us) service_pool.cc:224] Handling call
0709 12:20:27.035308 (+ 24555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.065610 (+ 30302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.065642 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:27.065685 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:27.065730 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.065794 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.150563 (+1084769us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b54001c3c50. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:28.150751 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29823,"raft.queue_time_us":38013,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":29267,"spinlock_wait_cycles":55604096}
W20260709 12:20:28.036322 17313 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:20:28.141222 13137 rpcz_store.cc:276] 0709 12:20:26.201306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.201492 (+   186us) service_pool.cc:224] Handling call
0709 12:20:26.201893 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.202337 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.202381 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.254062 (+ 51681us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b2c00000c88. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:20:26.254651 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.593136 (+338485us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:26.593179 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.593241 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:27.610868 (+1017627us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:27.859502 (+248634us) raft_consensus.cc:1685] finished
0709 12:20:27.859536 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.859731 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":505,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":73847040,"thread_start_us":279141,"threads_started":1,"wal-append.queue_time_us":553725}
I20260709 12:20:28.173444 13175 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:27.910929 17306 log.cc:927] Time spent T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 12:20:27.979811 17299 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:20:27.872825 17242 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.035531 17288 raft_consensus.cc:3055] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:27.962451 17285 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:27.776435 17130 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:28.161330 17204 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.892727 17326 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:28.185104 13130 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.002s	sys 0.014s
W20260709 12:20:28.212868 13130 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.002s	sys 0.014s
W20260709 12:20:28.184319 17252 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.264s	user 0.006s	sys 0.011s
W20260709 12:20:27.904242 17220 consensus_meta.cc:287] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.000s
I20260709 12:20:28.025683 17331 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:27.979226 17298 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:28.004422 17284 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.113377 17250 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.927491 17217 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:27.798725 16494 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:28.184930 13177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.009s	sys 0.006s
W20260709 12:20:28.287951 13177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.009s	sys 0.006s
W20260709 12:20:28.288312 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 750684us
I20260709 12:20:27.942796 17194 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:27.651836 17296 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:27.961916 17210 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:28.135725 17295 raft_consensus.cc:697] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:27.785161 17277 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:28.161906 17279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.159s	sys 0.263s
I20260709 12:20:27.768728 16973 raft_consensus.cc:697] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:28.239698 17300 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:28.199410 17288 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:28.205716 17242 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:28.241641 17287 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:28.242311 17251 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:28.303076 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 147305us
I20260709 12:20:28.242199 17301 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 12:20:28.220178 17252 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.407s	user 0.007s	sys 0.011s
I20260709 12:20:28.317934 17252 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:28.319007 17252 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.239813 17331 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.320529 16972 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:28.321470 17331 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:28.322840 16972 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:28.296530 17210 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.243809 17284 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:28.323745 17210 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:28.325536 17284 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:28.326527 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2883) took 2504 ms. Trace:
I20260709 12:20:28.328006 17314 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:28.328683 17314 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.329903 17119 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:28.331564 17334 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:28.331867 17288 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.332248 17334 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:28.332943 17305 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.694s	user 0.002s	sys 0.000s
I20260709 12:20:28.333170 17288 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:28.334865 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 733) took 1494 ms. Trace:
I20260709 12:20:28.334954 17334 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:28.293023 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 125132us
I20260709 12:20:28.247409 16863 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.214073 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 731) took 1834 ms. Trace:
I20260709 12:20:28.343922 17249 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:28.343945 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:28.344484 17249 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:28.215788 17130 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.343674 16863 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.346834 17130 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:28.343657 13130 rpcz_store.cc:276] 0709 12:20:26.379946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.842240 (+462294us) service_pool.cc:224] Handling call
0709 12:20:26.842566 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:27.275971 (+433405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.279504 (+  3533us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:27.284738 (+  5234us) log.cc:844] Serialized 52 byte log entry
0709 12:20:27.443845 (+159107us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:28.213351 (+769506us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.213648 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.213759 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.213814 (+    55us) raft_consensus.cc:1685] finished
0709 12:20:28.213832 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.214003 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175880,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":82973,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":23216,"thread_start_us":1223618,"threads_started":3,"wal-append.queue_time_us":712074}
I20260709 12:20:28.338918 17295 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.349409 17226 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.349900 17226 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:28.335297 13133 rpcz_store.cc:276] 0709 12:20:26.840653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.840878 (+   225us) service_pool.cc:224] Handling call
0709 12:20:26.841250 (+   372us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:27.182656 (+341406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.182699 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:27.210222 (+ 27523us) log.cc:844] Serialized 52 byte log entry
0709 12:20:27.361151 (+150929us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:27.454324 (+ 93173us) log.cc:844] Serialized 14 byte log entry
0709 12:20:27.532799 (+ 78475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.533082 (+   283us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.332178 (+799096us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:28.334586 (+  2408us) raft_consensus.cc:1685] finished
0709 12:20:28.334681 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.334808 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107901,"prepare.queue_time_us":234501,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":161935,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":7081,"spinlock_wait_cycles":58030080,"thread_start_us":528332,"threads_started":3,"wal-append.queue_time_us":316188}
I20260709 12:20:28.351737 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:27.915971 17317 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.313s
I20260709 12:20:28.331291 17314 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:28.352962 17002 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:28.290331 17289 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:28.307418 16973 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.312110 17337 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:28.290963 17298 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:20:28.314882 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2896) took 1597 ms. Trace:
I20260709 12:20:28.315285 17311 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:27.926051 17294 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:28.316313 17248 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:28.362584 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:28.363901 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:28.211458 17204 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:28.317195 17316 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:20:28.319552 17335 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.323302 17242 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:28.326892 13286 rpcz_store.cc:276] 0709 12:20:25.821870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.822086 (+   216us) service_pool.cc:224] Handling call
0709 12:20:25.822429 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.402020 (+579591us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:27.082812 (+680792us) log.cc:844] Serialized 14 byte log entry
0709 12:20:27.337855 (+255043us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:27.338480 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:20:27.360829 (+ 22349us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:27.360885 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.360976 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.326299 (+965323us) raft_consensus.cc:1685] finished
0709 12:20:28.326318 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.326438 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1859,"prepare.queue_time_us":586957,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":368792,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":22662,"thread_start_us":1282654,"threads_started":3,"wal-append.queue_time_us":404312}
I20260709 12:20:28.335557 17333 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:28.314904 17094 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:28.335989 17287 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:27.943018 17286 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:28.336889 17296 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:28.337833 16931 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:20:28.338083 17251 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:28.338461 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:28.339077 17322 log.cc:927] Time spent T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:20:28.228847 17326 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.396042 17326 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:28.204313 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:28.396899 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 192679us
I20260709 12:20:28.397989 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:28.398697 17109 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:28.247259 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 107243us
I20260709 12:20:28.399206 17109 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.399642 17109 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:28.400465 13103 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:28.401652 13103 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:28.220487 17121 consensus_meta.cc:287] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.039s	user 0.014s	sys 0.000s
I20260709 12:20:28.342694 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:28.360715 17119 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:20:28.410234 17217 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:28.410735 16893 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.410835 17217 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:28.411926 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 73518us
I20260709 12:20:28.412084 16931 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:28.412715 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:28.413847 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:28.414521 17119 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:28.415148 17119 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:28.418660 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:28.297318 17279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.159s	sys 0.264s
I20260709 12:20:28.421183 13175 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:28.344931 13131 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:28.421902 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:28.355392 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:28.355490 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:28.422993 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:28.355891 13838 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:28.425359 13103 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:28.347353 16863 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:28.359160 13129 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:28.434847 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 79033.2us
I20260709 12:20:28.423497 13130 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:28.364934 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:28.316681 17301 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:28.366852 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:28.436685 13135 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 7.
I20260709 12:20:28.435129 13175 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:28.438441 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:28.335965 16972 consensus_queue.cc:1059] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:28.392968 17280 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:28.393813 17251 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:28.396962 16494 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:28.443397 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:28.445466 13130 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:28.444280 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:28.398947 17287 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:28.367851 17289 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:28.402889 13137 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:28.230777 17220 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:28.341794 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:28.403517 17334 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:28.404134 17317 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:28.404907 13277 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:20:28.462574 13277 pending_rounds.cc:85] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 6
I20260709 12:20:28.462983 13277 pending_rounds.cc:107] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:20:28.463265 13277 raft_consensus.cc:2889] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:28.405231 17331 consensus_queue.cc:1059] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:20:28.469000 17265 log.cc:927] Time spent T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 1.540s	user 0.004s	sys 0.000s
I20260709 12:20:28.469333 17331 raft_consensus.cc:3055] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:28.469763 17331 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:28.409159 17226 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:28.402701 17094 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:28.352443 13283 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:28.462610 17251 raft_consensus.cc:3055] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:28.472317 17251 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:28.472775 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:28.473182 17251 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:28.474385 17251 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:28.419512 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:28.452114 17098 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:28.475719 17098 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.476099 17098 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:28.476423 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1055) took 2271 ms. Trace:
I20260709 12:20:28.421109 13282 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:28.475216 13283 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:28.452030 17129 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:28.415242 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:28.423419 13136 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:28.452389 16494 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:28.360255 13205 rpcz_store.cc:276] 0709 12:20:26.717472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.728152 (+ 10680us) service_pool.cc:224] Handling call
0709 12:20:28.314706 (+1586554us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54000b7054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:28.314825 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023471872}
I20260709 12:20:28.286285 17250 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:28.440606 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:28.441524 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:28.443121 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:28.447887 13103 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:28.444020 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:28.453164 13129 raft_consensus.cc:2393] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 7: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:28.455879 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:28.445485 13838 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:28.457751 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:28.462111 17289 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.411331 16893 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.455489 17327 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:28.309954 17254 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:28.452265 17300 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.443500 17284 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:28.470666 17331 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:28.487216 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 145485us
I20260709 12:20:28.357759 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:28.454178 17280 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.361331 17337 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.383701 17335 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.474251 17109 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.376137 17333 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.456633 17217 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:28.452057 17301 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:28.456405 17290 consensus_queue.cc:1059] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 12:20:28.479463 13840 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:28.549325 13131 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:28.476809 13881 rpcz_store.cc:276] 0709 12:20:26.204636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.205177 (+   541us) service_pool.cc:224] Handling call
0709 12:20:26.241059 (+ 35882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.243667 (+  2608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.243708 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.263399 (+ 19691us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.629219 (+365820us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:26.629283 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.629384 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.460894 (+1831510us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:28.476122 (+ 15228us) raft_consensus.cc:1685] finished
0709 12:20:28.476144 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.476346 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7330,"raft.queue_time_us":2642,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9449,"spinlock_wait_cycles":5178752,"thread_start_us":318208,"threads_started":1,"wal-append.queue_time_us":468622}
I20260709 12:20:28.456774 17242 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:28.841687 13286 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 6.
W20260709 12:20:28.842607 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 394747us
I20260709 12:20:28.843326 17288 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:28.844499 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 428998us
W20260709 12:20:28.710106 17319 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.913s	user 0.000s	sys 0.003s
W20260709 12:20:28.470695 17262 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 1.682s	user 0.003s	sys 0.000s
I20260709 12:20:28.885221 13279 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:28.499773 16972 raft_consensus.cc:2764] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:20:28.600404 17119 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:28.519719 13130 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:28.880187 13134 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:20:28.975368 13137 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:20:28.886715 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 407310us
W20260709 12:20:28.893760 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 53371.4us
I20260709 12:20:28.844604 17284 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.908502 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:28.559401 17120 consensus_meta.cc:287] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.926s	user 0.014s	sys 0.000s
I20260709 12:20:28.909401 17288 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.476843 17246 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:28.706118 17316 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:28.462430 17317 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.705866 17285 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:28.920032 13103 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:28.920825 13280 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:28.485179 17129 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:28.884232 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 438794us
I20260709 12:20:28.841935 17327 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.602176 17029 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:28.845808 17295 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:28.691803 17308 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:28.544301 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.891722 16688 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:28.908438 17292 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:28.536561 17309 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.390s
W20260709 12:20:29.021827 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.595633 17287 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:28.880409 17344 consensus_queue.cc:1059] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:20:28.476908 17329 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.528s
I20260709 12:20:29.044097 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:28.981385 17220 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:28.980643 17284 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:28.995297 17346 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:20:28.990964 17120 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:28.987265 17288 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:29.005890 17319 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:20:29.002679 17317 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:29.035764 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:29.000792 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 80893.7us
I20260709 12:20:28.550149 17210 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:28.997232 17342 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:29.013057 17327 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:28.908414 17300 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.018435 17250 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.014971 17129 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:29.030215 17094 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:29.018935 17292 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:29.019588 16688 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:29.076733 17347 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:20:29.002429 17316 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.079937 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.080969 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.081806 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.041466 17295 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.091360 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2885) took 3241 ms. Trace:
I20260709 12:20:29.026803 17308 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.086347 17250 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.109760 17316 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.110201 17250 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.111606 13135 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:29.111759 17295 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.112627 17250 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.086593 17220 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:29.114588 13210 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:29.015196 17285 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.026916 17029 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.095022 13284 rpcz_store.cc:276] 0709 12:20:25.849873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.850073 (+   200us) service_pool.cc:224] Handling call
0709 12:20:25.850563 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.093570 (+243007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.093622 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.150947 (+ 57325us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.473468 (+322521us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:26.473509 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.473598 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.460975 (+1987377us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:29.082290 (+621315us) raft_consensus.cc:1685] finished
0709 12:20:29.082321 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:29.091290 (+  8969us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113515,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3188,"spinlock_wait_cycles":57339776,"thread_start_us":564462,"threads_started":2,"wal-append.queue_time_us":581561}
W20260709 12:20:29.103997 17352 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:20:29.105065 17333 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.107853 17301 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:29.094817 17329 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:29.082995 17254 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:29.090167 17292 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:29.090946 16688 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:29.138784 17285 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.135353 17109 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.131726 17337 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.141810 17029 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.142195 17294 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:29.142915 17294 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:29.122251 17277 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:29.123732 17289 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:29.134501 17098 consensus_meta.cc:287] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.658s	user 0.003s	sys 0.009s
W20260709 12:20:29.153445 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 711926us
I20260709 12:20:29.150476 17280 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.205581 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:29.218716 13102 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.769s (SENT) [suppressed 37 similar messages]
I20260709 12:20:29.223598 13841 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:29.230930 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.231868 13279 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
W20260709 12:20:29.219403 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 310937us
I20260709 12:20:29.236022 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:20:29.128362 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 120476us
I20260709 12:20:29.128885 17355 consensus_queue.cc:1059] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:20:29.250383 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 44907.6us
I20260709 12:20:29.251981 13175 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:29.252920 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:29.146991 17254 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.264103 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.272197 13283 raft_consensus.cc:2410] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:29.252337 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:29.161466 17335 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:29.277825 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 220543us
I20260709 12:20:29.284904 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.286242 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:29.287012 13132 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:29.267026 17285 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:29.288547 17285 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.291600 17285 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:29.292924 17204 consensus_meta.cc:287] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.908s	user 0.010s	sys 0.000s
I20260709 12:20:29.293422 17204 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.221004 17188 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:29.294983 17188 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.297652 17188 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.220713 17249 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.299815 17209 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:29.172032 17277 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.264014 17337 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:29.288935 17250 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:29.300858 17254 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:29.222435 17098 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.304052 17300 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.304948 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:29.305253 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.306006 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.354192 13133 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
W20260709 12:20:29.280272 17311 consensus_meta.cc:287] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.911s	user 0.011s	sys 0.001s
I20260709 12:20:29.290339 17280 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:29.314782 17288 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.316887 13132 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:29.317728 17342 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:29.317834 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 737) took 3144 ms. Trace:
I20260709 12:20:29.385848 13277 rpcz_store.cc:276] 0709 12:20:26.173672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.173849 (+   177us) service_pool.cc:224] Handling call
0709 12:20:26.174234 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:28.485399 (+2311165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.317572 (+832173us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54002292d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:29.317767 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5129140480}
I20260709 12:20:29.318572 17204 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.320730 16688 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.322127 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.401201 13211 raft_consensus.cc:2393] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:29.322373 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:29.323654 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.324543 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.326839 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.402657 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.328430 17109 consensus_queue.cc:1059] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:20:29.220942 17029 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:20:29.146323 17329 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.249955 17333 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:29.333743 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.335841 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.342705 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:29.264174 17120 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:20:29.344851 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 66249us
I20260709 12:20:29.422122 13286 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:29.345567 17209 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:29.356691 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:29.423868 13207 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:29.309687 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.334628 17257 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:29.343924 17356 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.426898 17209 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:29.431384 16688 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:29.343204 17294 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.432425 17294 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:29.433254 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:29.405324 17280 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.434544 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:29.436014 17300 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:29.436388 17300 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:29.436744 17300 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:29.437121 17280 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.437114 17250 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:29.382186 17254 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:20:29.437808 17250 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:29.438244 17250 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:29.439033 17257 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:29.441510 17251 consensus_meta.cc:287] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.967s	user 0.012s	sys 0.000s
I20260709 12:20:29.442215 17251 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:29.442622 17251 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.443004 17251 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:29.443876 13278 raft_consensus.cc:2410] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:20:29.444584 17286 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:29.445200 17286 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:29.445353 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2120) took 1028 ms. Trace:
I20260709 12:20:29.445808 13278 rpcz_store.cc:276] 0709 12:20:28.416431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.419276 (+  2845us) service_pool.cc:224] Handling call
0709 12:20:29.445135 (+1025859us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54000979d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:29.445288 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225813248}
I20260709 12:20:29.446094 17286 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.423370 17120 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:29.450227 17120 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:29.450788 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.451155 17250 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:29.454020 17345 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.908s	user 0.006s	sys 0.003s
I20260709 12:20:29.319885 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:29.391726 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 318971us
I20260709 12:20:29.267459 17252 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:20:29.398428 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:29.460047 13103 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:29.423141 16494 consensus_meta.cc:287] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.001s
I20260709 12:20:29.350832 17309 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:29.328480 17285 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.422397 13129 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:29.383209 17311 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:29.430325 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.477391 13206 raft_consensus.cc:2410] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:20:29.458074 13128 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:29.462683 13103 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:29.354478 17094 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:29.471035 13207 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:29.428486 17109 consensus_queue.cc:1243] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:29.456311 17286 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:29.473173 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 246508us
W20260709 12:20:29.473838 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 231881us
I20260709 12:20:29.421550 17210 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.492182 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.441546 17257 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:29.498064 13100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.005s	sys 0.007s
W20260709 12:20:29.503247 13100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.005s	sys 0.008s
W20260709 12:20:29.503701 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 525167us
I20260709 12:20:29.504721 13207 raft_consensus.cc:2368] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:29.476079 17246 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:29.510123 17372 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:29.510327 17370 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:29.510322 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.513218 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.514865 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.516588 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.517386 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.517570 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:29.515525 13134 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:29.519529 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.520157 13132 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:29.477830 17301 consensus_queue.cc:1059] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:20:29.527483 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.479264 16494 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.525501 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.505018 17369 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:29.519101 17242 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.383973 17317 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.485966 17309 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.521111 17372 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.536192 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.510871 17370 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.536962 17338 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.532403 17094 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.534389 17369 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:29.504055 17129 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.541842 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.547736 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.547971 17287 raft_consensus.cc:3055] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:29.586444 13129 raft_consensus.cc:2393] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:29.547652 17372 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.430955 17356 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.554046 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.555626 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.556937 17309 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.512108 13128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:29.588572 13211 raft_consensus.cc:2368] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:29.592918 13128 raft_consensus.cc:606] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:20:29.593482 13128 raft_consensus.cc:614] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:29.596228 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:29.575042 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 356339us
W20260709 12:20:29.589473 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 337215us
I20260709 12:20:29.602321 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.603507 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.603557 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:29.603936 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.601378 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.605319 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.607555 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.608259 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.608851 13203 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:29.609067 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:29.609627 13282 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:29.609645 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.611600 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:29.613480 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.613525 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:29.568192 17369 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:29.616618 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 76020.1us
I20260709 12:20:29.587206 17287 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:29.623852 13841 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:29.601128 17277 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.541671 17242 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.625769 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:29.624737 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 226374us
I20260709 12:20:29.626626 13887 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:29.636113 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.637017 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.637655 13881 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:29.624712 13203 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:29.641674 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:29.627039 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 271863us
I20260709 12:20:29.633055 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.634068 13880 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:20:29.644625 13884 raft_consensus.cc:2410] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:20:29.626899 13282 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
W20260709 12:20:29.634801 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:29.651729 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.652536 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:29.653968 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.654595 13887 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:29.657853 13203 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:20:29.619931 17288 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.569284 17338 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.660959 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2130) took 1197 ms. Trace:
I20260709 12:20:29.661405 13280 rpcz_store.cc:276] 0709 12:20:28.452455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.457530 (+  5075us) service_pool.cc:224] Handling call
0709 12:20:29.649992 (+1192462us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5400096fd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:29.650084 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82500352}
I20260709 12:20:29.662112 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:29.662285 13887 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:29.665189 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.657126 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:29.665936 13204 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:29.666704 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.668184 13277 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:20:29.669539 13129 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:29.638832 17314 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.675554 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.676448 13883 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:29.669989 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.677260 13880 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:29.670907 13207 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:20:29.672832 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:29.682478 13882 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:20:29.683032 13204 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:20:29.683560 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.684283 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.661295 17210 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:29.676734 17292 consensus_meta.cc:287] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 12:20:29.664996 17329 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.689006 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:29.696297 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.699884 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.685573 13283 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:29.693289 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:29.683670 17309 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:29.701586 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.701579 13175 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:29.702863 13204 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:29.708282 13204 raft_consensus.cc:3055] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:29.708640 13204 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:29.713385 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.716401 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.709311 13204 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.718346 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:29.721217 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.692277 17210 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:29.723181 13128 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:29.705840 17287 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.692517 17109 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:20:29.728879 17129 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:29.709020 17284 consensus_meta.cc:287] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.000s
I20260709 12:20:29.703004 17250 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.706751 16892 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:29.736585 13129 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
W20260709 12:20:29.720253 17327 consensus_meta.cc:287] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.634s	user 0.006s	sys 0.006s
I20260709 12:20:29.686218 17314 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.696942 17311 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:20:29.754869 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.747985 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.749948 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.747258 13880 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:29.736640 17210 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:29.695904 17357 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 12:20:29.749049 17378 log.cc:927] Time spent T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:20:29.734269 17384 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:29.762197 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.808311 17384 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:29.809037 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.809309 17384 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.810254 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.762192 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.812441 13283 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:29.742539 16494 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.751087 16892 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.813359 16892 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:29.811273 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.814853 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.815845 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:29.816453 13885 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:29.817243 17300 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.817884 13210 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:29.765769 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.820219 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:29.821146 13880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:20:29.821656 13880 raft_consensus.cc:606] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:29.704406 17292 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.823123 13881 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:29.824299 17292 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.824738 17294 consensus_queue.cc:1059] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:20:29.825941 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.826678 16892 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:29.767758 17373 log.cc:927] Time spent T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:20:29.768821 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:29.768537 17120 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.769589 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.758433 17327 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.768541 17209 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.756315 17287 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:29.771801 17314 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.773847 13279 raft_consensus.cc:2410] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:20:29.828752 17300 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.778970 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:29.780124 17370 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.780905 17356 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.781693 17338 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.751824 17284 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:29.872103 13884 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:29.759166 17317 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.805851 13136 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
W20260709 12:20:29.805621 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 83047.1us
W20260709 12:20:29.759984 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 75706.7us
I20260709 12:20:29.829887 13207 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:29.828747 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.876245 13206 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:29.830705 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:29.831084 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:29.834389 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:29.877274 13203 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:29.855243 13885 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:29.860491 13283 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:29.776400 17211 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:29.844434 17351 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 1.305s	user 0.020s	sys 0.002s
I20260709 12:20:29.862373 16892 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.865665 13130 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:20:29.796283 17242 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.888245 13131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:29.888870 13131 raft_consensus.cc:606] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:29.888986 13212 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:29.886391 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:29.842885 17251 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.893792 13283 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:20:29.872783 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 152007us
I20260709 12:20:29.873857 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:29.866554 17395 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:29.893757 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:20:29.908067 17389 log.cc:927] Time spent T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:20:29.908957 17209 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.885317 17211 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.909974 17327 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:29.844071 17369 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:29.911873 17211 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:29.885771 17314 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 12:20:29.927525 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 51280us
I20260709 12:20:29.928790 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:29.930510 13252 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:29.931376 13252 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:29.946240 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.952812 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:29.956946 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:29.957549 13886 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:29.963642 13206 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:29.964202 13283 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:29.964957 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:29.966534 13278 raft_consensus.cc:2393] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:29.969090 13206 raft_consensus.cc:2393] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:29.972360 13252 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:29.906754 17242 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:29.978299 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.978528 13209 raft_consensus.cc:2393] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:29.979451 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:29.981911 13252 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:29.983237 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:29.984587 13206 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:29.984956 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:29.990010 17362 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:29.990477 17362 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:29.991629 13277 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:29.965391 17211 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:29.989226 13206 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:20:29.968808 17254 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:29.965684 17327 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:29.992482 13252 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:29.990849 17362 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:29.971343 17252 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:29.994407 17211 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:29.978505 17242 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.999075 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:30.000259 17385 consensus_queue.cc:1059] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:30.000896 17211 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:30.001068 13128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:30.007036 13128 raft_consensus.cc:606] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:29.986639 16972 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:29.988260 17344 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:30.002022 17398 log.cc:927] Time spent T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:20:29.991350 17286 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:29.988461 17294 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:29.983335 17396 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:20:29.925016 17395 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.016606 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:30.007517 17242 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:30.008112 17254 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:30.017632 17385 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:30.052989 17029 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:30.053686 17029 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:30.054654 16893 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:30.060362 17369 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:30.060705 17372 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:30.062079 17251 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:30.067034 13132 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:30.069540 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:30.069622 17242 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.072355 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:30.072896 17284 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:30.073617 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:30.074326 13134 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:30.074440 17362 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.075302 13132 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:30.076733 17362 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:30.017421 17294 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.022957 17286 raft_consensus.cc:697] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:30.032984 13210 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:30.044811 13249 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:30.009356 17120 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:29.998991 17327 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.018437 17396 consensus_queue.cc:1243] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:30.071172 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:30.084846 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:30.087932 13277 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:20:30.088845 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 44126.2us
I20260709 12:20:30.113164 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:30.113533 13249 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:30.113902 13137 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:30.068482 17395 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:30.118510 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:30.119356 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:30.123209 13128 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:30.126881 17294 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:30.054687 17029 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.130349 13886 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:30.134835 13212 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:30.136341 13210 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:20:30.140169 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:30.094769 17254 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:30.143942 13883 raft_consensus.cc:2393] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:30.141132 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:30.018405 17210 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.145840 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.147890 13102 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:30.136451 13886 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:30.149554 13102 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:30.152696 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.153748 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:30.154289 13282 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:30.155030 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:30.122951 17362 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:30.184942 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:30.192570 13175 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:30.195938 13879 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:30.196218 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:30.135481 17342 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:20:30.157508 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:30.142252 17120 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:30.146855 17254 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.158700 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:30.213785 13283 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:20:30.156816 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 164382us
I20260709 12:20:30.159263 17395 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:30.160320 17094 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:30.162561 17240 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:30.164952 13134 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:30.165153 13885 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:30.165773 16892 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:30.166103 13210 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:30.171511 17370 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:30.172322 17249 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:30.174431 17288 raft_consensus.cc:993] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:20:30.177079 17360 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:30.177412 17327 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:30.179054 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.201210 17300 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:30.180467 17242 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:30.196720 17356 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:30.159752 17367 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:30.215047 13252 leader_election.cc:400] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:30.239274 13252 leader_election.cc:403] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:30.212287 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 54863.8us
I20260709 12:20:30.221062 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:30.216866 17254 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:30.260141 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:30.219849 13282 raft_consensus.cc:2410] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:20:30.217211 17362 raft_consensus.cc:3055] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:30.220041 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:30.258417 13252 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:30.263144 13134 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:30.232404 16973 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.213s	user 0.000s	sys 0.030s
I20260709 12:20:30.223075 16892 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:30.231379 17384 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:30.266996 13102 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:30.269457 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:30.238925 17295 raft_consensus.cc:3055] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:30.286913 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.287128 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:30.219213 17406 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:30.289067 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:30.262336 17120 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:20:30.289881 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:30.290056 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:30.290824 13132 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:30.272172 17252 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:30.291061 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:30.262560 17300 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:30.292433 17300 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:30.294813 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.283751 17383 consensus_queue.cc:1059] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:20:30.204564 17286 consensus_queue.cc:237] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.313355 13136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2050) took 1004 ms. Trace:
I20260709 12:20:30.298828 13840 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:30.262171 17311 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:30.324337 13136 rpcz_store.cc:276] 0709 12:20:29.309308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.309438 (+   130us) service_pool.cc:224] Handling call
0709 12:20:30.313152 (+1003714us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b5400060754. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:30.313280 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":875454848}
W20260709 12:20:30.341369 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 52380.9us
W20260709 12:20:30.341701 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.239029 17396 raft_consensus.cc:1081] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:20:30.340560 17029 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.351962 17029 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.357573 17029 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:30.302968 17372 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:30.358289 17372 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.358764 17372 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:30.284498 17251 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:30.359704 17251 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:30.360129 17251 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:30.363020 17211 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.298894 17406 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:30.365074 17406 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:30.365599 17211 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:30.344758 16688 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:30.366839 16688 raft_consensus.cc:697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:30.266978 17342 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:30.262318 17287 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 12:20:30.369709 17287 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:30.367791 16688 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.262462 17362 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:30.372787 17362 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.370823 16892 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.374816 16892 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:30.375101 13175 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:30.382040 13177 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:30.310012 17348 log.cc:927] Time spent T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Append to log took a long time: real 1.216s	user 0.018s	sys 0.004s
W20260709 12:20:30.271682 16973 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.262s	user 0.000s	sys 0.030s
I20260709 12:20:30.388993 17109 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:30.286324 17295 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:30.390862 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:30.391791 13283 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:30.313553 17290 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:30.390318 17301 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:30.416392 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.418341 13887 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:20:30.419809 17417 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.420392 17417 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.422672 17417 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:30.426119 13840 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:30.339773 17344 consensus_queue.cc:1059] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:20:30.430891 13840 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:30.435958 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.429226 13134 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:30.437839 13175 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:30.439131 17204 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:30.442598 13284 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:30.443410 16972 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:30.443960 17410 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:20:30.444034 16972 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.445506 17334 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:30.446152 17334 raft_consensus.cc:697] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:30.443157 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.415073 17316 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:30.449354 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:30.450552 13840 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:30.456025 13137 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:30.417294 17383 raft_consensus.cc:3055] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:30.457433 13175 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:30.460880 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:30.462291 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:30.447197 17334 consensus_queue.cc:237] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.424319 17317 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:30.412739 17301 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.453785 16973 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:30.513130 13134 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:30.431648 17357 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:20:30.458731 17210 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:30.464097 17311 raft_consensus.cc:697] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:30.463899 17383 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:30.464589 17364 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:30.475989 17317 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.478641 17392 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:30.476758 17369 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:30.554718 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 268959us
I20260709 12:20:30.532775 16973 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.534428 17308 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:30.567786 17417 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:30.568418 17417 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:30.570641 17417 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:30.571792 17411 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:20:30.574107 13280 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:30.574273 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:30.581967 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.582029 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.599999 13280 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:30.603628 13277 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:30.558502 17317 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:30.475497 17295 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.566601 16973 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:30.616394 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:30.616904 17413 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:20:30.617870 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:30.617970 17254 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.618579 13210 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:30.619406 13284 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:30.620376 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:30.575418 17342 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
W20260709 12:20:30.624508 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:30.625561 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.626861 17286 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:30.627599 17286 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.630016 17286 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:30.631814 13252 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:30.633141 17286 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:30.633649 17286 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.634112 17286 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:30.576133 17369 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:30.645318 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:30.646134 13210 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:30.620353 17295 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:30.665333 13210 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:30.667007 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:30.635013 17372 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.669600 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:30.672642 17406 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.677798 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:30.651525 16973 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:30.679157 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 264218us
I20260709 12:20:30.678243 13100 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:30.680786 13137 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:30.697026 13205 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:30.697772 13100 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:30.696588 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1670) took 1373 ms. Trace:
I20260709 12:20:30.698801 13211 rpcz_store.cc:276] 0709 12:20:29.323601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.488205 (+164604us) service_pool.cc:224] Handling call
0709 12:20:30.696399 (+1208194us) spinlock_profiling.cc:243] Waited 75.8 ms on lock 0x7b54002f0dd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:30.696533 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174391168}
I20260709 12:20:30.697657 13177 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:30.701274 13100 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:30.702443 13177 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:30.704289 17300 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:30.653304 17415 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:20:30.693729 17423 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:20:30.621124 17383 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.652210 17311 consensus_queue.cc:237] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.720544 17415 consensus_queue.cc:1243] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:30.720984 16973 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:30.675982 17370 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:20:30.708997 17240 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:30.705657 17242 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:30.711642 17369 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.724409 17395 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:30.712392 17286 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.713608 17301 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:30.718639 17372 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:30.719729 17254 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:30.678785 17342 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:30.675736 17290 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:20:30.733078 13177 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:30.707729 17360 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:30.689694 17280 consensus_queue.cc:1059] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:20:30.741562 13177 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:30.737685 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:30.689426 17251 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.728193 17395 raft_consensus.cc:3055] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:30.745255 13280 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:30.732967 17029 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:30.746309 17428 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:30.756331 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:30.757380 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1065) took 1040 ms. Trace:
I20260709 12:20:30.757944 13887 rpcz_store.cc:276] 0709 12:20:29.716606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.716770 (+   164us) service_pool.cc:224] Handling call
0709 12:20:29.717155 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:30.418799 (+701644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.757061 (+338262us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54004be1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:30.757309 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611898240}
I20260709 12:20:30.736088 17406 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:30.738142 17204 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:30.760133 17204 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.762822 17204 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:30.763134 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.763944 13286 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:30.764532 17406 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:30.765085 17406 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.745846 17395 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:30.766736 17382 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 1.042s	user 0.003s	sys 0.006s
I20260709 12:20:30.767311 17395 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.769416 13279 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:20:30.748139 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:30.747218 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.772482 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:30.772665 13280 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:30.774441 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:30.778326 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:30.779079 13884 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:30.771564 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:30.781708 13280 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:30.782958 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:30.784701 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.784982 13286 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:30.785243 13280 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:30.786286 13840 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:30.787057 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:30.743656 17342 raft_consensus.cc:697] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:30.750399 17280 raft_consensus.cc:3055] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:30.795140 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:30.796002 13885 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:30.749264 16688 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:30.805891 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:30.778177 17029 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:30.810281 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.788054 17252 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.801038 17109 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:30.818374 13280 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:30.801824 17280 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:30.808475 16973 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:30.825695 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2134) took 1979 ms. Trace:
I20260709 12:20:30.824452 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:30.827976 13282 raft_consensus.cc:2410] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:20:30.809072 17428 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:30.826931 13285 rpcz_store.cc:276] 0709 12:20:28.846205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.883353 (+ 37148us) service_pool.cc:224] Handling call
0709 12:20:28.883831 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:28.891604 (+  7773us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:29.343361 (+451757us) log.cc:844] Serialized 14 byte log entry
0709 12:20:29.567301 (+223940us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:29.567902 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:20:29.581295 (+ 13393us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:29.581349 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.581454 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:30.766193 (+1184739us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:30.825324 (+ 59131us) raft_consensus.cc:1685] finished
0709 12:20:30.825461 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.825626 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42611,"prepare.queue_time_us":239623,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2192,"raft.queue_time_us":23695,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":92304,"spinlock_wait_cycles":72166272,"thread_start_us":517719,"threads_started":2,"wal-append.queue_time_us":312627}
I20260709 12:20:30.811059 17311 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:30.817850 17109 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.838560 17109 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:30.838580 17311 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:30.823014 17331 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:30.818054 17252 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.841987 17252 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:30.835646 16973 raft_consensus.cc:697] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:30.842658 17342 consensus_queue.cc:237] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.843684 16973 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:30.844738 17412 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.313s	user 0.003s	sys 0.000s
I20260709 12:20:30.845983 17098 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:30.847266 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2934) took 1138 ms. Trace:
I20260709 12:20:30.847689 13206 rpcz_store.cc:276] 0709 12:20:29.708437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.995400 (+286963us) service_pool.cc:224] Handling call
0709 12:20:29.996349 (+   949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:29.996561 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:29.996590 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:29.997545 (+   955us) log.cc:844] Serialized 26 byte log entry
0709 12:20:30.286398 (+288853us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:30.286437 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.286501 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:30.844145 (+557644us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:30.847013 (+  2868us) raft_consensus.cc:1685] finished
0709 12:20:30.847034 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.847199 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16516864,"thread_start_us":288102,"threads_started":1,"wal-append.queue_time_us":426298}
I20260709 12:20:30.849032 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:30.837543 17406 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:30.851186 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:30.852896 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:30.854116 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:30.856432 13206 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:20:30.858307 13206 raft_consensus.cc:1217] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.5->[6.6-10.8]   Dedup: 6.6->[7.7-10.8]
I20260709 12:20:30.858146 17109 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.858810 13206 pending_rounds.cc:85] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:20:30.859117 13206 pending_rounds.cc:107] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:20:30.859390 13206 raft_consensus.cc:2889] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:30.860741 17286 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:30.860858 17109 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:30.862950 17280 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.865422 17280 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:30.861804 17251 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:30.875653 17317 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.877141 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.878365 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.878865 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 756) took 1356 ms. Trace:
I20260709 12:20:30.879465 13208 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:30.880277 17317 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:30.886996 13286 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:30.880546 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2929) took 1366 ms. Trace:
I20260709 12:20:30.839721 17311 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.887734 13209 rpcz_store.cc:276] 0709 12:20:29.514423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.613043 (+ 98620us) service_pool.cc:224] Handling call
0709 12:20:30.880344 (+1267301us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54001c4154. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:30.880477 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837549824}
I20260709 12:20:30.889711 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:30.890249 13209 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:30.891033 13133 rpcz_store.cc:276] 0709 12:20:29.522830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.522952 (+   122us) service_pool.cc:224] Handling call
0709 12:20:29.523254 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:29.590597 (+ 67343us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:29.611724 (+ 21127us) log.cc:844] Serialized 14 byte log entry
0709 12:20:29.698245 (+ 86521us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:29.698303 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:29.698348 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.043081 (+344733us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b180037ac20. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:30.878609 (+835528us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b54003cf5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:30.878659 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:30.878796 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2191,"prepare.queue_time_us":23929,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":250,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":162009856,"thread_start_us":86186,"threads_started":1,"wal-append.queue_time_us":176142,"wal-append.run_cpu_time_us":1069,"wal-append.run_wall_time_us":1005695}
I20260709 12:20:30.887598 17385 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.895289 17385 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.913311 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.914012 13279 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:30.921728 13286 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:30.934229 13283 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:30.952454 13283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38644
I20260709 12:20:30.959771 13283 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.960276 13283 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:30.942859 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1067) took 1183 ms. Trace:
I20260709 12:20:30.960733 13879 rpcz_store.cc:276] 0709 12:20:29.759088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.759255 (+   167us) service_pool.cc:224] Handling call
0709 12:20:29.765920 (+  6665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.196519 (+430599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:30.942551 (+746032us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54005cd5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:30.942781 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988364160}
I20260709 12:20:30.942363 13286 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:20:30.962188 13286 pending_rounds.cc:85] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 3
I20260709 12:20:30.962447 13286 pending_rounds.cc:107] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:20:30.935945 17385 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:30.941862 13204 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:30.960007 13279 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
W20260709 12:20:30.946938 17426 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.329s	user 0.003s	sys 0.000s
I20260709 12:20:30.943310 13209 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:30.968456 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:30.965181 13286 raft_consensus.cc:2889] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:30.969769 13279 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:30.971526 13252 leader_election.cc:336] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.990s (SENT)
I20260709 12:20:30.971912 13279 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:20:30.972527 17285 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:30.975324 13279 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:30.976908 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:30.977412 17375 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:30.974438 13286 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:30.983125 17209 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:30.984159 17375 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:30.984527 17375 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:30.985350 17375 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:30.985986 13252 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:30.986527 17375 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:30.986795 17251 consensus_queue.cc:1059] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:30.987742 17251 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:20:30.988226 17425 log.cc:927] Time spent T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 12:20:30.988279 17251 raft_consensus.cc:697] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:30.989439 17251 consensus_queue.cc:237] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:30.986793 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 762) took 1361 ms. Trace:
I20260709 12:20:30.992178 13129 rpcz_store.cc:276] 0709 12:20:29.625309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.625526 (+   217us) service_pool.cc:224] Handling call
0709 12:20:30.986610 (+1361084us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b54002b5054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:30.986712 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77480192}
I20260709 12:20:30.996874 13204 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:20:30.997592 13204 pending_rounds.cc:85] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:20:30.997965 13204 pending_rounds.cc:107] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:20:30.998306 13204 raft_consensus.cc:2889] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:31.001690 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2919) took 1507 ms. Trace:
I20260709 12:20:30.997255 13283 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.008733 13279 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
W20260709 12:20:31.010576 17220 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:20:31.002674 17337 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.011523 17337 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:31.013708 17337 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:31.021013 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:31.021562 13283 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:31.024946 13279 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:31.002310 13204 rpcz_store.cc:276] 0709 12:20:29.493890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.707854 (+213964us) service_pool.cc:224] Handling call
0709 12:20:29.708172 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.941299 (+1233127us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b58007c58d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4de90aa 00007f70f4e6b447 00007f70f4e83fe7 00007f70f4e857de 00007f70f4e8fb49 00007f70f4e90416 00007f70f4e8cd8f 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4
0709 12:20:31.001310 (+ 60011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.001625 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956963072}
I20260709 12:20:31.090477 17337 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:31.091152 17337 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:31.101064 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:31.177929 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.231909 17285 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:31.267644 17335 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:31.273525 17337 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:31.280685 17335 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.283967 17335 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:31.284837 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:31.285980 13283 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:31.270684 17285 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.310469 17285 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:31.324530 17422 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:31.329084 17358 log.cc:927] Time spent T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 1.898s	user 0.014s	sys 0.005s
W20260709 12:20:31.334542 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 265331us
I20260709 12:20:31.326509 17422 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.434938 17422 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:31.435993 17436 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:20:31.579924 17383 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:31.606694 17249 raft_consensus.cc:3055] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:31.607254 17249 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:31.608238 17249 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:31.609654 17249 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:31.613134 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1685) took 1517 ms. Trace:
I20260709 12:20:31.613597 13205 rpcz_store.cc:276] 0709 12:20:30.095588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.095723 (+   135us) service_pool.cc:224] Handling call
0709 12:20:30.696849 (+601126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.697507 (+   658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.612884 (+915377us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54002f0dd0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:31.613061 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315842304}
I20260709 12:20:31.615778 17451 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:31.617897 13129 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:31.626405 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.627054 13129 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:31.628051 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.630517 13129 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:31.619009 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:31.620173 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:31.631963 13285 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:31.632319 13130 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:31.632385 13285 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:31.633301 13285 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.634294 13285 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:31.623579 13132 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:31.635849 13282 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:31.637650 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:31.641304 13130 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:31.643822 17451 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.646320 17451 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:31.670384 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:31.670827 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.671335 17327 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:31.671964 17327 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.674285 17327 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:31.674881 13100 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:31.674804 17327 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:31.678907 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:31.680627 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.680804 13882 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:31.682039 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:31.682663 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:31.682853 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.682754 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:20:31.683391 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.684645 17451 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:31.696992 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:31.700076 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:31.701310 13884 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:31.685495 17342 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:31.712775 17342 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.715209 13285 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:20:31.715775 13285 pending_rounds.cc:85] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 10
I20260709 12:20:31.719604 13285 pending_rounds.cc:107] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:20:31.720090 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.720273 13285 raft_consensus.cc:2889] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:31.735669 13210 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:31.737919 13206 raft_consensus.cc:1240] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:31.741187 13209 pending_rounds.cc:85] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:20:31.741681 13209 pending_rounds.cc:107] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:20:31.741997 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:31.741997 13209 raft_consensus.cc:2889] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:31.748279 13210 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:20:31.751215 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:31.751322 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:31.752029 13205 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:31.752297 13212 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:31.745260 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:31.756175 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:31.756371 13206 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:31.756979 13204 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:31.758129 17311 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:31.761693 17311 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.728288 17384 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:31.772289 17342 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:31.763303 17362 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:31.764760 17311 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:31.791622 17384 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:31.769045 17406 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:31.796247 17406 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.815618 17406 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:31.837719 13134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 774) took 1651 ms. Trace:
I20260709 12:20:31.852174 13134 rpcz_store.cc:276] 0709 12:20:30.186808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.526955 (+340147us) service_pool.cc:224] Handling call
0709 12:20:31.834396 (+1307441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.834713 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:31.834745 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:31.834796 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:31.834861 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.834947 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:31.837416 (+  2469us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540010c2d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:31.837618 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3005895936}
W20260709 12:20:31.856616 13278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42730 (request call id 778) took 2204 ms (client timeout 1585 ms). Trace:
W20260709 12:20:31.857261 13278 rpcz_store.cc:269] 0709 12:20:29.651962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.652222 (+   260us) service_pool.cc:224] Handling call
0709 12:20:31.856229 (+2204007us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54004092d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:31.856476 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719722880}
W20260709 12:20:31.859670 13128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2059) took 1795 ms (client timeout 1616 ms). Trace:
W20260709 12:20:31.860441 13128 rpcz_store.cc:269] 0709 12:20:30.064443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.070881 (+  6438us) service_pool.cc:224] Handling call
0709 12:20:31.834190 (+1763309us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b540010c2d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:31.859558 (+ 25368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27137408}
W20260709 12:20:31.867261 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.872200 16972 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:31.872301 17456 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:31.874017 17456 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.876880 17456 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:31.877593 17456 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:31.878152 17456 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:31.878829 13281 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:20:31.880018 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2895) took 2208 ms. Trace:
I20260709 12:20:31.880301 13281 rpcz_store.cc:276] 0709 12:20:29.671437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.671553 (+   116us) service_pool.cc:224] Handling call
0709 12:20:31.878633 (+2207080us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:31.879311 (+   678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.879869 (+   558us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54004092d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:31.879970 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5074955008}
I20260709 12:20:31.880553 17456 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:31.882580 17454 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.883102 17454 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:31.883559 17455 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:31.884099 17455 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:31.885521 17454 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:31.886343 17455 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:31.887691 13023 maintenance_manager.cc:643] P 98cf96dd74f448d18b23072207e1dc85: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.803s	user 0.203s	sys 0.075s Metrics: {"bytes_written":29225,"cfile_init":1,"dirs.queue_time_us":314744,"dirs.run_cpu_time_us":493,"dirs.run_wall_time_us":35766,"drs_written":1,"lbm_read_time_us":404,"lbm_reads_lt_1ms":4,"lbm_write_time_us":434892,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":12,"lbm_writes_lt_1ms":17,"peak_mem_usage":0,"rows_written":63,"thread_start_us":207865,"threads_started":1}
I20260709 12:20:31.888998 13128 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:31.890264 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:31.891072 13130 raft_consensus.cc:2410] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:20:31.891623 13024 maintenance_manager.cc:419] P 98cf96dd74f448d18b23072207e1dc85: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9899 bytes on disk
I20260709 12:20:31.892499 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:31.894335 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.895478 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.896042 13132 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:31.896844 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.897284 13023 maintenance_manager.cc:643] P 98cf96dd74f448d18b23072207e1dc85: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":379,"lbm_reads_lt_1ms":4}
I20260709 12:20:31.897846 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.898411 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.898926 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.893734 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.924248 13281 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:20:31.899808 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.945401 13130 raft_consensus.cc:2410] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:20:31.900246 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:31.947049 13129 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:31.899029 13128 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:31.903653 17455 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:20:31.905627 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:31.949798 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.951522 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:31.952742 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:31.953604 13278 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:31.954715 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:31.955834 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:31.916723 17454 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:20:31.908816 17456 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:31.960536 17456 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:31.962978 17456 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:31.965545 13130 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:31.965540 13129 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:31.966792 13133 raft_consensus.cc:3055] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:31.968020 13133 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:31.970081 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:31.969036 13133 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:31.971855 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:31.971451 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 54958.2us
W20260709 12:20:31.972807 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.974120 13133 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:31.972661 17455 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:31.978526 13130 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:31.976681 17455 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:31.980149 17455 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:31.982040 17455 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:31.976624 17456 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:20:31.990509 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2057) took 1926 ms. Trace:
I20260709 12:20:31.991359 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:31.991171 13131 rpcz_store.cc:276] 0709 12:20:30.063823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.071517 (+  7694us) service_pool.cc:224] Handling call
0709 12:20:30.071899 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.142730 (+ 70831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:30.142762 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:30.142801 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:30.142832 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.990157 (+1847325us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b540011dd54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:31.990230 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:31.990419 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162432384}
I20260709 12:20:31.995174 13133 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:31.995905 17456 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.992862 17294 consensus_queue.cc:1059] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:20:32.000053 17294 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:32.000257 17463 raft_consensus.cc:3055] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:32.000280 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:32.000864 17463 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:32.001912 17294 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:32.001847 17463 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.002920 17294 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:32.003540 17462 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.004549 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:32.006606 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:32.007823 13249 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:32.010705 17465 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:31.998027 17456 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.008998 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:32.015930 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:32.017166 13249 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:32.018172 13249 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:32.009536 16972 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:20:32.006801 17455 consensus_queue.cc:1175] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a99436c294734e5cbc3657b2517cefca" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 9 index: 6 } }
I20260709 12:20:32.004176 17462 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:32.004344 17463 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:32.004324 17464 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:32.024047 13208 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36412 (request call id 860) took 2947 ms (client timeout 2147 ms). Trace:
I20260709 12:20:32.029850 13249 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:32.024544 13208 rpcz_store.cc:269] 0709 12:20:29.076104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.079696 (+  3592us) service_pool.cc:224] Handling call
0709 12:20:32.022903 (+2943207us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b540002c454. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:32.023007 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4110567808}
I20260709 12:20:32.021896 17456 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:32.024363 16972 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:32.040307 16972 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:31.743876 17285 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:32.040846 16972 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:32.041406 16972 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:32.041253 17285 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.048422 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:32.049373 17456 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:32.049755 17462 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:32.049799 17456 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:32.050546 17456 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:32.056779 13278 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:32.058566 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:32.060082 13279 raft_consensus.cc:1240] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:32.060804 17456 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.051585 17285 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:32.069202 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:32.070994 16972 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.073238 16972 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:32.073520 17464 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:32.073906 16972 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:32.074527 16972 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:32.074971 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:32.076429 13277 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:20:32.075109 16972 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:32.079113 16972 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:32.080240 17456 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:32.081024 16972 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:20:32.081982 17464 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:32.077477 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:32.083912 17464 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:32.083933 13131 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:32.084393 17464 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:32.085371 17464 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.086870 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:32.087695 13886 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:32.087898 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.081185 17467 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:32.088666 13884 raft_consensus.cc:2368] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9.
I20260709 12:20:32.089049 17464 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:32.084467 16972 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:32.090533 16972 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:32.092442 16972 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:32.099459 17449 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.100003 17449 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.102183 17449 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:32.102445 16972 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:32.106120 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:32.109658 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:32.117901 13277 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:32.123602 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:32.125089 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:32.125890 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:32.124717 17464 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:32.131485 13884 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:20:32.132498 13128 raft_consensus.cc:3055] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:32.132957 13128 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:32.133908 13128 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.134984 13128 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:32.137063 17120 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.137681 17467 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.137620 17120 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.138453 17467 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.137491 17406 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:32.140450 17406 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.141805 17120 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:32.142653 17467 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:32.150568 13129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:32.095296 13131 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:32.151252 13129 raft_consensus.cc:606] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:32.151728 13129 raft_consensus.cc:614] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:32.151940 17406 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:32.152879 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:32.153744 13129 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:32.128049 17464 raft_consensus.cc:697] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:32.154381 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.155356 17464 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.156067 13249 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:32.159945 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:32.161334 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:32.161979 13280 raft_consensus.cc:2393] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:32.162680 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:32.163232 13280 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:32.164101 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:32.164839 13280 raft_consensus.cc:2410] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:20:32.166567 17120 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:32.167060 17120 raft_consensus.cc:697] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:32.167958 17120 consensus_queue.cc:237] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.168277 13840 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:32.172307 13840 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:32.173175 17449 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:32.173885 17449 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:32.174201 17449 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.174523 17449 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:32.385972 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.437866 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.438676 13881 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
W20260709 12:20:32.537019 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.559149 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.577252 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.578869 13131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9377aea669547028ee8449f654c60b7"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:32.579123 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:32.617640 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.632580 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.635155 13881 raft_consensus.cc:2393] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 11: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:20:32.641219 13128 consensus_meta.cc:287] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 12:20:32.642217 13128 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:20:32.642740 13128 pending_rounds.cc:85] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 8
I20260709 12:20:32.643105 13128 pending_rounds.cc:107] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:20:32.643785 13128 raft_consensus.cc:2889] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:32.643973 13133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.001s	sys 0.033s
W20260709 12:20:32.644508 13133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.001s	sys 0.033s
I20260709 12:20:32.648473 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.649588 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:32.650177 13880 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:32.657369 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:32.644343 17456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.021s	sys 0.070s
W20260709 12:20:32.674029 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.517516 17467 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:32.575695 17406 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:32.631800 17294 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:32.645629 17120 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:32.693322 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:32.702967 13884 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:20:32.675598 17456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.021s	sys 0.071s
I20260709 12:20:32.694522 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:32.698652 13840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.026s	sys 0.066s
W20260709 12:20:32.706753 17474 log.cc:927] Time spent T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:20:32.710989 13838 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:32.708527 13840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.026s	sys 0.066s
I20260709 12:20:32.725122 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:32.725325 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 543445us
W20260709 12:20:32.704535 17450 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.026s	sys 0.016s
I20260709 12:20:32.726647 13881 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:32.729631 13880 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
W20260709 12:20:32.729693 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.730311 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.733579 13881 raft_consensus.cc:2393] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:32.735512 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.734649 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:32.731379 17450 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.027s	sys 0.017s
I20260709 12:20:32.697271 17467 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.732494 17464 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.701715 17406 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:32.761597 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 240940us
I20260709 12:20:32.761758 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.731389 16972 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:32.763329 13880 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:32.763417 17486 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.763957 17486 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.766180 17483 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:32.766916 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 59389us
I20260709 12:20:32.766963 13131 raft_consensus.cc:606] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:20:32.768651 13131 raft_consensus.cc:614] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:32.710279 17120 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:32.771405 13130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.031s	sys 0.065s
W20260709 12:20:32.771888 13130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.031s	sys 0.065s
I20260709 12:20:32.723590 17294 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:32.786454 17449 consensus_meta.cc:287] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.004s
I20260709 12:20:32.786755 17294 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:32.788658 17467 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:32.789274 17476 log.cc:927] Time spent T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:20:32.760416 17462 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:32.790693 17475 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:32.790421 17462 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.767002 17464 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.793396 17464 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:32.770078 16972 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.798846 17120 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:32.799955 16972 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:32.786988 17449 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.766700 17483 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:32.801156 16972 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:32.787322 17294 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.820672 13880 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:32.821237 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 137277us
I20260709 12:20:32.806237 17120 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:32.823637 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.819062 16972 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:32.823416 13158 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0420 after lost signal to thread 11919
W20260709 12:20:32.828400 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 58364.8us
I20260709 12:20:32.829427 17488 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:32.829604 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.829931 17488 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.830703 13838 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:32.820745 17462 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:32.834434 17449 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:32.837164 17449 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:32.825037 17120 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.840585 17120 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:32.841053 17120 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:32.841534 17120 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:32.842298 17384 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 1.050s	user 0.013s	sys 0.001s
I20260709 12:20:32.842730 17384 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.846421 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:32.847043 13280 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:32.851256 16972 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:32.852435 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:32.853073 13136 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:32.853485 17120 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:32.820115 17294 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.853526 13136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2078) took 1232 ms. Trace:
I20260709 12:20:32.855343 13136 rpcz_store.cc:276] 0709 12:20:31.620895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.852183 (+1231288us) service_pool.cc:224] Handling call
0709 12:20:32.853465 (+  1282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:32.857491 17488 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:32.857695 17294 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:32.860347 17483 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.862425 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:32.863070 13277 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
W20260709 12:20:32.866616 13283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.169s	user 0.013s	sys 0.037s
W20260709 12:20:32.867009 13283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.013s	sys 0.037s
I20260709 12:20:32.866925 17120 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:32.867527 17120 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.871920 16972 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.872435 16972 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.874645 16972 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:32.875102 16972 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:32.870301 13882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.047s	sys 0.018s
I20260709 12:20:32.877351 13840 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:32.877815 13882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.047s	sys 0.018s
I20260709 12:20:32.867869 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2171) took 1237 ms. Trace:
I20260709 12:20:32.878539 13882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1085) took 1191 ms. Trace:
W20260709 12:20:32.877169 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 44399us
I20260709 12:20:32.870285 17120 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:32.878418 13283 rpcz_store.cc:276] 0709 12:20:31.630247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.636660 (+  6413us) service_pool.cc:224] Handling call
0709 12:20:31.637013 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:31.696087 (+ 59074us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:31.696121 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:31.696746 (+   625us) log.cc:844] Serialized 52 byte log entry
0709 12:20:32.867525 (+1170779us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:32.867570 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.867637 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:32.867682 (+    45us) raft_consensus.cc:1685] finished
0709 12:20:32.867696 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.867815 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58540,"raft.queue_time_us":58696,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":1170321,"threads_started":1,"wal-append.queue_time_us":169512,"wal-append.run_cpu_time_us":2253,"wal-append.run_wall_time_us":1004385}
I20260709 12:20:32.879102 13882 rpcz_store.cc:276] 0709 12:20:31.687492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.687643 (+   151us) service_pool.cc:224] Handling call
0709 12:20:31.688064 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:31.688486 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:31.688517 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:31.689028 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:20:32.878223 (+1189195us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:32.878265 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.878327 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:32.878360 (+    33us) raft_consensus.cc:1685] finished
0709 12:20:32.878371 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.878485 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1158,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":1188770,"threads_started":1,"wal-append.queue_time_us":179709,"wal-append.run_cpu_time_us":1851,"wal-append.run_wall_time_us":1001909}
I20260709 12:20:32.884078 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.884207 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:32.884860 13280 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:32.885708 17120 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:32.885908 17491 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:32.886188 17120 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:32.886145 13840 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:32.886799 17120 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:32.885716 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:32.887763 17491 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:32.888278 17491 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:32.888616 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:32.889078 17491 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.894464 17120 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.897645 17120 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:32.898327 17120 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:32.899967 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:31.771914 13205 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:32.906533 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2941) took 1172 ms. Trace:
I20260709 12:20:32.906883 13205 rpcz_store.cc:276] 0709 12:20:31.733804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.734654 (+   850us) service_pool.cc:224] Handling call
0709 12:20:32.906441 (+1171787us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:32.880566 16972 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.908455 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.909693 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.910770 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:32.914754 13882 raft_consensus.cc:2376] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9. Re-sending same reply.
I20260709 12:20:32.915714 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.919109 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:32.921377 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.922446 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:32.923866 13882 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:32.882244 17488 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:32.925824 17488 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.925477 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.927541 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.928447 17488 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:32.934268 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:32.936553 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.938683 13882 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:32.929678 16972 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:32.931249 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:32.939762 16972 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:32.940456 16972 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:32.940881 16972 raft_consensus.cc:697] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:32.941680 16972 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.944949 17383 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:32.919111 17362 consensus_meta.cc:287] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.133s	user 0.010s	sys 0.017s
I20260709 12:20:32.949843 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 773) took 2763 ms. Trace:
I20260709 12:20:32.950359 13137 rpcz_store.cc:276] 0709 12:20:30.185612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.512221 (+326609us) service_pool.cc:224] Handling call
0709 12:20:30.512497 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.695101 (+182604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.949174 (+2254073us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400411754. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:32.949314 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386591616}
W20260709 12:20:32.953853 17335 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.297s	user 0.015s	sys 0.039s
W20260709 12:20:32.954470 17335 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.298s	user 0.015s	sys 0.039s
I20260709 12:20:32.955331 17362 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.955947 17362 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:32.968647 17119 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.969259 17119 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:32.957223 17120 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:32.972270 17488 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:32.975621 13885 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.198s	user 0.009s	sys 0.001s
W20260709 12:20:32.976095 13885 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.010s	sys 0.001s
I20260709 12:20:32.985219 17119 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:32.994135 17488 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:32.997254 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:32.997912 13281 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:33.003278 13206 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:33.004050 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2946) took 1263 ms. Trace:
I20260709 12:20:33.004448 13206 rpcz_store.cc:276] 0709 12:20:31.740623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.744932 (+  4309us) service_pool.cc:224] Handling call
0709 12:20:33.003964 (+1259032us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:33.006906 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54815.9us
I20260709 12:20:32.999706 17362 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:33.008581 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:33.009027 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:33.009595 13878 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:33.010775 13249 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:33.017956 13281 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:33.020427 13840 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:33.015813 17362 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:33.035666 17362 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.036060 17362 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:33.045815 17287 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.046483 17287 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:33.048823 17287 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:33.054118 17486 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:33.057989 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:33.062525 13103 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:33.125890 17485 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:33.126502 17485 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:33.126909 17485 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:33.074535 17294 raft_consensus.cc:2764] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:20:33.134219 17496 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:20:33.134601 17294 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:33.135195 17294 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:33.141050 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.155849 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.292045 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.355166 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.405172 13100 leader_election.cc:336] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.726s (SENT)
W20260709 12:20:33.474821 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 454918us
I20260709 12:20:33.037698 17335 consensus_queue.cc:1059] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.258s
I20260709 12:20:33.484366 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:33.327613 17287 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.311909 17286 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:33.517431 17286 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:33.478051 17485 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:33.492086 17287 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:33.645277 17286 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:33.633347 17501 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:33.629125 17294 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:33.652609 17501 raft_consensus.cc:697] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:33.668689 17286 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:33.668268 17501 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:33.669566 17286 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:33.672502 17120 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:33.673050 17286 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:33.673298 17120 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:33.485486 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 423094us
I20260709 12:20:33.676035 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:33.484437 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 79333us
I20260709 12:20:33.678831 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:33.679267 13100 leader_election.cc:336] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.808s (SENT)
I20260709 12:20:33.679664 13136 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:33.679967 13100 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:33.681460 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.682236 13137 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 6.
I20260709 12:20:33.683350 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.684173 13130 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:33.685545 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.686565 13133 raft_consensus.cc:2393] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 11: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:33.689635 17383 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:33.690366 17383 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:33.693733 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.695544 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.696492 13130 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:33.697659 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.700587 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.702052 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.703819 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.704572 13137 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:33.707073 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.707844 13137 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:33.709007 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:33.702883 13130 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:33.718130 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.718967 13128 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:33.673768 17286 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:33.721671 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.722405 13128 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:33.485275 13878 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:33.740166 17515 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:33.741569 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 62339.7us
W20260709 12:20:33.742352 13100 leader_election.cc:336] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.511s (SENT)
I20260709 12:20:33.745348 13132 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:33.745653 16972 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:33.707942 17308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.017s	sys 0.034s
I20260709 12:20:33.757933 13249 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:33.766218 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:33.767094 13132 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
W20260709 12:20:33.768663 17362 consensus_meta.cc:287] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.000s
I20260709 12:20:33.733619 17294 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:33.731346 17287 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:33.756518 17308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.017s	sys 0.035s
I20260709 12:20:33.793159 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:33.795565 13249 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:33.796813 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:33.798168 13249 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:33.800110 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.800629 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.801187 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.803620 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 205244us
I20260709 12:20:33.805714 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:33.746413 16972 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:33.739135 17286 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:33.769266 17362 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:33.807358 13102 leader_election.cc:336] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.700s (SENT)
I20260709 12:20:33.855182 13102 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:33.856478 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 49167.1us
I20260709 12:20:33.799490 17335 consensus_queue.cc:1243] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:33.833401 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:33.802073 17287 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:33.799219 17294 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:33.872171 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.859474 17463 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:33.862974 13838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.000s	sys 0.011s
W20260709 12:20:33.901846 13838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.001s	sys 0.012s
I20260709 12:20:33.874162 17516 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.873582 17287 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:34.007622 17485 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:34.010711 17514 raft_consensus.cc:3055] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:34.054077 17287 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:34.038563 17120 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:34.039191 17294 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.055401 17287 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:34.064244 17287 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.064946 17287 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:34.055864 17120 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:34.066073 17120 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:34.066552 17120 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:34.056641 17362 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:34.071802 17362 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:34.072285 17362 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:34.072799 17362 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:34.006405 17516 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:34.099191 17504 log.cc:927] Time spent T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 12:20:34.118602 17286 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:34.044685 17514 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:34.127216 16972 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:34.128533 17514 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:34.144840 17516 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:34.168217 16972 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.168937 16972 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.171386 16972 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:34.172559 16972 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:34.172978 16972 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.173449 16972 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:34.178465 17286 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.164750 17308 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:34.182608 17524 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:34.183145 17308 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:34.182250 17286 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.198227 17528 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:34.220089 17308 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:34.263252 17120 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.348939 17120 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:34.338508 17287 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.277451 17286 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:34.388373 17287 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:34.342723 17362 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.398073 17362 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:34.425119 17308 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:34.499536 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:34.504495 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 760946us
W20260709 12:20:34.507179 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:34.508463 13136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.001s	sys 0.001s
W20260709 12:20:34.510015 13103 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.660s (SENT) [suppressed 18 similar messages]
I20260709 12:20:34.514175 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:34.471500 17528 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:34.565254 13249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.000s	sys 0.005s
W20260709 12:20:34.583094 13136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.002s	sys 0.001s
W20260709 12:20:34.583643 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.584300 17294 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:34.579063 13130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.005s	sys 0.009s
I20260709 12:20:34.584221 13278 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:34.592790 17287 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.593875 17287 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:34.597235 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.603197 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:34.604389 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.604470 13204 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:34.552410 17286 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:34.613566 13249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.000s	sys 0.006s
I20260709 12:20:34.623915 17541 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:34.624071 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 790701us
I20260709 12:20:34.625126 17541 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.625530 13249 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:34.627610 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 464914us
I20260709 12:20:34.628155 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.629103 17120 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:34.628903 17294 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.629650 17120 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.630133 17120 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:34.630846 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 121094us
I20260709 12:20:34.633198 13208 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:20:34.635586 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.635875 13249 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:34.636492 13204 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:34.638003 13279 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:34.638273 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.627050 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.639389 13206 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:34.641374 17525 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:34.640903 17286 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:34.641924 17525 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:34.642460 17525 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:34.645638 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.659152 17545 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.658806 17540 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:34.660415 17545 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:34.660691 17540 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:34.662406 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.667732 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:34.668025 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.668752 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.670174 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:34.672155 17528 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:34.672818 17528 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.672976 17294 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:34.673408 17528 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:34.675879 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.676780 13203 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
W20260709 12:20:34.679279 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:34.656610 13137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.000s	sys 0.012s
I20260709 12:20:34.668919 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:34.683853 13137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.000s	sys 0.013s
I20260709 12:20:34.671084 17286 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:34.685940 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.686199 17294 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.686988 17294 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.693143 17294 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:34.693800 17294 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:34.694548 17294 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:34.695989 13177 connection.cc:256] RPC call timeout handler was delayed by -2.8371977759998117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 12:20:34.696995 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:34.698007 13278 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:34.701061 13285 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:20:34.701906 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 2925) took 2773 ms. Trace:
I20260709 12:20:34.702351 13285 rpcz_store.cc:276] 0709 12:20:31.928953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.699775 (+2770822us) service_pool.cc:224] Handling call
0709 12:20:34.700394 (+   619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:34.701586 (+  1192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.701840 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:34.704816 13282 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2931) took 2753 ms (client timeout 1684 ms). Trace:
W20260709 12:20:34.705461 13282 rpcz_store.cc:269] 0709 12:20:31.951593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.704278 (+2752685us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:34.704500 (+   222us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:34.726733 17455 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:34.727602 17455 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:34.733311 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.733711 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:34.734613 17327 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.059s	user 0.019s	sys 0.062s
I20260709 12:20:34.734520 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:34.735077 17327 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.059s	user 0.020s	sys 0.062s
I20260709 12:20:34.742419 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:34.747221 13203 raft_consensus.cc:2376] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12. Re-sending same reply.
I20260709 12:20:34.751399 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:34.752425 17455 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:34.766007 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.766772 13211 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:34.769081 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:34.769193 17249 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:34.770018 13204 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:34.770591 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:34.772130 16972 consensus_meta.cc:287] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.598s	user 0.013s	sys 0.013s
I20260709 12:20:34.772847 17541 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:34.772693 16972 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.766299 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.780788 17381 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:34.778539 13205 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:34.742059 17543 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.789794 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.790557 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:34.791721 13100 leader_election.cc:336] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.603s (SENT)
I20260709 12:20:34.792446 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:34.792775 17294 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:34.795156 17525 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.769531 17540 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:34.800676 13103 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:34.815553 13211 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:34.817040 13204 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:34.786989 16972 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:34.827399 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1528) took 1120 ms. Trace:
I20260709 12:20:34.827935 13130 rpcz_store.cc:276] 0709 12:20:33.711974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.713684 (+  1710us) service_pool.cc:224] Handling call
0709 12:20:33.713991 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.714215 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:33.881293 (+167078us) log.cc:844] Serialized 14 byte log entry
0709 12:20:34.815221 (+933928us) log.cc:844] Serialized 14 byte log entry
0709 12:20:34.815639 (+   418us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:34.815729 (+    90us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:34.815906 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.822289 (+  6383us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:34.827301 (+  5012us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34154,"prepare.queue_time_us":320680,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":39103,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":3157,"thread_start_us":930926,"threads_started":4,"wal-append.queue_time_us":698628}
I20260709 12:20:34.829934 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:34.831671 17540 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:34.832109 13203 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:34.834174 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1529) took 1121 ms. Trace:
I20260709 12:20:34.835880 17525 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:34.836585 13158 debug-util.cc:398] Leaking SignalData structure 0x7b0800344ca0 after lost signal to thread 13069
I20260709 12:20:34.836686 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:34.837738 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 51061.3us
I20260709 12:20:34.839624 16972 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:34.840062 16972 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:34.840927 16972 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:34.841614 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 49992.2us
I20260709 12:20:34.844956 17548 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:34.845032 17294 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.846110 17548 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.846222 17294 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:34.864521 17294 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:34.866015 13883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 1091) took 2779 ms (client timeout 1603 ms). Trace:
W20260709 12:20:34.866518 13883 rpcz_store.cc:269] 0709 12:20:32.086200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.865624 (+2779424us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:34.865793 (+   169us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:34.866863 17384 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:34.840202 17545 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:34.834632 13137 rpcz_store.cc:276] 0709 12:20:33.712372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.712828 (+   456us) service_pool.cc:224] Handling call
0709 12:20:33.713165 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.713424 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:33.874033 (+160609us) log.cc:844] Serialized 14 byte log entry
0709 12:20:34.823338 (+949305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:34.833682 (+ 10344us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:34.833831 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.833945 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:34.834106 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1922,"prepare.queue_time_us":287516,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":1813,"raft.queue_time_us":63184,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":166,"thread_start_us":1054912,"threads_started":3,"wal-append.queue_time_us":762882}
I20260709 12:20:34.878966 17120 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.856925 17543 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.892174 17342 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:34.893115 17342 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:34.896018 17342 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:34.896672 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 66990.3us
I20260709 12:20:34.899101 13103 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:34.901520 17543 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:34.916559 17545 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:34.919086 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:34.919746 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.920992 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:34.925268 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.926103 17553 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:34.926754 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.926497 17528 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.929236 17528 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:34.929700 17395 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:34.930047 13279 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:34.926813 17553 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:34.932433 17553 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:34.934259 13878 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:34.935611 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.937381 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.941104 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:34.944024 17543 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:34.944238 17120 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:34.944316 17406 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:34.951565 13158 debug-util.cc:398] Leaking SignalData structure 0x7b08003da9a0 after lost signal to thread 13161
I20260709 12:20:34.947291 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.955684 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:34.956463 13878 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:34.956729 17548 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:34.960938 17308 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:34.963994 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:34.965305 13137 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:34.966393 13103 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:34.944610 17543 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:34.969895 13284 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2927) took 3040 ms (client timeout 1700 ms). Trace:
W20260709 12:20:34.970417 13284 rpcz_store.cc:269] 0709 12:20:31.929602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.969525 (+3039923us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:34.969697 (+   172us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:34.975246 17311 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:34.980459 13879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 1089) took 2894 ms (client timeout 2223 ms). Trace:
W20260709 12:20:34.980928 13879 rpcz_store.cc:269] 0709 12:20:32.085618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.980126 (+2894508us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:34.980273 (+   147us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:34.981462 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.981876 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.982784 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.983737 17337 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.984402 17337 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.985985 17548 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:34.986423 17548 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:34.986788 17548 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:34.990028 17527 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:34.990705 17527 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:34.987160 17337 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:34.983160 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.993011 13878 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:34.995819 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.993046 17527 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:34.999336 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.999053 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:34.996158 13103 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:34.976037 17311 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.003962 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:35.004289 13878 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:35.004851 13879 raft_consensus.cc:2393] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:35.004992 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1681) took 5652 ms. Trace:
W20260709 12:20:35.006500 13158 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6960 after lost signal to thread 13236
W20260709 12:20:35.008661 13158 debug-util.cc:398] Leaking SignalData structure 0x7b0800330360 after lost signal to thread 13237
I20260709 12:20:35.006829 17540 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:35.008196 13207 rpcz_store.cc:276] 0709 12:20:29.352907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.678171 (+325264us) service_pool.cc:224] Handling call
0709 12:20:29.829596 (+151425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:29.875805 (+ 46209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.004516 (+5128711us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54002a17d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:35.004719 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314088704}
I20260709 12:20:35.011615 13286 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:35.009636 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:35.014647 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 46980.3us
I20260709 12:20:35.018100 13103 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:35.018883 13103 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:35.019840 17294 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:35.020372 17294 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:35.020879 17294 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.022282 17551 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:35.022347 13103 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:35.022938 17551 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.023375 17551 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:35.016451 17308 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.024349 17308 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.024736 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.025452 13207 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:35.051272 13130 raft_consensus.cc:1240] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:35.057106 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.013417 17527 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:34.970777 17543 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.059628 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:35.060096 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.063639 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.070704 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.071521 13206 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:35.063462 17545 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:35.072741 13207 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:35.070665 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.062042 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.081080 13879 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:35.082260 17544 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:35.082908 17544 raft_consensus.cc:697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:35.083164 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:35.084283 13878 raft_consensus.cc:2368] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9.
I20260709 12:20:35.083995 17544 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.086342 17448 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:35.076669 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.078576 13284 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:35.107750 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.108510 13203 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:35.109301 17311 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.112241 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.111447 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.113967 13207 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 11: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:35.117030 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:35.079983 16972 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.121251 16972 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:35.126778 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.107753 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.129364 13285 raft_consensus.cc:2410] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:35.135118 13279 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:35.073313 17545 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:35.146798 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.144426 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.147189 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 772) took 2499 ms. Trace:
I20260709 12:20:35.146792 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.142266 17545 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.152145 13203 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:35.153297 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.156555 13207 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:35.157569 17520 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:35.158253 17520 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.159600 16972 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.159662 17251 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:35.160385 16972 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.160553 17251 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.162678 16972 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:35.163069 17251 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:35.124574 17448 consensus_queue.cc:1059] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:20:35.170722 13284 raft_consensus.cc:2393] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 8: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:35.167035 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.169613 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.176084 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.176891 13133 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:35.179816 13878 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:35.173627 13279 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:35.184306 17455 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.184930 17455 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.187146 17455 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:35.187803 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.188228 17383 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.188764 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.204046 13281 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:35.189668 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.204757 13205 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:35.205157 13280 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:35.190603 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.205780 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.206084 13283 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:35.193755 13133 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:35.190801 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.181248 13203 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:35.193461 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.193781 17448 raft_consensus.cc:3055] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:35.213877 13285 raft_consensus.cc:2410] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:35.214121 17448 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:35.193730 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.194401 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.195235 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.154366 17308 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.215801 17448 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.145249 17527 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.218647 17527 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.198552 16972 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.198649 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.220160 13129 raft_consensus.cc:2410] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:20:35.219910 16972 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.221098 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.221808 13129 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:35.222151 16972 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:35.200034 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.200733 17119 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:35.201438 13208 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:35.202039 13840 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:35.148888 13881 rpcz_store.cc:276] 0709 12:20:32.645229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.767720 (+122491us) service_pool.cc:224] Handling call
0709 12:20:32.768019 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:32.768852 (+   833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:32.768896 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:34.870514 (+2101618us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b2c00033c98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:20:34.871312 (+   798us) log.cc:844] Serialized 26 byte log entry
0709 12:20:35.008452 (+137140us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:35.058481 (+ 50029us) log.cc:844] Serialized 14 byte log entry
0709 12:20:35.073764 (+ 15283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.103061 (+ 29297us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:35.103121 (+    60us) raft_consensus.cc:1685] finished
0709 12:20:35.130556 (+ 27435us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:35.144186 (+ 13630us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107,"prepare.queue_time_us":108722,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":6459,"raft.queue_time_us":76196,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":200,"spinlock_wait_cycles":4565823744,"thread_start_us":143933,"threads_started":2,"wal-append.queue_time_us":145960}
I20260709 12:20:35.267417 13130 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:35.215234 13277 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:35.222720 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:35.266721 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1084) took 3574 ms. Trace:
I20260709 12:20:35.252941 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.256599 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.306241 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.278868 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2161) took 4471 ms. Trace:
I20260709 12:20:35.309422 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:35.290726 17448 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:35.308902 13286 rpcz_store.cc:276] 0709 12:20:30.807845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.981002 (+173157us) service_pool.cc:224] Handling call
0709 12:20:30.981270 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.017258 (+4035988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.278447 (+261189us) spinlock_profiling.cc:243] Waited 4.03 s on lock 0x7b54002da5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:35.278743 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9267904256}
W20260709 12:20:35.315342 13158 debug-util.cc:398] Leaking SignalData structure 0x7b080026bee0 after lost signal to thread 13310
I20260709 12:20:35.313740 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:35.315840 13158 debug-util.cc:398] Leaking SignalData structure 0x7b08003255e0 after lost signal to thread 13311
I20260709 12:20:35.315405 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.317236 13129 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:35.317389 13283 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:35.280401 17467 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:35.321723 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.312650 17544 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:35.323907 17544 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.324290 17544 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:35.325618 13133 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:35.280079 17449 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:20:35.328063 17449 raft_consensus.cc:3055] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:35.328425 17449 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:35.328871 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:35.329564 13128 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:35.329373 17449 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.330782 17449 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:35.331797 17543 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.331941 17491 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:35.332573 17543 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.340173 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50024 (request call id 33) took 2761 ms. Trace:
I20260709 12:20:35.340672 13131 rpcz_store.cc:276] 0709 12:20:32.578236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.578702 (+   466us) service_pool.cc:224] Handling call
0709 12:20:35.339720 (+2761018us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54000c2bd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e87853 00007f70f9e5560a 00007f70f33db7d4 00007f70f33db762 00007f70f33db691 00007f70f33db60c 00007f70f33da8c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:35.339936 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431015808}
I20260709 12:20:35.342032 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:35.342432 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 777) took 2647 ms. Trace:
I20260709 12:20:35.342782 13131 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:35.321106 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:35.292909 13885 rpcz_store.cc:276] 0709 12:20:31.682326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.682847 (+   521us) service_pool.cc:224] Handling call
0709 12:20:31.683974 (+  1127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:31.693189 (+  9215us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:31.776947 (+ 83758us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b180044a520. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9d455 00007f70f88853c7 00007f70f4e979a7 00007f70f4ea70bf 00007f70f4ea7038
0709 12:20:32.976488 (+1199541us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.034560 (+ 58072us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:35.110262 (+2075702us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b2c00033c98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:20:35.110921 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:20:35.154775 (+ 43854us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:35.155184 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 12:20:35.155956 (+   772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.156074 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:35.207614 (+ 51540us) raft_consensus.cc:1685] finished
0709 12:20:35.207638 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:35.256498 (+ 48860us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79,"prepare.queue_time_us":15276,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":617300,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":4464,"spinlock_wait_cycles":3970794752,"thread_start_us":1297170,"threads_started":4,"wal-append.queue_time_us":81711,"wal-append.run_cpu_time_us":1383,"wal-append.run_wall_time_us":1001388}
I20260709 12:20:35.350950 17294 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.351397 13133 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:35.358635 17294 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.352596 17465 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:35.234069 17455 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:35.361665 17455 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.362861 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:35.362203 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:35.365816 13133 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:35.250226 17548 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.358345 17119 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.351790 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2061) took 5286 ms. Trace:
I20260709 12:20:35.368517 13128 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:35.357157 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:35.354453 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.358366 13129 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:35.356575 13286 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:35.366688 17467 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.372846 13205 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:35.343055 13880 rpcz_store.cc:276] 0709 12:20:32.694995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.766225 (+ 71230us) service_pool.cc:224] Handling call
0709 12:20:32.766541 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.821361 (+ 54820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.341789 (+2520428us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b5400750b54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:35.342172 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123937536}
I20260709 12:20:35.382121 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.353005 13103 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:35.383873 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.355057 17287 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:35.388263 13102 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:35.389200 13284 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 6.
I20260709 12:20:35.390734 13129 raft_consensus.cc:2410] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:20:35.332607 17491 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.391672 17491 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:35.394078 13134 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:35.394707 17454 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.373857 13135 rpcz_store.cc:276] 0709 12:20:30.064989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.290792 (+225803us) service_pool.cc:224] Handling call
0709 12:20:30.291092 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:34.742714 (+4451622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:34.745557 (+  2843us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:34.802799 (+ 57242us) log.cc:844] Serialized 26 byte log entry
0709 12:20:34.871887 (+ 69088us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:35.000873 (+128986us) log.cc:844] Serialized 14 byte log entry
0709 12:20:35.001093 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.282397 (+281304us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54000a8d20. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e02dbe 00007f70f4e0d930 00007f70f4e0d8d8 00007f70f4e0d858 00007f70f4e0d813 00007f70f4e0ca9c 00007f70facf82f6 00007f70facf2aa8 00007f70f4e497cb 00007f70f4e4c2c0
0709 12:20:35.351311 (+ 68914us) spinlock_profiling.cc:243] Waited 4.28 s on lock 0x7b540011c954. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:35.351360 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:35.351398 (+    38us) raft_consensus.cc:1685] finished
0709 12:20:35.351410 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:35.351602 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52207,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":86849,"raft.run_cpu_time_us":543,"raft.run_wall_time_us":4153,"spinlock_wait_cycles":9867933184,"thread_start_us":348747,"threads_started":3,"wal-append.queue_time_us":55289}
I20260709 12:20:35.395287 17454 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.398394 17294 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:35.398583 13204 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:35.398957 17294 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:35.399897 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:35.400266 13208 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:35.399459 17294 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:35.398818 13102 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:35.373800 17455 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:35.402544 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 236268us
I20260709 12:20:35.318341 17551 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.404143 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:35.405272 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 52367.6us
I20260709 12:20:35.409665 13205 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:35.423645 13128 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:35.421911 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:35.350910 17545 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.428256 13205 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:20:35.431175 13286 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:35.434394 17543 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.439922 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:35.429747 13103 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:35.430501 17395 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:35.447101 13137 raft_consensus.cc:1240] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:35.447321 17395 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:35.449831 17395 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:35.451025 17451 raft_consensus.cc:3055] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:35.451289 17467 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.451496 17451 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:35.452494 17451 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.453917 17451 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:35.456400 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.461323 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.462008 13204 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:35.462845 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.466344 17520 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:35.466720 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.469890 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.470564 13205 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:35.428511 17540 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:35.463567 13131 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:35.472905 13204 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
W20260709 12:20:35.474628 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 43696.3us
I20260709 12:20:35.474850 13128 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:35.480186 13133 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
W20260709 12:20:35.482290 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 83597.6us
I20260709 12:20:35.444881 17455 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:35.491526 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.493013 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.493501 13204 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:35.494683 17119 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:35.500476 17543 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.501096 17543 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.501686 13282 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.505892 17357 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:35.439047 17491 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.508355 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.483340 17467 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:35.477347 17540 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:35.509297 13283 raft_consensus.cc:2410] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:20:35.509519 17540 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:35.513628 17220 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:35.514222 17220 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.506763 17357 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.515636 17546 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.516189 17546 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.517254 17551 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:35.517382 17384 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.517926 17384 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.518347 13206 raft_consensus.cc:3055] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:35.518687 13206 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:35.519079 17337 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.519625 17337 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:35.513659 13177 connection.cc:256] RPC call timeout handler was delayed by -2.3996083739998539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 12:20:35.521919 13177 connection.cc:256] RPC call timeout handler was delayed by -2.3061977759998626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 12:20:35.522341 13177 connection.cc:256] RPC call timeout handler was delayed by -1.8809845220000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 12:20:35.522652 13177 connection.cc:256] RPC call timeout handler was delayed by -1.8191858190000403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
W20260709 12:20:35.523027 13177 connection.cc:256] RPC call timeout handler was delayed by -1.8110587889998442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260709 12:20:35.509907 17491 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:35.523386 13177 connection.cc:256] RPC call timeout handler was delayed by -1.5294977759999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30820000000000003s for a response
W20260709 12:20:35.523720 13177 connection.cc:256] RPC call timeout handler was delayed by -1.4571771979999539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 12:20:35.524094 13177 connection.cc:256] RPC call timeout handler was delayed by -1.3070686879998448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2534s for a response
I20260709 12:20:35.525051 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:35.527582 13102 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:35.529433 17486 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:35.529942 17486 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.530181 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:35.530548 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:35.532085 17548 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:35.530366 17486 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:35.533209 17523 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:35.519577 13206 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.521543 17545 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.534591 13206 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.535763 17543 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:35.490150 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:35.541668 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 51620.6us
I20260709 12:20:35.542675 17119 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:35.543197 17119 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.543599 17119 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.492538 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.547495 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.547876 17454 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.548317 13207 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:35.549547 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.550748 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.550848 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:35.552004 13102 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:35.552181 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:35.553390 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.553762 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:35.554533 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 127545us
I20260709 12:20:35.554768 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.555349 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:35.555758 13885 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:35.556309 17337 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:35.555948 13158 debug-util.cc:398] Leaking SignalData structure 0x7b08001994a0 after lost signal to thread 13911
W20260709 12:20:35.556936 13158 debug-util.cc:398] Leaking SignalData structure 0x7b0800412840 after lost signal to thread 13912
I20260709 12:20:35.557612 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:35.557832 13158 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6a80 after lost signal to thread 17300
I20260709 12:20:35.558847 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:35.559178 13158 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9080 after lost signal to thread 17405
I20260709 12:20:35.560490 17523 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:35.562872 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.563493 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:35.564095 13285 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:35.559077 17544 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.571628 17544 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:35.571859 17514 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:35.573868 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 49100.8us
I20260709 12:20:35.574780 13203 raft_consensus.cc:2410] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:20:35.575632 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:35.578572 17385 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:35.580097 13134 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1505) took 3683 ms (client timeout 2037 ms). Trace:
W20260709 12:20:35.580627 13134 rpcz_store.cc:269] 0709 12:20:31.896314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.951243 (+ 54929us) service_pool.cc:224] Handling call
0709 12:20:35.579806 (+3628563us) spinlock_profiling.cc:243] Waited 3.36 s on lock 0x7b540027d654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:35.579950 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7721778944}
I20260709 12:20:35.581040 13249 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:35.584977 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.571944 17220 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:35.586442 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.588490 17357 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.591305 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2945) took 3851 ms. Trace:
I20260709 12:20:35.591697 17287 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:35.593236 17371 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:35.594615 17551 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:35.574167 17395 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.616948 13205 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:35.601588 13204 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:35.608261 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:35.618018 13282 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:20:35.584786 13177 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:35.619510 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 64240.5us
I20260709 12:20:35.620280 13103 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:35.621443 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:35.622613 13285 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:35.624611 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.618383 13282 pending_rounds.cc:85] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 4
I20260709 12:20:35.625203 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.629560 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.630481 13206 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:35.631060 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.625319 13282 pending_rounds.cc:107] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:20:35.634320 13282 raft_consensus.cc:2889] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:35.635327 13204 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.617591 17544 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:35.616545 17551 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.642000 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:35.468024 17294 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.597023 13209 rpcz_store.cc:276] 0709 12:20:31.740132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.740377 (+   245us) service_pool.cc:224] Handling call
0709 12:20:31.740868 (+   491us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:20:32.002973 (+262105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:32.003005 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:20:32.004898 (+  1893us) log.cc:844] Serialized 78 byte log entry
0709 12:20:32.028228 (+ 23330us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:32.035858 (+  7630us) log.cc:844] Serialized 14 byte log entry
0709 12:20:35.305002 (+3269144us) log.cc:844] Serialized 14 byte log entry
0709 12:20:35.590686 (+285684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.590885 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:35.590948 (+    63us) raft_consensus.cc:1685] finished
0709 12:20:35.590960 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:35.591093 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3120812,"prepare.queue_time_us":297644,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":4350,"raft.queue_time_us":6694946,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":336,"thread_start_us":319472,"threads_started":4,"wal-append.queue_time_us":150656,"wal-append.run_cpu_time_us":2650,"wal-append.run_wall_time_us":1002927}
I20260709 12:20:35.640614 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.638460 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:35.640641 13205 raft_consensus.cc:2410] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:20:35.626495 17098 raft_consensus.cc:2764] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:20:35.628777 17454 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:35.627481 17543 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:35.649689 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.630769 17220 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:35.627221 17287 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:35.639354 17455 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:35.655587 17542 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 12:20:35.658785 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 62048.1us
I20260709 12:20:35.645550 17551 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.639851 17308 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.627151 17548 consensus_queue.cc:1059] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:20:35.663187 13204 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:35.639678 17544 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:35.682369 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.664546 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.661995 17465 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:35.666114 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 81512.9us
I20260709 12:20:35.669762 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.633666 17383 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.626989 17545 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:20:35.653371 13205 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:35.675439 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.676834 17395 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.678858 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.680014 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:35.698660 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.685174 17544 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:35.684351 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.656919 17543 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.685397 13102 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:35.685408 13249 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:35.687783 13206 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 11: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:35.693892 13128 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:35.693847 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.705437 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.694674 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.695000 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:35.695171 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:35.706761 13132 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:35.707578 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.709558 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:35.695554 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.695974 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.656391 17527 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:35.699581 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:35.722434 13137 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:35.724997 17294 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.725679 17294 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:20:35.726130 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 52055.3us
I20260709 12:20:35.726747 17371 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:35.726866 13249 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:35.731873 17384 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:35.733342 13840 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:35.735960 16972 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:35.736865 16972 raft_consensus.cc:697] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:35.738231 16972 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.708168 13209 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:35.701035 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.687979 17465 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:35.681099 17454 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:35.713238 17523 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:35.714010 17542 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:35.707700 17543 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:35.715119 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 227839us
I20260709 12:20:35.719945 17451 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:35.756556 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.757216 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.758004 13204 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:35.757280 13207 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:35.740756 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.741595 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:35.759141 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 66475.2us
I20260709 12:20:35.753705 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.741592 13203 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:35.742580 17465 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:35.704262 17540 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.787945 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.789772 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.790117 17540 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.710211 17287 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:35.791741 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.794168 13208 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:35.794600 17119 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.795197 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.796008 13208 raft_consensus.cc:2368] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9.
I20260709 12:20:35.797013 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.797099 17119 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:35.760450 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:35.799147 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:35.700254 17383 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.805099 17383 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.811743 17523 consensus_queue.cc:1243] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:20:35.812546 17523 raft_consensus.cc:3055] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:35.812960 17523 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:35.814178 17523 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.815680 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.816536 13133 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:35.819399 17546 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.820138 17454 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.821180 13841 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:35.822470 17500 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:35.822877 17454 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:35.824954 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:35.758036 13282 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:35.832683 13285 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:35.761201 13206 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.752559 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.761773 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:35.739773 17371 raft_consensus.cc:697] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:35.704396 17308 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.770785 13883 raft_consensus.cc:2410] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:20:35.735971 17333 raft_consensus.cc:2804] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:35.771908 13035 catalog_manager.cc:5697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.775161 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:35.777566 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:35.846683 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.797502 13208 raft_consensus.cc:2376] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9. Re-sending same reply.
W20260709 12:20:35.846999 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 75629.6us
I20260709 12:20:35.847890 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.847496 13880 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:35.841007 13132 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:20:35.847018 13885 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:35.858117 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:35.739375 17486 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.863190 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.865269 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:35.867339 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.865818 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.832420 17384 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:35.874773 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:35.866230 13211 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:35.873193 13205 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:35.866390 13204 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:20:35.901822 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.850196 17523 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:35.850206 17491 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.867663 13882 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:35.858117 17333 raft_consensus.cc:697] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:35.908353 13131 raft_consensus.cc:2393] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:35.908797 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.909562 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.920210 13204 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:35.920908 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.925618 17333 consensus_queue.cc:237] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.926378 13177 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:35.926712 17560 consensus_queue.cc:1059] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:35.927561 17285 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:35.927937 17560 raft_consensus.cc:2764] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:20:35.928119 17285 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.929349 17560 raft_consensus.cc:3055] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:35.929735 17560 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:35.929904 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.930538 13203 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.931022 17560 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.932195 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.932448 17560 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:35.933180 17454 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:35.933386 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.933768 17454 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.934258 17308 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.934628 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.935456 13211 raft_consensus.cc:2410] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:20:35.935585 17375 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:35.936282 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.936522 17454 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.938246 17371 consensus_queue.cc:237] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.937340 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:35.940290 17384 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:35.940677 13211 raft_consensus.cc:2376] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9. Re-sending same reply.
I20260709 12:20:35.941540 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:35.941246 17384 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.942938 13208 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:35.943266 17486 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.944536 13208 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:35.945441 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:35.945876 17561 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:35.946359 17220 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:35.946820 17220 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:35.947229 17220 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:35.948113 17561 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:35.948705 17204 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:20:35.875502 17500 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:20:35.906178 17543 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.955701 17220 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.956379 17532 consensus_queue.cc:1059] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.207s
I20260709 12:20:35.956966 17543 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.957614 17532 raft_consensus.cc:3055] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:35.958001 17220 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:35.914888 17491 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:35.958624 13178 connection.cc:256] RPC call timeout handler was delayed by -1.2541202200000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:20:35.963775 13035 catalog_manager.cc:5697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.966131 13035 catalog_manager.cc:5697] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 4 to 6, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 6 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.970501 17491 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:35.958067 17532 raft_consensus.cc:740] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:35.972712 17532 consensus_queue.cc:260] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:35.973920 17532 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:35.977119 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.979938 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 836) took 3540 ms. Trace:
I20260709 12:20:35.874657 17551 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:35.982383 17551 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:35.980510 13884 rpcz_store.cc:276] 0709 12:20:32.438951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.743927 (+304976us) service_pool.cc:224] Handling call
0709 12:20:32.767356 (+ 23429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:32.769551 (+  2195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:32.769599 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:35.442182 (+2672583us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b2c00033c98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:20:35.443043 (+   861us) log.cc:844] Serialized 52 byte log entry
0709 12:20:35.623547 (+180504us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:35.646861 (+ 23314us) log.cc:844] Serialized 14 byte log entry
0709 12:20:35.658694 (+ 11833us) log.cc:844] Serialized 14 byte log entry
0709 12:20:35.665397 (+  6703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.671989 (+  6592us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:35.716396 (+ 44407us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18004190e0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:35.721078 (+  4682us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b18004190e0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:35.979511 (+258433us) raft_consensus.cc:1685] finished
0709 12:20:35.979542 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:35.979749 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33257,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":4788,"raft.queue_time_us":78724,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":6685,"spinlock_wait_cycles":4619833856,"thread_start_us":166871,"threads_started":1,"wal-append.queue_time_us":468228}
W20260709 12:20:35.980517 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 56785.9us
I20260709 12:20:35.997852 13137 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:36.011186 13205 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:36.007885 13203 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:36.013849 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:36.013398 13035 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:36.012774 13207 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:36.020751 13204 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:36.028640 13206 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:36.040141 13208 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:36.039072 13205 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 13. Ops: []
I20260709 12:20:36.039532 13283 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
W20260709 12:20:36.042899 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 43773us
W20260709 12:20:36.045964 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.050948 13204 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:36.037986 17455 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:36.067660 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 355158us
I20260709 12:20:36.076777 13203 raft_consensus.cc:1240] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:36.086289 13100 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:36.088479 13211 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:36.092129 13129 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:36.076858 13204 raft_consensus.cc:1240] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:36.076821 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 350011us
I20260709 12:20:36.097411 13284 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:36.097652 13211 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:36.094031 13249 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:36.100117 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 84959.6us
I20260709 12:20:36.110112 13203 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:20:36.110773 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.115976 13840 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:36.087791 17220 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:20:36.129133 17327 raft_consensus.cc:3055] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:36.129627 17327 raft_consensus.cc:740] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:36.122980 13841 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:36.115118 13103 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:36.088111 17560 consensus_queue.cc:1059] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:20:36.135284 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:36.139039 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:36.139595 17546 raft_consensus.cc:2764] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:20:36.142249 13103 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:36.140375 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 829) took 4009 ms. Trace:
I20260709 12:20:36.151162 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:36.161612 13103 leader_election.cc:400] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9.
I20260709 12:20:36.161968 13103 leader_election.cc:403] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:20:36.134850 17548 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:36.103080 17465 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.163902 13103 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:36.145453 16972 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:36.142902 13886 rpcz_store.cc:276] 0709 12:20:32.131036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.135511 (+  4475us) service_pool.cc:224] Handling call
0709 12:20:32.135831 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:32.136200 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:32.136225 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:35.513657 (+3377432us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b2c00033c98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:20:35.514333 (+   676us) log.cc:844] Serialized 52 byte log entry
0709 12:20:35.865384 (+351051us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:35.865421 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.905323 (+ 39902us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.139937 (+234614us) raft_consensus.cc:1685] finished
0709 12:20:36.139957 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.140193 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3627,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"spinlock_wait_cycles":6023574784,"thread_start_us":349806,"threads_started":1,"wal-append.queue_time_us":535343}
W20260709 12:20:36.163039 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 83897.8us
I20260709 12:20:36.136132 17514 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:36.147919 17586 raft_consensus.cc:2764] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:20:36.151803 17545 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:36.160009 17500 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:20:36.173527 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 67195.1us
I20260709 12:20:36.179558 17356 raft_consensus.cc:2764] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:20:36.181089 13177 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:36.158455 17375 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:36.177911 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 77051.6us
I20260709 12:20:36.183035 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:36.172487 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:36.184334 13103 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:36.185545 13103 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:36.161024 17491 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:20:36.187579 13128 raft_consensus.cc:2393] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 7: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:36.177070 13249 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:36.166363 17541 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:36.172967 17584 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:36.200124 17590 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:20:36.225317 17584 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:36.225775 17584 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:36.205118 17357 raft_consensus.cc:3055] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:36.226507 17357 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:36.226781 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2956) took 1600 ms. Trace:
W20260709 12:20:36.227758 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.188504 17308 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:36.227201 13210 rpcz_store.cc:276] 0709 12:20:34.626231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.634962 (+  8731us) service_pool.cc:224] Handling call
0709 12:20:34.637384 (+  2422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:35.511739 (+874355us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:35.512062 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 12:20:35.896973 (+384911us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:35.943929 (+ 46956us) log.cc:844] Serialized 26 byte log entry
0709 12:20:35.944081 (+   152us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:35.944117 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.944186 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.226478 (+282292us) raft_consensus.cc:1685] finished
0709 12:20:36.226496 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.226602 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":894967,"prepare.queue_time_us":787,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":44,"raft.queue_time_us":896859,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":5193,"thread_start_us":363186,"threads_started":1,"wal-append.queue_time_us":712414}
I20260709 12:20:36.199918 17356 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:36.229633 17356 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:36.230010 17356 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:36.234241 17584 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.206775 13100 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:36.190529 13031 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42070 (request call id 326) took 28427 ms (client timeout 15000 ms). Trace:
I20260709 12:20:36.202737 17285 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:36.199414 17327 consensus_queue.cc:260] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.237578 17327 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:36.195796 17588 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:36.239892 17588 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:36.227414 17357 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.241367 17357 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:36.208868 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.209774 17523 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:36.213006 17560 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.214195 17220 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:36.214998 17465 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:36.215924 17491 raft_consensus.cc:3055] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:36.171068 17514 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:36.219049 17577 log.cc:927] Time spent T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:20:36.196429 17455 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:36.259766 17514 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:36.260118 17455 raft_consensus.cc:697] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:36.260385 17287 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:36.261025 17287 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:36.261142 17455 consensus_queue.cc:237] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.196593 17467 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:36.262315 17467 raft_consensus.cc:697] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:36.261969 17287 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.263456 17491 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:36.263221 17467 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.263893 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 2955) took 1638 ms. Trace:
I20260709 12:20:36.264361 17491 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.264302 13212 rpcz_store.cc:276] 0709 12:20:34.625722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.626969 (+  1247us) service_pool.cc:224] Handling call
0709 12:20:34.627673 (+   704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:35.510476 (+882803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:35.510511 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:35.511063 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:20:35.874959 (+363896us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:35.874999 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.875063 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.218742 (+343679us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b2400152588. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1c269c4 00007f70f1c24acb 00007f70f1ddfdc9 00007f70f1ddfa55 00007f70f1ddf09d 00007f70f4a1110e 00007f70f4a2888c 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221
0709 12:20:36.263494 (+ 44752us) raft_consensus.cc:1685] finished
0709 12:20:36.263516 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.263733 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":890360,"raft.queue_time_us":884804,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":132,"spinlock_wait_cycles":36696960,"thread_start_us":353905,"threads_started":1,"wal-append.queue_time_us":591323}
I20260709 12:20:36.265668 17491 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:36.204469 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.267916 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:36.268802 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 92502.7us
I20260709 12:20:36.166507 17548 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.224440 17561 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.272042 17385 consensus_queue.cc:1059] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:36.176652 17545 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:36.228879 17308 raft_consensus.cc:697] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:36.188903 17544 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.240924 17588 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.197808 13103 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:36.195932 13035 catalog_manager.cc:5697] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 1 to 3, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 3 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:36.210603 13841 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:36.248988 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:36.288969 13129 raft_consensus.cc:2393] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:36.249672 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:36.250149 17587 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:36.250366 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:36.250754 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 44053.3us
I20260709 12:20:36.292726 13100 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:36.292869 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:36.215042 16972 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:36.235709 13031 rpcz_store.cc:269] 0709 12:20:07.762829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.800402 (+ 37573us) service_pool.cc:224] Handling call
0709 12:20:08.571986 (+771584us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b54003633d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df7090 00007f70f4e95f3a 00007f70fac4be9c 00007f70fad4a04e 00007f70f920b2a4 00007f70f920b232 00007f70f920b161 00007f70f920b0dc 00007f70f920a392 00007f70f31c848c 00007f70f31c78c6
0709 12:20:36.190266 (+27618280us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:27.250722 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:27.331688 (+ 80966us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:27.331748 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:20:27.331767 (+    19us) tablet.cc:662] Decoding operations
0709 12:20:27.560810 (+229043us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:27.589933 (+ 29123us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:27.592673 (+  2740us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:20:27.683003 (+ 90330us) tablet.cc:701] Row locks acquired
0709 12:20:27.683073 (+    70us) write_op.cc:260] PREPARE: finished
0709 12:20:27.683317 (+   244us) write_op.cc:270] Start()
0709 12:20:27.713346 (+ 30029us) write_op.cc:276] Timestamp: P: 1783599627683230 usec, L: 0
0709 12:20:27.719438 (+  6092us) op_driver.cc:348] REPLICATION: starting
0709 12:20:28.056041 (+336603us) log.cc:844] Serialized 8935 byte log entry
0709 12:20:28.397138 (+341097us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f1d830ac 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b
0709 12:20:30.308027 (+1910889us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:30.672724 (+364697us) op_driver.cc:464] REPLICATION: finished
0709 12:20:30.820550 (+147826us) write_op.cc:301] APPLY: starting
0709 12:20:30.820651 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:30.822134 (+  1483us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:30.822173 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:31.324935 (+502762us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:31.419210 (+ 94275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=44
0709 12:20:31.429057 (+  9847us) write_op.cc:312] APPLY: finished
0709 12:20:31.429817 (+   760us) log.cc:844] Serialized 284 byte log entry
0709 12:20:31.430047 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:31.430344 (+   297us) write_op.cc:454] Released schema lock
0709 12:20:31.430454 (+   110us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:31.431030 (+   576us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:31.431072 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2229719,"reported_tablets":46,"spinlock_wait_cycles":41958656,"child_traces":[["op",{"apply.queue_time_us":147498,"apply.run_cpu_time_us":28345,"apply.run_wall_time_us":610400,"cfile_cache_hit":42,"cfile_cache_hit_bytes":43953,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":1,"lbm_read_time_us":908,"lbm_reads_lt_1ms":8,"num_ops":22,"prepare.queue_time_us":650692,"prepare.run_cpu_time_us":27118,"prepare.run_wall_time_us":1249856,"raft.queue_time_us":64676,"raft.run_cpu_time_us":39500,"raft.run_wall_time_us":130663,"replication_time_us":2953112,"spinlock_wait_cycles":45570176,"thread_start_us":965123,"threads_started":4,"wal-append.queue_time_us":1031951,"wal-append.run_cpu_time_us":60721,"wal-append.run_wall_time_us":3923246}]]}
I20260709 12:20:36.256307 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:36.271023 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 48173.3us
W20260709 12:20:36.273209 13175 connection.cc:256] RPC call timeout handler was delayed by -3.6002164119997815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 12:20:36.276044 17545 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:36.269500 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:36.273010 17561 raft_consensus.cc:3055] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:36.289644 13137 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:20:36.289649 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 92288.1us
I20260709 12:20:36.249600 13128 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:36.293998 13175 connection.cc:256] RPC call timeout handler was delayed by -3.3477422139999362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 12:20:36.299628 13175 connection.cc:256] RPC call timeout handler was delayed by -3.1108094779999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 12:20:36.299954 13175 connection.cc:256] RPC call timeout handler was delayed by -3.0330584739999722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
W20260709 12:20:36.300256 13175 connection.cc:256] RPC call timeout handler was delayed by -1.4064663489998566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.48910000000000003s for a response
I20260709 12:20:36.275653 17548 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:36.302506 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:36.311988 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:36.318833 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:36.319693 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:36.295672 17465 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:36.321822 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:36.322687 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:36.326683 13128 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:36.328004 17534 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:36.328342 17584 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:36.328056 17383 consensus_queue.cc:1059] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:20:36.337854 17356 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.339751 13884 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:36.340173 16972 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.298825 17561 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:36.314360 17119 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:36.316612 17583 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:36.365252 13212 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:20:36.358172 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:36.360114 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:36.360445 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:36.306057 17337 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:20:36.366532 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:36.368822 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:36.378319 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 54375.1us
W20260709 12:20:36.360834 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 121396us
I20260709 12:20:36.376078 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:36.369129 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:36.372066 13210 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:36.376564 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:36.368535 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:36.382304 13208 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:36.382491 13131 raft_consensus.cc:2410] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:20:36.382596 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:36.381561 13207 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:36.377156 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:36.368227 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:36.377210 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:36.378309 13883 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:36.349695 13881 raft_consensus.cc:2410] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:20:36.386418 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:36.368356 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:36.387612 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 177087us
I20260709 12:20:36.387663 13885 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:36.391125 13211 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:36.392686 13203 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:36.395079 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:36.351212 17465 raft_consensus.cc:697] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:36.399633 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:36.401202 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:36.366729 17385 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:36.375815 17544 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:36.371342 17356 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:36.418912 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:36.421245 13128 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:36.421566 13103 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:36.421736 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:36.422051 13133 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:36.422314 13131 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:36.423714 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:36.425379 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:36.425527 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 45048.6us
I20260709 12:20:36.426524 13100 leader_election.cc:400] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9.
I20260709 12:20:36.424546 13883 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:36.435065 13100 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:36.418097 13207 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:36.407027 17337 consensus_queue.cc:1243] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:36.451558 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:36.467319 13277 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:36.427866 17534 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:36.438536 17586 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:36.420616 17583 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:20:36.474876 13284 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:20:36.481208 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 46250.9us
I20260709 12:20:36.491901 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:36.492587 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 104020us
I20260709 12:20:36.398052 17308 consensus_queue.cc:237] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.494151 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:36.494410 13131 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:36.466418 17587 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:36.497188 13130 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:36.498142 13841 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:36.495970 13133 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:36.495412 13135 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:20:36.498477 13278 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:20:36.500893 13100 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:36.422281 17561 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.505553 13128 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:36.478771 17287 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:36.503082 13279 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:36.472316 17544 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:36.502725 13283 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:36.498211 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:36.510370 13136 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:36.481648 17586 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:36.489684 17534 raft_consensus.cc:697] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:36.520356 17587 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:36.522063 13100 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:36.526938 17523 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:36.532060 13278 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:20:36.521572 17532 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:20:36.517524 17586 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:36.525571 17546 consensus_queue.cc:1059] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:20:36.536316 17546 raft_consensus.cc:3055] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:36.536674 17546 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:36.537554 17546 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.538733 17546 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:36.539407 17294 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:36.522537 17327 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:36.540371 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 47124.6us
I20260709 12:20:36.543723 17500 consensus_queue.cc:1059] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:36.545882 17333 raft_consensus.cc:3055] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:36.546285 17333 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:36.547164 17333 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.548486 17333 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:36.556003 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 237224us
I20260709 12:20:36.527128 17561 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:36.525007 17465 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.564500 17532 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.565047 17514 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.539847 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:36.565075 17532 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.511479 17287 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:36.581848 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:36.568792 17287 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:36.587720 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:36.551296 17545 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.590867 13283 raft_consensus.cc:1217] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 9.10->[11.11-11.11]   Dedup: 11.11->[]
I20260709 12:20:36.597739 13283 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:20:36.660147 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.668414 13128 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:36.686896 13132 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:36.688369 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 96405.2us
I20260709 12:20:36.691167 13133 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:36.670444 17555 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.732149 13128 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:20:36.741240 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 189199us
W20260709 12:20:36.745100 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.748994 17119 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:36.750497 17119 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.754984 13886 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:36.781543 13133 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:36.772260 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 185013us
I20260709 12:20:36.795557 13175 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:36.688400 17534 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.698038 17555 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.814116 13137 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:36.814760 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 125369us
I20260709 12:20:36.712623 17548 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:36.817510 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.824451 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 76406.7us
I20260709 12:20:36.819420 17609 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:36.838969 13133 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:36.785151 17532 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:36.857354 13136 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:20:36.865424 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.866355 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 71022.2us
I20260709 12:20:36.877604 13133 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:36.877228 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 557543us
I20260709 12:20:36.879865 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:36.880805 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:36.881611 13206 raft_consensus.cc:2393] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:36.882112 13205 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:36.882479 13205 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:36.883445 13205 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.883857 17603 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:36.883972 16893 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:20:36.884513 13205 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:36.885404 17603 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:36.886771 17603 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:36.849741 17204 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:20:36.897729 13205 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:20:36.901361 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:36.916971 13205 pending_rounds.cc:85] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 10
I20260709 12:20:36.917536 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:36.917528 13205 pending_rounds.cc:107] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:20:36.903926 13131 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:36.904994 13838 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:36.905318 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:36.908380 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:36.908605 17548 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:36.909015 17545 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:36.879927 17514 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:36.912734 13281 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:36.914108 17287 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:36.861230 17532 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:20:36.918516 13205 raft_consensus.cc:2889] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:36.919158 13133 raft_consensus.cc:2393] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:36.902969 17555 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:36.917502 13128 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
W20260709 12:20:36.926095 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.928639 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:36.943308 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:36.924530 17541 consensus_meta.cc:287] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.678s	user 0.006s	sys 0.005s
I20260709 12:20:36.929332 17371 raft_consensus.cc:3055] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:36.948493 17371 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:36.933525 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:36.949613 13207 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:36.934257 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:36.934703 17544 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:20:36.938405 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 59963.7us
I20260709 12:20:36.894483 17586 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:36.925683 17585 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:36.959000 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:36.939177 17583 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:20:36.939581 17606 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:20:36.951254 17514 raft_consensus.cc:3055] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:36.953037 17541 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9.
I20260709 12:20:36.958698 17204 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:37.000819 13133 raft_consensus.cc:3055] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:37.002398 13133 raft_consensus.cc:740] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:37.002430 13252 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:36.960657 17618 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:36.960599 17548 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:36.963672 17585 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:37.006237 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:37.006927 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 48029.2us
W20260709 12:20:36.980464 17385 consensus_meta.cc:287] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.006s
I20260709 12:20:37.001832 17514 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:37.000924 17534 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 12:20:37.016655 17624 log.cc:927] Time spent T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:36.966019 17623 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:20:36.981259 17555 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:20:37.030076 17384 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.028442 17585 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:37.034655 17385 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:37.003438 16893 consensus_queue.cc:1059] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 12:20:37.061789 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 82346.9us
I20260709 12:20:37.034862 17603 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:37.054303 17617 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.097s	user 0.002s	sys 0.000s
I20260709 12:20:37.063408 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:37.065524 13207 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:37.030612 17548 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:36.966188 17621 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:20:37.053121 17204 consensus_queue.cc:1059] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:20:37.060802 13133 consensus_queue.cc:260] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:37.075608 17607 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:37.071419 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:37.080976 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:37.081363 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:37.074126 17287 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:37.108176 13133 raft_consensus.cc:3060] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:37.106966 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:37.109376 13283 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.110926 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:37.113030 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:37.107450 13252 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:37.066911 17623 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:20:37.081293 17555 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.085318 17383 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:37.132699 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:37.148343 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:37.124017 17606 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:37.229206 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:37.230177 13207 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.216706 13883 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:37.220104 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:37.214427 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:37.132561 17287 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 12:20:37.236292 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:37.237880 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:37.112725 17616 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:37.130471 17383 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.240265 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:37.237231 13103 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:37.245905 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:37.249586 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:37.250464 17629 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:20:37.255528 17220 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:37.256162 17220 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.256579 17220 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:37.206379 17544 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:37.259987 17544 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:20:37.262816 17544 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:37.220885 17523 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:37.219911 17619 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:37.244415 17609 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:37.244020 17383 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.248173 17384 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:20:37.108249 17514 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:37.285856 13134 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:37.280330 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:37.272714 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:37.282470 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:37.289368 13883 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:37.293221 13207 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
W20260709 12:20:37.286972 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.295995 13283 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:37.211452 16893 raft_consensus.cc:3055] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:37.298580 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:37.299316 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:37.299978 13882 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:37.301184 13209 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 2991) took 1642 ms (client timeout 2140 ms). Trace:
W20260709 12:20:37.297788 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 85835.8us
W20260709 12:20:37.301635 13209 rpcz_store.cc:269] 0709 12:20:35.654832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.789457 (+134625us) service_pool.cc:224] Handling call
0709 12:20:37.287799 (+1498342us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54002d5d54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:37.296856 (+  9057us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495145856}
I20260709 12:20:37.130270 17555 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:37.308386 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:37.267560 17285 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:37.263407 17546 consensus_meta.cc:287] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.724s	user 0.001s	sys 0.009s
I20260709 12:20:37.275586 17619 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.309706 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:37.281792 17620 raft_consensus.cc:3055] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:37.297053 16893 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:37.329511 13102 leader_election.cc:336] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.568s (SENT)
I20260709 12:20:37.308601 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:37.281939 17606 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:37.354678 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:37.309830 17465 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:37.377089 13884 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.268029 17523 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:37.371526 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:37.134599 17548 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:37.381433 13277 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:37.357486 13285 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:37.386626 13882 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:37.377708 13133 raft_consensus.cc:1275] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:20:37.378059 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:37.387329 13133 pending_rounds.cc:85] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 11
I20260709 12:20:37.387598 13280 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:37.361423 17620 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:37.388140 13133 pending_rounds.cc:107] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:20:37.398924 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:37.397377 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:37.356767 17630 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:20:37.358708 17357 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:20:37.402946 13133 raft_consensus.cc:2889] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:37.404225 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 74747.4us
I20260709 12:20:37.423517 13102 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:37.404772 13887 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:20:37.361508 17619 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:37.408197 17606 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:37.415124 13137 raft_consensus.cc:1240] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:37.393779 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.430894 13285 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
W20260709 12:20:37.434185 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.439163 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:37.398793 17465 raft_consensus.cc:697] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:37.396992 17545 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:37.440129 13285 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.376554 17546 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:20:37.448410 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:37.448992 13882 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:37.388535 17384 consensus_queue.cc:1059] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:20:37.438184 17285 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.438441 17541 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:37.461053 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.466913 13204 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:37.476929 13100 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:37.477953 13882 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:20:37.479693 13100 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:37.480216 17548 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.482468 17642 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:37.484643 13206 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:37.486502 13280 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:37.456238 17546 consensus_queue.cc:1243] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:37.486903 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:37.495712 13280 raft_consensus.cc:1240] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:20:37.505470 13285 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
W20260709 12:20:37.528543 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 93788.6us
I20260709 12:20:37.479581 17384 consensus_queue.cc:1243] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:37.539314 13285 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:20:37.534265 13840 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:20:37.534206 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 307685us
I20260709 12:20:37.542148 13285 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:37.467650 17285 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:37.546587 13103 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:37.475672 17630 consensus_queue.cc:1059] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:20:37.529086 17642 raft_consensus.cc:697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:37.588006 17467 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:37.588665 17467 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:37.589823 17467 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:37.592043 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1563) took 1190 ms. Trace:
I20260709 12:20:37.592581 13132 rpcz_store.cc:276] 0709 12:20:36.401269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.401411 (+   142us) service_pool.cc:224] Handling call
0709 12:20:36.401698 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:36.687505 (+285807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.591669 (+904164us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400137ed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:37.591957 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655328128}
I20260709 12:20:37.596153 13279 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:37.599905 17586 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:37.607146 17385 raft_consensus.cc:3055] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:20:37.612368 17637 log.cc:927] Time spent T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:20:37.612884 17285 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:37.613718 17523 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:37.546550 17098 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.483341 17545 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:20:37.467568 16893 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:37.591324 17467 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:37.607613 17385 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:37.614302 17548 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:37.533030 17620 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:37.638866 17649 log.cc:927] Time spent T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:20:37.654536 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:37.656493 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49831.7us
I20260709 12:20:37.659577 13883 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:37.661002 13135 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:37.635090 17555 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:37.657406 13252 leader_election.cc:336] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.545s (SENT)
I20260709 12:20:37.662356 13252 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:37.668473 13881 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:37.651499 17204 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:37.651333 17548 raft_consensus.cc:697] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:37.554739 17465 consensus_queue.cc:237] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:37.623960 17098 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:37.669349 16893 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.699237 13884 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:37.701512 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:37.704702 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:37.706147 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:37.700433 17204 raft_consensus.cc:697] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:37.705447 17560 raft_consensus.cc:3055] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:37.707022 13286 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:20:37.708166 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 50795us
I20260709 12:20:37.688315 17641 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:37.696993 17357 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:20:37.703164 17616 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.683180 17651 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:20:37.772921 17651 consensus_queue.cc:1243] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:20:37.711220 17640 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
W20260709 12:20:37.729880 13252 leader_election.cc:336] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.591s (SENT)
I20260709 12:20:37.773800 13252 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:37.731631 13249 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:37.736466 17648 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:37.737126 17357 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:37.775748 17357 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:37.776600 17357 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:37.777849 17357 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.779649 17455 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.780191 17455 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:37.781630 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.782802 17455 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:37.786640 17357 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.738534 17638 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:20:37.744534 17548 consensus_queue.cc:237] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:37.749053 17098 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:37.750372 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:37.753875 17585 consensus_meta.cc:287] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.671s	user 0.007s	sys 0.003s
I20260709 12:20:37.796068 17585 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:37.797120 13277 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:37.694473 17642 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:37.737957 17650 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:20:37.698081 17385 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:37.758085 17383 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:37.760423 17220 consensus_meta.cc:287] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 12:20:37.760478 17285 raft_consensus.cc:1064] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:20:37.766646 17204 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:37.721000 17643 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:20:37.772020 17661 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:37.790104 17634 raft_consensus.cc:3055] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:20:37.755019 17646 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 12:20:37.803885 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.839886 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.865851 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 134300us
I20260709 12:20:37.731086 17560 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:37.870864 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 432776us
I20260709 12:20:37.880050 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:37.881078 13129 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:37.881146 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:20:37.884555 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.866771 16972 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:37.885656 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 351426us
I20260709 12:20:37.884268 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:37.888602 13175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.026s	sys 0.063s
W20260709 12:20:37.889223 13175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.026s	sys 0.063s
I20260709 12:20:37.890012 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:37.891537 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:37.883882 17545 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.893850 17545 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:37.866839 17220 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:37.896932 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 651098us
I20260709 12:20:37.897634 17220 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:37.897687 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:37.918541 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 197313us
W20260709 12:20:37.920706 13252 leader_election.cc:336] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.620s (SENT)
I20260709 12:20:37.912267 13210 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:37.875706 17634 raft_consensus.cc:740] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:37.816311 17357 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:37.916095 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.916653 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 419874us
I20260709 12:20:37.886951 17623 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:20:37.930476 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.925097 13175 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:37.887238 17616 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:37.911577 17585 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:37.913609 17541 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.936687 13175 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:37.914713 17661 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:37.927136 17587 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.923530 17220 raft_consensus.cc:2764] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:20:37.934618 17616 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:37.953095 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.934290 17586 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:37.955358 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:37.958523 13207 raft_consensus.cc:2410] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:20:37.957387 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.959532 13212 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:37.962059 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.937986 17623 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:37.964701 13212 raft_consensus.cc:2368] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12.
I20260709 12:20:37.965997 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.966835 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.951963 17651 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:37.974233 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.976054 17605 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:37.975051 13207 raft_consensus.cc:2376] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10. Re-sending same reply.
I20260709 12:20:37.956902 17616 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:37.983268 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.953251 17661 raft_consensus.cc:697] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:37.987748 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.988564 13206 raft_consensus.cc:2376] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13. Re-sending same reply.
I20260709 12:20:37.989511 13129 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:37.985302 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.990425 13207 raft_consensus.cc:2376] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14. Re-sending same reply.
I20260709 12:20:37.992198 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:37.992727 17660 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:20:37.994357 17658 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:37.994738 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.997357 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.998590 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:38.000478 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.001889 17357 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.002074 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:37.956482 17587 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.003978 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:38.004328 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:38.004875 17587 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.007576 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2190) took 1531 ms. Trace:
I20260709 12:20:38.007733 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.008009 13278 rpcz_store.cc:276] 0709 12:20:36.476145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.532943 (+ 56798us) service_pool.cc:224] Handling call
0709 12:20:36.533251 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:36.864950 (+331699us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:36.865231 (+   281us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:37.310414 (+445183us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b1800009400. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d6e2a6 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a
0709 12:20:37.792248 (+481834us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b2c0003a938. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:20:37.792893 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 12:20:37.914572 (+121679us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:37.914664 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.914854 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:38.007287 (+ 92433us) raft_consensus.cc:1685] finished
0709 12:20:38.007309 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:38.007488 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29487,"raft.queue_time_us":331643,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":6669,"spinlock_wait_cycles":51196544,"thread_start_us":451330,"threads_started":2,"wal-append.queue_time_us":173218}
I20260709 12:20:38.009589 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.010680 13206 raft_consensus.cc:2410] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:20:37.952847 17560 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.012071 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:38.012558 17560 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:38.013697 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:38.014381 13206 raft_consensus.cc:2376] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10. Re-sending same reply.
I20260709 12:20:38.016440 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:38.018014 17615 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 1.052s	user 0.006s	sys 0.000s
I20260709 12:20:38.019851 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.022643 17357 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.023168 17357 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.025729 17661 consensus_queue.cc:237] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.027839 17545 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.027735 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:38.029170 17371 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:37.960083 17585 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:37.941912 17541 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.031136 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:38.033154 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.035338 13207 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
W20260709 12:20:38.033813 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.036396 13129 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:38.036463 13206 raft_consensus.cc:2376] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13. Re-sending same reply.
I20260709 12:20:37.938578 17619 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:38.040387 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 111848us
I20260709 12:20:38.050839 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:38.057125 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:38.057773 13130 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:37.965461 17586 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.064069 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.064847 13206 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:38.075012 13128 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:37.980805 17285 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.039011 17651 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:38.078409 17651 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:38.070012 13252 leader_election.cc:336] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.500s (SENT)
I20260709 12:20:38.035190 17357 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.086486 13284 raft_consensus.cc:2393] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:38.084153 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:38.088459 13132 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:38.091771 17618 raft_consensus.cc:3055] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:38.092327 17618 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:38.093490 17618 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.094998 17618 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:38.096907 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2186) took 1622 ms. Trace:
I20260709 12:20:38.097098 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:20:38.100558 13252 leader_election.cc:336] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.540s (SENT)
W20260709 12:20:38.102125 13252 leader_election.cc:336] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.574s (SENT)
I20260709 12:20:37.973501 17641 consensus_queue.cc:1059] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:20:38.097287 13281 rpcz_store.cc:276] 0709 12:20:36.474922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.477357 (+  2435us) service_pool.cc:224] Handling call
0709 12:20:36.497962 (+ 20605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:36.927118 (+429156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.096670 (+1169552us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54002657d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:38.096843 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953315584}
I20260709 12:20:38.106416 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:38.061424 17371 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:38.108403 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:38.114583 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:38.117884 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.118475 13132 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:38.117882 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:38.120210 13252 leader_election.cc:336] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.684s (SENT)
I20260709 12:20:38.121050 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:38.121140 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:38.121050 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:38.122361 13283 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:38.041384 17585 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.122467 13252 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:38.122592 13277 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:38.130626 13278 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:38.121273 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:38.128688 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.112792 16893 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.113262 17606 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:20:38.138301 13252 leader_election.cc:336] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.687s (SENT)
I20260709 12:20:38.144170 13206 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: [9.7-10.8]
I20260709 12:20:38.043897 17634 consensus_queue.cc:260] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.127954 17467 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:38.132773 17641 raft_consensus.cc:3055] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:20:38.176829 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.152459 17541 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:38.136660 17550 consensus_queue.cc:1048] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:20:38.158888 17585 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:38.159639 17668 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.137655 16893 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.165182 13209 raft_consensus.cc:2410] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 12:20:38.179670 13252 leader_election.cc:336] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.799s (SENT)
I20260709 12:20:38.166054 17560 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.083621 17623 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.167585 17357 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:38.168560 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.174017 13280 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:38.175643 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.165567 17658 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.187295 13207 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 12:20:38.187563 13884 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:38.189352 13206 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:38.204016 13252 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.851s (SENT)
I20260709 12:20:38.176658 17641 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:38.186112 17560 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.186893 17618 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:38.210597 13205 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:38.185220 17534 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:20:38.211658 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:38.212482 13205 raft_consensus.cc:2410] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:20:38.213372 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.213764 17619 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:38.214402 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.215981 13208 raft_consensus.cc:1240] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:20:38.217259 13208 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:38.217808 17560 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:38.218500 13208 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:38.217274 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:38.223557 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 105895us
I20260709 12:20:38.207608 13207 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:38.207708 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.207331 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:38.178658 17467 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:38.235319 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 310284us
I20260709 12:20:38.236763 13208 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:38.236325 13841 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:38.238021 13252 leader_election.cc:336] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.712s (SENT)
I20260709 12:20:38.185003 17679 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:20:38.240272 16893 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:38.242174 17467 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.242386 17514 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:38.242550 17641 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.243536 17677 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:38.244033 17641 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:38.247790 17220 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.248381 17220 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:38.250355 17665 log.cc:927] Time spent T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.295s	user 0.004s	sys 0.002s
I20260709 12:20:38.250793 17220 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.184342 17661 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:20:38.251240 13285 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:38.202090 17357 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.184813 17668 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.254101 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:38.224257 17560 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.257180 13285 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:38.258082 13252 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:38.258793 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:38.259002 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:38.259688 13883 raft_consensus.cc:2393] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:38.263085 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2980) took 1148 ms. Trace:
I20260709 12:20:38.263619 13284 rpcz_store.cc:276] 0709 12:20:37.116828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.127579 (+ 10751us) service_pool.cc:224] Handling call
0709 12:20:38.256200 (+1128621us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54004092d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:38.256304 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151516416}
I20260709 12:20:38.201923 17658 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:38.275493 13252 leader_election.cc:336] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.717s (SENT)
I20260709 12:20:38.290483 13100 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:38.276875 17661 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:38.277280 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.277302 17679 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:38.279598 17220 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.279604 17534 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:38.272028 17560 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.308480 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 2971) took 1224 ms. Trace:
I20260709 12:20:38.308600 17220 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.309195 17357 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:38.309373 17651 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:38.310086 17560 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.296062 13203 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:38.311061 17220 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.311751 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.311975 17668 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:38.312561 13203 raft_consensus.cc:2393] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:38.313462 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.300767 13208 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:38.308964 13282 rpcz_store.cc:276] 0709 12:20:37.083840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.243922 (+160082us) service_pool.cc:224] Handling call
0709 12:20:38.308277 (+1064355us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b5400336654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:38.308418 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339277184}
I20260709 12:20:38.314623 13208 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:38.316358 17586 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.316182 13208 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.310207 17651 consensus_queue.cc:1243] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:38.317322 13208 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:38.318993 17658 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.319614 13205 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:38.319756 17532 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.320322 17532 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.321215 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.321816 13205 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:38.322597 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.323105 13205 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:38.323788 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:38.325248 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49846.8us
W20260709 12:20:38.325951 13252 leader_election.cc:336] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.721s (SENT)
I20260709 12:20:38.326327 13252 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:38.268584 17606 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:38.330209 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.332259 13883 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 12:20:38.353783 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:38.355170 13132 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:38.356702 13882 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:38.314989 17583 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:38.360224 13136 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:38.362677 13131 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:38.357556 13252 leader_election.cc:336] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.781s (SENT)
I20260709 12:20:38.359913 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:38.364720 13252 leader_election.cc:336] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.977s (SENT)
I20260709 12:20:38.365917 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:38.363584 13841 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:38.372679 13878 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:38.372944 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:38.375480 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:38.328629 17635 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:38.359386 17679 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:38.357076 17668 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.387812 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.356894 17534 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.389555 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:38.395267 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.403728 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.400133 13203 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:38.398175 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:38.363718 17532 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.399115 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:38.413177 13878 raft_consensus.cc:2410] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:20:38.409482 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 44789.3us
I20260709 12:20:38.410526 13882 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:38.410367 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:38.340490 17616 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.411799 17534 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:38.411129 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.415834 13203 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:38.415401 13134 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:38.417140 13838 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:38.421828 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 804) took 1785 ms. Trace:
W20260709 12:20:38.417413 13252 leader_election.cc:336] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.848s (SENT)
I20260709 12:20:38.429626 13252 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:38.429908 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.429494 13135 rpcz_store.cc:276] 0709 12:20:36.636732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.636928 (+   196us) service_pool.cc:224] Handling call
0709 12:20:36.637387 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:37.661397 (+1024010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.421588 (+760191us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003ac5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:38.421767 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336908544}
I20260709 12:20:38.430660 13134 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:38.376004 17583 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:38.431197 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:38.418673 13887 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:20:38.431229 13252 leader_election.cc:336] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 2.047s (SENT)
I20260709 12:20:38.432927 13252 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:38.428932 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:38.419705 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.423321 13284 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:38.432471 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.436538 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.437338 13132 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:38.438375 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.434139 13130 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 8.
I20260709 12:20:38.442615 13841 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:38.443922 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 135780us
I20260709 12:20:38.449863 17285 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:38.451212 17285 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:38.451666 17285 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:38.452732 17285 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.454319 17285 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:38.470229 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.481582 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 52731.5us
I20260709 12:20:38.482462 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:38.482620 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:38.483311 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.483516 13134 raft_consensus.cc:2410] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:20:38.480858 13879 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:38.416823 17605 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:38.388386 17635 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:38.484628 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 44410.1us
W20260709 12:20:38.495229 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.432384 17658 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.484997 13135 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:38.447567 17641 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:38.435101 17679 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:38.496351 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:38.428579 17541 consensus_queue.cc:1059] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:20:38.480614 17651 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:38.492599 17605 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:38.485369 17666 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:38.408409 17668 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.520627 13208 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:38.448371 17500 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:20:38.440910 17656 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:20:38.498034 17550 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:38.524513 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 93305.4us
W20260709 12:20:38.543090 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.543622 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.544309 13252 leader_election.cc:336] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.926s (SENT)
W20260709 12:20:38.540009 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 68230.1us
I20260709 12:20:38.435361 17606 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.545833 13177 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:38.517160 17664 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:38.522647 17672 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:38.522066 17666 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.521229 17285 consensus_queue.cc:1059] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 12:20:38.564869 13252 leader_election.cc:336] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.946s (SENT)
I20260709 12:20:38.507797 17658 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.578393 17534 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:38.579638 17616 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:38.580005 17658 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:38.567843 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.580673 17668 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:38.515767 17583 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.566407 17666 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:38.552811 17664 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.587396 17664 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:38.594728 13132 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:38.576781 17635 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.597380 13880 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:38.568222 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:38.606184 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.612727 13206 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:20:38.612609 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48034.6us
W20260709 12:20:38.614470 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 132057us
I20260709 12:20:38.616855 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:38.599946 17636 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.622906 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.623757 13204 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:38.624547 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.626500 13206 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:38.615224 17679 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:38.635994 17701 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:38.637369 17666 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.620992 17709 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:20:38.638845 17630 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.677589 17672 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:38.732530 17689 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.650738 17664 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.736853 17651 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:38.737473 17664 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.728627 17285 consensus_queue.cc:1243] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:38.741266 17712 raft_consensus.cc:3055] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:38.741742 17712 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:38.640789 13252 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:38.748343 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 131585us
I20260709 12:20:38.651145 17220 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.651841 17357 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:38.733109 17689 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.648111 17706 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:38.755959 13175 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:38.755380 17220 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.761183 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 1130) took 1383 ms. Trace:
I20260709 12:20:38.766419 13880 rpcz_store.cc:276] 0709 12:20:37.378186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.378322 (+   136us) service_pool.cc:224] Handling call
0709 12:20:38.760973 (+1382651us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54005eae54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:38.761086 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2624538496}
I20260709 12:20:38.762244 17605 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.628051 17636 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.768325 17716 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:38.769235 17666 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:38.770030 17703 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:20:38.750085 17560 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:38.742743 17712 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:38.771968 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 275986us
W20260709 12:20:38.791915 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 152148us
I20260709 12:20:38.793458 13252 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:38.776189 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:38.776711 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:38.794983 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.795238 13133 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:38.778136 17545 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:38.778573 17656 raft_consensus.cc:3055] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:38.779474 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.782941 17467 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.783612 17587 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:38.785219 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:38.785806 17690 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:38.786583 13205 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:20:38.786497 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.799711 17656 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:38.813373 17607 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:38.786959 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.812647 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:38.790058 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.766942 17706 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.796574 13132 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:38.815164 13137 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:38.797403 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.798609 17465 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:38.798899 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.785744 17689 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:38.730767 17630 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.810331 13175 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:38.787758 17220 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.815979 13135 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:38.816187 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:38.773914 17701 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:38.814002 17718 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:38.814498 13204 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:38.817670 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:38.791276 17541 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.819866 17641 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:38.820740 17620 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:38.815246 17287 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:38.815508 17467 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.837396 13132 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:20:38.827127 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 281400us
I20260709 12:20:38.795805 17679 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:38.789664 17560 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:38.850715 13279 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:38.823128 17706 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:38.830367 17712 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:38.843997 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:38.843719 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 50421.8us
I20260709 12:20:38.845049 13285 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:38.846237 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:38.856158 13175 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:38.856810 13128 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:38.858073 13175 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:38.786592 17644 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:20:38.847188 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:38.815924 17717 consensus_queue.cc:1059] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:20:38.861447 13175 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:38.846060 17709 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:20:38.836232 17541 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.849265 17636 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:38.844096 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.860059 13131 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:20:38.831884 17220 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:38.861593 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:38.879467 13280 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:38.863140 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:38.863727 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:38.873842 13281 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:38.855839 13252 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:38.874536 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:38.848220 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:38.882019 13132 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:38.866045 13278 raft_consensus.cc:2410] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:20:38.842628 17641 raft_consensus.cc:697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:38.883935 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.884639 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.889886 17467 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.896551 17287 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:38.866466 17651 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:38.899573 17651 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.899984 17651 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:38.901681 13128 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:38.906082 17679 consensus_queue.cc:1059] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:38.907589 17607 raft_consensus.cc:3055] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:38.908002 17607 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:38.908831 17541 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:38.908916 17607 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.907016 17679 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:20:38.912441 13252 leader_election.cc:336] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 2.213s (SENT)
I20260709 12:20:38.846601 17583 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:20:38.865124 17701 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:38.865091 17285 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:20:38.944988 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 152348us
I20260709 12:20:38.851992 17716 consensus_queue.cc:1059] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 12:20:38.946236 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 60586.5us
I20260709 12:20:38.910382 17607 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:38.873034 17658 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:20:38.960610 17709 raft_consensus.cc:3055] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:38.961069 17709 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:38.961942 17709 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.962733 17220 consensus_queue.cc:1059] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:38.963521 17384 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:38.963778 17709 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:38.964136 17384 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.964664 17384 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:38.967447 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.968010 17723 log.cc:927] Time spent T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:20:38.968652 17285 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:38.968927 17716 raft_consensus.cc:3055] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:38.969491 17716 raft_consensus.cc:740] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:38.969645 17285 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.970566 17716 consensus_queue.cc:260] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.971639 17719 consensus_queue.cc:1059] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:38.946337 17701 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.978680 17716 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:38.979156 13203 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:20:38.981262 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.983460 17550 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:38.984047 17550 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:38.987653 17465 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:20:38.988917 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.974164 17717 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:38.990810 17717 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.992082 17383 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:38.993753 17717 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:38.994053 17384 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:38.994306 17560 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:38.996245 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.000187 17465 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:39.001663 17465 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:39.002352 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:39.003089 13280 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 10: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:39.000444 17560 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:39.010952 13137 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:39.012545 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:39.014552 13132 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:39.024922 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:39.042002 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:39.042824 13284 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:39.043723 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:39.046082 13878 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:39.049172 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:39.050148 13278 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:38.874235 17656 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:38.996726 17701 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:39.053793 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:39.066216 13278 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
W20260709 12:20:39.066275 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 202612us
I20260709 12:20:39.067129 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:39.067777 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:39.068948 13252 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:39.069199 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:39.069933 13283 raft_consensus.cc:2393] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:39.070217 13252 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:39.071795 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:39.074265 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:39.077792 13277 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:39.079536 17677 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:39.065201 17546 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:20:39.086130 13134 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:39.084388 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:39.086374 13209 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:39.087724 13205 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:20:39.090054 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:39.091367 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:39.097783 13209 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:39.098575 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:39.092104 13883 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:39.093228 13880 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:39.079994 17220 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:39.110308 17220 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.110711 17220 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:39.111932 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:39.112577 13206 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:20:39.113394 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:39.113960 13206 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:39.113806 17706 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:39.115602 13209 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:39.116201 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:39.098205 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:39.104208 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:39.016922 17641 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.106789 17651 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:39.103291 13137 raft_consensus.cc:1240] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:39.120211 13175 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:39.157712 13284 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:39.171348 17636 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.172087 17636 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:39.178514 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 108318us
I20260709 12:20:39.092641 17287 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.092s
W20260709 12:20:39.184227 17722 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:20:39.184584 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:39.186797 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 66661.8us
I20260709 12:20:39.187630 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:39.188591 17707 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:39.092592 17690 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:39.189013 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:39.222004 13175 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:39.093086 17679 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:39.238107 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:39.211925 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.190373 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:39.240007 13137 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:39.243258 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:39.232654 13878 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:39.124759 17656 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:39.246495 13204 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:39.252053 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.254000 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:39.128320 17689 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:39.264779 13137 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
W20260709 12:20:39.266283 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 139505us
I20260709 12:20:39.189041 17630 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:39.270421 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.189296 17707 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:39.238041 17717 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:39.236025 17679 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:39.174752 17220 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:39.288944 17679 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:39.285857 17706 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:39.294888 17724 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.297363 17708 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:39.245679 17285 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:39.279438 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:39.329555 13137 raft_consensus.cc:2393] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:39.271306 13102 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:39.287468 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 64308.5us
I20260709 12:20:39.235466 17644 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:20:39.271410 17689 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.274865 17383 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.277956 17541 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:39.237712 17550 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.325466 13205 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:39.305589 17384 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:39.128695 16972 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.143s
I20260709 12:20:39.334930 17644 consensus_queue.cc:1243] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:20:39.337146 13284 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:39.306121 17731 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:20:39.354089 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:39.355242 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:39.357281 17721 log.cc:927] Time spent T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
W20260709 12:20:39.358039 17732 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:20:39.359028 17467 raft_consensus.cc:3055] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:39.340425 17689 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:39.343945 17701 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:39.448740 17701 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:39.362026 17541 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:39.324548 17724 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.451818 17724 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:39.352594 17287 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:20:39.348341 17383 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:39.453423 17651 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:39.454073 17287 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.454663 17383 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:39.365060 17550 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:39.395027 17730 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:20:39.406028 17220 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:39.392812 17467 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:39.409072 13137 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:20:39.411022 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.411305 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:39.465627 13129 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:39.428030 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 794) took 1087 ms. Trace:
I20260709 12:20:39.466588 13884 rpcz_store.cc:276] 0709 12:20:38.340492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.340614 (+   122us) service_pool.cc:224] Handling call
0709 12:20:38.340998 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:38.521499 (+180501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.521546 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:38.521605 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:38.521658 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:39.427711 (+906053us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400691ed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:39.427766 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:39.427933 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400060160}
I20260709 12:20:39.435519 17605 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:39.439072 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:39.445848 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:39.448884 17634 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:39.348603 17607 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:20:39.470183 13136 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:39.454707 17287 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.486297 13203 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:39.485236 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:39.460887 17383 consensus_queue.cc:1059] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:20:39.487376 13137 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:39.501524 17287 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:39.505029 17689 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.507818 13136 raft_consensus.cc:2468] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:39.495316 17383 consensus_queue.cc:1243] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:20:39.510238 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 239001us
I20260709 12:20:39.514288 13102 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:20:39.513638 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.515443 17541 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:20:39.516738 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.519807 17541 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:39.520922 17541 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:39.521890 17727 consensus_queue.cc:1059] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:39.524145 13209 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:20:39.525578 13209 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:20:39.525885 13209 pending_rounds.cc:85] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 10
I20260709 12:20:39.526113 13209 pending_rounds.cc:107] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:20:39.526381 13209 raft_consensus.cc:2889] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:39.526324 17679 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.528049 13135 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:39.529714 13209 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 12:20:39.534010 13209 pending_rounds.cc:85] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:20:39.534286 13209 pending_rounds.cc:107] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:20:39.534523 13209 raft_consensus.cc:2889] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:39.543289 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:39.545658 13840 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:39.540284 13838 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:39.572299 17620 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:39.583706 13137 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:39.590721 13136 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 12:20:39.551187 17718 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:39.585232 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 48152.9us
W20260709 12:20:39.593736 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 154442us
I20260709 12:20:39.596171 13102 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:39.597378 13102 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:20:39.592711 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 45409.1us
I20260709 12:20:39.581082 17709 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:20:39.586222 17748 raft_consensus.cc:3055] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:39.583406 13129 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:39.605959 13133 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:39.594471 17621 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:39.608348 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:39.592849 17620 raft_consensus.cc:697] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:39.603904 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:39.593336 17718 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:39.609647 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:39.626214 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:39.626971 13285 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:39.597947 17749 consensus_queue.cc:1059] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:20:39.625485 17718 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:39.629027 17751 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:20:39.631376 17690 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:39.611568 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:39.637915 13249 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:39.610956 17621 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.606421 17748 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:39.621496 17607 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:39.668043 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 127826us
I20260709 12:20:39.652071 17621 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:39.655241 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:39.659474 17755 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:39.660563 17753 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:39.661506 17287 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:39.662184 17620 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.663851 17658 raft_consensus.cc:3055] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:39.664718 17748 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.666839 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:39.670266 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:39.636885 17751 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:39.647547 17759 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.699966 13285 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:39.680565 17749 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.667757 17641 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:20:39.705801 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 108480us
I20260709 12:20:39.689242 17753 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:39.694911 17679 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:39.711687 13102 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:39.710541 17651 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:39.714855 17651 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.715699 17757 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:20:39.716388 17757 consensus_queue.cc:1243] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:39.717684 17651 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:39.717823 17757 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:39.718374 17757 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.718725 17757 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:39.720276 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:39.720681 17385 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:39.721535 13211 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:39.724568 13211 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:39.728189 13103 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:39.710562 17748 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:39.727159 17621 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.736734 17621 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:39.693094 17718 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.691854 17658 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:39.743827 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:39.712008 17753 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:39.713871 17586 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 12:20:39.753964 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 73063.7us
I20260709 12:20:39.711102 17755 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:20:39.779776 17761 raft_consensus.cc:2764] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:20:39.709225 17749 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:39.752215 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 82007.4us
I20260709 12:20:39.768805 17586 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:39.768972 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.759464 17763 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:39.782578 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 144770us
I20260709 12:20:39.775563 17658 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.705736 17759 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.786509 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:39.796299 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:39.805138 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 61431.4us
I20260709 12:20:39.805547 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:39.797850 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:39.786818 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:39.796418 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:39.807943 13211 raft_consensus.cc:2410] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:20:39.799024 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:39.798237 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:39.798480 13205 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:20:39.806929 13103 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:39.809095 13282 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:39.810019 13103 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:39.810871 13177 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:39.812577 13177 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:39.802995 13838 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:39.819132 13278 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:39.811208 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:39.820760 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:39.823099 13281 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:39.824013 13205 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 12:20:39.824949 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:39.826548 13177 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:39.827574 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:39.827692 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:39.828202 13285 raft_consensus.cc:2376] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11. Re-sending same reply.
I20260709 12:20:39.825556 13282 raft_consensus.cc:2376] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12. Re-sending same reply.
I20260709 12:20:39.791033 17690 raft_consensus.cc:3055] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:39.833576 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:39.834854 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:39.839164 13278 raft_consensus.cc:2410] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:20:39.791231 17679 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:39.784130 17718 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:39.791102 17677 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.840803 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:39.842559 13885 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:39.785990 17749 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:39.843546 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.818810 17651 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:39.822999 17555 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:39.827977 17751 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:39.823312 17755 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:39.824185 17761 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:39.807636 17701 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:20:39.806577 17763 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:20:39.843760 17731 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.836906 17560 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:39.828138 17641 consensus_queue.cc:1059] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:20:39.838053 17690 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:39.871798 13281 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:39.836601 17607 consensus_queue.cc:1059] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:20:39.794335 17753 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.850461 17755 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.850230 17658 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:39.871021 17761 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.869964 17555 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:39.892318 17755 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:39.880036 17731 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:39.845877 17679 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:39.883850 17641 consensus_queue.cc:1243] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:39.845887 17677 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:39.893052 17768 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:39.892474 17756 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:39.891233 17774 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:39.848464 17708 consensus_queue.cc:1059] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:20:39.849992 17586 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:20:39.994176 17679 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:39.984450 17560 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.037348 17763 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:39.963994 17742 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:39.985982 17385 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:39.965121 17761 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:40.090323 17774 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:40.115907 17775 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:20:40.038113 17756 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:40.142450 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.144187 17718 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:40.178956 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 351797us
I20260709 12:20:40.143873 17751 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:39.989109 17634 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.146311 17774 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:40.108462 17560 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.171389 17616 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:40.192693 17776 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:20:40.196549 17773 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:20:40.196889 17753 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.116590 17763 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:40.197342 17769 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.319s	user 0.000s	sys 0.000s
I20260709 12:20:40.179469 17742 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:40.144589 17385 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.201149 17756 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:40.202457 17759 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:40.204028 17755 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.205180 13212 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:40.205400 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:40.210616 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2107) took 1879 ms. Trace:
I20260709 12:20:40.177006 17712 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:40.272328 13130 rpcz_store.cc:276] 0709 12:20:38.330756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.480999 (+150243us) service_pool.cc:224] Handling call
0709 12:20:38.498284 (+ 17285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:38.498499 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.498535 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:38.498591 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:38.498644 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.498732 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.210337 (+1711605us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b540011c950. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:40.210538 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39065472}
I20260709 12:20:40.108485 17690 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.235863 17636 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:40.254117 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 433360us
I20260709 12:20:40.216310 17634 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.209224 17718 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.278630 13885 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:40.237195 17605 raft_consensus.cc:3055] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:40.181726 17555 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.291808 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2117) took 1504 ms. Trace:
I20260709 12:20:40.205220 17757 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.224596 17616 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.252529 17701 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:40.301074 13131 rpcz_store.cc:276] 0709 12:20:38.775963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.779153 (+  3190us) service_pool.cc:224] Handling call
0709 12:20:40.280225 (+1501072us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b5400060754. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:40.280361 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138019584}
I20260709 12:20:40.273664 17717 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:40.310560 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.296630 17605 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:40.297752 17690 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:40.355000 17773 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:20:40.360798 13280 raft_consensus.cc:2955] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 2 to 8, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:40.368112 17545 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:20:40.301750 17779 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:40.356534 17778 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.281024 17712 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.381387 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:40.375666 13281 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:20:40.291862 17748 consensus_queue.cc:1059] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:20:40.252004 17742 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.395815 13131 pending_rounds.cc:85] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 8
I20260709 12:20:40.396185 13131 pending_rounds.cc:107] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:20:40.396427 13131 raft_consensus.cc:2889] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:40.387548 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:40.361013 17783 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:40.397706 13102 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:40.401976 13885 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:40.402218 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:40.403968 13137 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:40.357591 17717 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.405565 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:40.406119 17385 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.406190 13128 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:40.407255 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:40.370437 17560 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:40.411587 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:40.397629 13130 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:40.411783 13878 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:40.407807 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:40.379902 17731 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:40.297080 17751 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.428594 13249 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:40.397441 17785 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.411626 17783 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.399869 17779 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.447582 17785 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.370560 17605 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.443831 17799 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:40.495807 13177 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:40.398401 17701 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:40.296957 17641 consensus_queue.cc:1175] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a99436c294734e5cbc3657b2517cefca" responder_term: 11 status { last_received { term: 7 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: [8.7-10.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:40.473268 13136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1583) took 1364 ms. Trace:
I20260709 12:20:40.474278 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:40.475306 17616 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.397225 17778 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.497802 13136 rpcz_store.cc:276] 0709 12:20:39.108418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.510765 (+402347us) service_pool.cc:224] Handling call
0709 12:20:39.590457 (+ 79692us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:39.591100 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.449824 (+858724us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b54003acad0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:40.473194 (+ 23370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182353280}
I20260709 12:20:40.475719 17712 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:40.476862 17786 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 12:20:40.477818 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 49301.8us
I20260709 12:20:40.478020 13883 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:40.439657 17560 raft_consensus.cc:3055] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:40.476915 17742 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.480835 17718 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:40.482335 17777 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
W20260709 12:20:40.494858 17745 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.999s	user 0.017s	sys 0.035s
I20260709 12:20:40.513861 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:40.532203 13136 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:40.502823 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:40.494083 17791 raft_consensus.cc:3055] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:40.535247 17791 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:40.536244 17791 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.537474 17798 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:40.537700 17791 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:40.494311 17763 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.495200 17634 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:40.519320 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:40.503458 17796 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:40.523639 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:40.543977 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:40.498765 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 86034.5us
I20260709 12:20:40.548270 13102 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:40.538352 17798 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:20:40.500000 17799 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.555656 13102 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:40.555756 17789 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:20:40.557018 17798 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:40.557602 17799 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.532233 17616 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:20:40.558246 17739 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:40.558178 17799 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:40.558987 17739 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.560021 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1795) took 1457 ms. Trace:
I20260709 12:20:40.560463 13204 rpcz_store.cc:276] 0709 12:20:39.102666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.103527 (+   861us) service_pool.cc:224] Handling call
0709 12:20:39.103853 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:39.246913 (+143060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.559767 (+1312854us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54000b7054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:40.559954 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327570304}
I20260709 12:20:40.561477 17739 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.561934 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:40.562674 13204 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:40.564741 17785 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.566771 17778 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:40.567576 17757 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:40.569499 17701 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.569841 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 863) took 3280 ms. Trace:
I20260709 12:20:40.570299 13886 rpcz_store.cc:276] 0709 12:20:37.289774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.289956 (+   182us) service_pool.cc:224] Handling call
0709 12:20:37.304672 (+ 14716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:37.405706 (+101034us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:37.407732 (+  2026us) log.cc:844] Serialized 14 byte log entry
0709 12:20:38.384113 (+976381us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b180036d300. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f4a354bc 00007f70f1d8348b 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d23a
0709 12:20:38.821036 (+436923us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b180036d300. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9d455 00007f70f88853c7 00007f70f4e979a7 00007f70f4ea70bf 00007f70f4ea7038
0709 12:20:38.948080 (+127044us) log.cc:844] Serialized 14 byte log entry
0709 12:20:39.071187 (+123107us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:39.071237 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:39.071293 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.569626 (+1498333us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54004560d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:40.569671 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.569778 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16110,"prepare.queue_time_us":178122,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":92,"raft.queue_time_us":10140,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":22382,"spinlock_wait_cycles":250714112,"thread_start_us":275850,"threads_started":3,"wal-append.queue_time_us":421296,"wal-append.run_cpu_time_us":4480,"wal-append.run_wall_time_us":2571958}
I20260709 12:20:40.573179 17761 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.573845 17690 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.574486 13132 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:40.574436 17690 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.576646 17779 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.501704 17774 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.503559 17780 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:40.541234 17790 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:20:40.580479 17790 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:40.580852 17790 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:40.580892 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3036) took 1469 ms. Trace:
I20260709 12:20:40.542073 17795 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:40.547703 17514 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:40.522572 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:40.582947 13211 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:40.583313 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:40.583326 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:40.583618 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:40.583880 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:40.584146 13278 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:40.584708 13211 raft_consensus.cc:2410] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 15 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:20:40.545405 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.581843 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:40.541823 13841 connection.cc:256] RPC call timeout handler was delayed by -1.0813659200000529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:20:40.496713 17755 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.503702 17560 raft_consensus.cc:740] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:40.581405 13208 rpcz_store.cc:276] 0709 12:20:39.111228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.116280 (+  5052us) service_pool.cc:224] Handling call
0709 12:20:39.116528 (+   248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:39.116855 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:39.128200 (+ 11345us) log.cc:844] Serialized 14 byte log entry
0709 12:20:39.332315 (+204115us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:39.337962 (+  5647us) log.cc:844] Serialized 26 byte log entry
0709 12:20:39.338149 (+   187us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:39.338202 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:39.338287 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.374233 (+1035946us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:40.580623 (+206390us) raft_consensus.cc:1685] finished
0709 12:20:40.580714 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.580834 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11595,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1884,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":66951,"spinlock_wait_cycles":9385728,"thread_start_us":63067,"threads_started":1,"wal-append.queue_time_us":217274}
I20260709 12:20:40.557698 17798 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:40.584255 13204 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:40.551259 17783 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.607379 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:40.607785 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:40.587155 13286 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:40.579165 17774 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:40.589493 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:40.591162 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:40.592269 13277 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:40.592670 13285 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:40.598608 13136 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:40.602527 13882 raft_consensus.cc:1240] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:20:40.616282 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:40.616993 13882 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:40.607306 17799 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.617878 17783 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:40.618295 17799 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.618551 17783 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.620826 17799 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.620939 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:40.621582 17783 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:40.621981 17779 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:40.617918 17634 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:40.622498 17779 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:40.622963 17779 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:40.605121 17550 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:40.601536 17701 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.582485 17514 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.553606 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:40.588876 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:40.631876 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 107173us
I20260709 12:20:40.631517 13204 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:40.609720 13883 raft_consensus.cc:2376] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10. Re-sending same reply.
I20260709 12:20:40.610818 17761 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:40.610987 17560 consensus_queue.cc:260] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.604266 13887 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:40.624392 13841 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:40.631311 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:40.625641 17798 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:40.646241 13883 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:40.637564 17204 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:40.659566 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 345650us
I20260709 12:20:40.647298 17560 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:40.633227 17550 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.633910 17701 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:40.676530 17607 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.003s	sys 0.022s
W20260709 12:20:40.736963 17607 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.003s	sys 0.022s
I20260709 12:20:40.737111 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:40.630278 17767 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:20:40.708295 17658 consensus_meta.cc:287] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.005s
I20260709 12:20:40.737315 17607 consensus_queue.cc:1243] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:40.730932 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:40.741573 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:40.756204 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:40.756902 13208 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:40.734612 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:40.742987 17806 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:40.744791 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1582) took 1636 ms. Trace:
W20260709 12:20:40.745975 17733 log.cc:927] Time spent T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 1.263s	user 0.001s	sys 0.008s
I20260709 12:20:40.747004 17767 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.748438 17514 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:40.707538 17500 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:40.581872 17790 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.780555 17500 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.781013 17500 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:40.769764 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:40.771749 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:40.769829 13133 rpcz_store.cc:276] 0709 12:20:39.108150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.486217 (+378067us) service_pool.cc:224] Handling call
0709 12:20:39.605779 (+119562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:39.606449 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.744535 (+1138086us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b54003cfad0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:40.744701 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150475008}
I20260709 12:20:40.777638 17767 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.785578 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:40.724313 17799 consensus_queue.cc:1059] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:20:40.783727 13206 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:40.789845 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1790) took 1714 ms. Trace:
I20260709 12:20:40.790257 13203 rpcz_store.cc:276] 0709 12:20:39.075253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.075411 (+   158us) service_pool.cc:224] Handling call
0709 12:20:39.091810 (+ 16399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:39.486724 (+394914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.789609 (+1302885us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54002161d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:40.789783 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906408704}
I20260709 12:20:40.675799 17204 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:40.793051 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 156161us
I20260709 12:20:40.782307 17220 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.787693 17761 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.825608 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3001) took 1756 ms. Trace:
I20260709 12:20:40.826021 13284 rpcz_store.cc:276] 0709 12:20:39.069491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.165920 (+ 96429us) service_pool.cc:224] Handling call
0709 12:20:39.171220 (+  5300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:39.355064 (+183844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.825374 (+1470310us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540023d054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:40.825553 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379186560}
W20260709 12:20:40.820408 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 196081us
I20260709 12:20:40.796427 17796 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.813334 17808 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.827536 17220 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.845950 17690 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:40.875654 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1782) took 2622 ms. Trace:
I20260709 12:20:40.829476 17761 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.876077 13207 rpcz_store.cc:276] 0709 12:20:38.253456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.253597 (+   141us) service_pool.cc:224] Handling call
0709 12:20:38.273053 (+ 19456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:38.273393 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.273424 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:38.289274 (+ 15850us) log.cc:844] Serialized 26 byte log entry
0709 12:20:39.001712 (+712438us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b1800349120. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1 00007f70f4e48a0f
0709 12:20:39.247283 (+245571us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:39.282108 (+ 34825us) log.cc:844] Serialized 14 byte log entry
0709 12:20:39.294871 (+ 12763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:39.294968 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:39.437121 (+142153us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b1800349120. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:40.745308 (+1308187us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:40.875439 (+130131us) raft_consensus.cc:1685] finished
0709 12:20:40.875461 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.875594 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18845,"prepare.queue_time_us":30655,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":16359,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":8732,"spinlock_wait_cycles":45256576,"thread_start_us":245355,"threads_started":1,"wal-append.queue_time_us":1135267}
I20260709 12:20:40.794723 17798 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.875356 17806 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.875717 17799 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:40.918599 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:40.857024 17808 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.921432 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:40.921741 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:40.900305 17819 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:40.924319 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:40.927332 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:40.852559 17796 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.933282 13136 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:40.920904 17795 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:40.939082 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:40.941671 17816 log.cc:927] Time spent T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:20:40.959574 17689 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:40.944991 17761 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:40.946558 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:40.935693 17819 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.911827 17799 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.950719 17779 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.954756 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:40.964093 17467 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:40.922758 17550 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:40.982213 17767 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:40.904151 17806 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:40.955840 17638 consensus_queue.cc:1059] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:40.956897 17811 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.129s
I20260709 12:20:41.010703 17220 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.011006 17677 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:41.072628 13136 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:41.012917 17204 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:40.928136 17815 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.166s
I20260709 12:20:41.013720 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:40.931794 17739 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:40.930904 17780 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.016669 17796 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:41.017022 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.018590 13135 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:40.929584 17701 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:41.061293 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.063805 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.064515 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.084239 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:41.030661 17644 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.078734 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.082861 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:41.088213 13209 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:41.084901 13206 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:41.085670 17739 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.097438 17739 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:41.085810 17780 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.100813 17780 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.022146 17779 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.057302 17808 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.109459 13208 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:41.069037 17658 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:41.110173 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.072809 17467 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:41.118371 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.071847 17712 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:41.121840 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.077582 17616 consensus_queue.cc:1059] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:20:41.128023 13207 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:20:41.123821 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:41.131672 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:41.134181 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.134459 17801 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.135073 17801 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.137713 17801 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:41.111024 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:41.109788 13249 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:41.113400 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.119935 17780 consensus_queue.cc:1059] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:20:41.138509 13203 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:41.138590 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.142627 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:41.078164 17690 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:20:41.146291 13249 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:41.148949 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:41.150831 13886 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:41.152252 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:41.107254 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.144346 17616 consensus_queue.cc:1243] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:41.112814 17644 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.145386 17808 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:41.082832 17799 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:41.129294 17658 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.174718 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.153812 17780 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:41.143116 17712 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.189101 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.155786 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:41.193727 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:41.175763 17616 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:41.198882 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:41.201385 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 45689.8us
I20260709 12:20:41.202824 13103 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:41.206682 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 136585us
W20260709 12:20:41.208104 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.188232 17717 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:41.215101 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 361262us
I20260709 12:20:41.216297 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:41.219939 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.228418 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.230706 13103 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:41.235327 13131 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:20:41.236351 13100 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.775s (SENT) [suppressed 52 similar messages]
I20260709 12:20:41.238509 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.207242 17761 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:41.203938 17383 consensus_queue.cc:1059] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:20:41.245700 13103 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:20:41.267236 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 113802us
I20260709 12:20:41.268755 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:41.232357 17795 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:41.272428 13175 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:41.275063 13210 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:41.073436 17800 raft_consensus.cc:2955] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 2 to 8, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:41.234326 17755 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:41.277500 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.280655 13136 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:41.267299 17651 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:41.278486 13212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1771) took 3216 ms (client timeout 1781 ms). Trace:
I20260709 12:20:41.285162 17658 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:41.278187 17807 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:41.285908 17807 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:41.267791 17634 consensus_meta.cc:287] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.645s	user 0.013s	sys 0.000s
I20260709 12:20:41.286396 17807 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:41.286556 17634 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:41.281558 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.282291 13884 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:20:41.282606 17725 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:41.283217 17708 raft_consensus.cc:2804] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:41.284042 17644 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:41.268332 17791 consensus_meta.cc:287] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.730s	user 0.014s	sys 0.000s
W20260709 12:20:41.285517 13212 rpcz_store.cc:269] 0709 12:20:38.056215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.056764 (+   549us) service_pool.cc:224] Handling call
0709 12:20:41.271657 (+3214893us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54002a30d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:41.271764 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4199896320}
I20260709 12:20:41.325356 13208 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:41.281230 13175 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:41.331961 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 63633.6us
I20260709 12:20:41.242806 17717 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:41.351543 17717 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.352279 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.353474 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.353574 17806 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:41.353894 17717 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.354029 13130 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:41.355075 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.333273 13879 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:41.270064 17831 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:41.350459 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.356484 13130 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:41.347098 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:41.356845 13128 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:41.358146 17819 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.334602 17651 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.360306 17651 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.361611 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1580) took 2260 ms. Trace:
I20260709 12:20:41.361997 13132 rpcz_store.cc:276] 0709 12:20:39.101478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.354269 (+252791us) service_pool.cc:224] Handling call
0709 12:20:40.280365 (+926096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:40.575032 (+294667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.275452 (+700420us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400060754. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:41.361431 (+ 85979us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400060750. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:41.361555 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2804652160}
I20260709 12:20:41.363904 17836 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:41.365036 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 83881.1us
I20260709 12:20:41.365751 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:41.326109 17763 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.367853 17560 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:41.335305 17383 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:41.335526 17834 log.cc:927] Time spent T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.069s	user 0.001s	sys 0.008s
I20260709 12:20:41.372313 17717 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:41.373327 17560 raft_consensus.cc:697] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:41.373952 17545 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:41.374400 17545 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:41.374221 17560 consensus_queue.cc:237] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.375700 17717 raft_consensus.cc:697] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:41.376510 17835 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:20:41.376730 17717 consensus_queue.cc:237] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.374775 17545 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:41.386322 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.386967 13136 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:41.379936 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:41.377781 17842 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:41.325755 17795 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:41.401136 17679 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.402375 13134 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:41.384963 17763 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.397725 17465 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.404214 17751 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:41.408502 17616 consensus_queue.cc:1059] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:41.411728 17842 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.378759 17836 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.399116 17651 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:41.412657 17648 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:41.431289 17648 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:41.428754 17465 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.432403 17836 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:41.432518 17648 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.434345 17648 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:41.435379 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 804) took 1611 ms. Trace:
I20260709 12:20:41.435794 13884 rpcz_store.cc:276] 0709 12:20:39.824256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.824435 (+   179us) service_pool.cc:224] Handling call
0709 12:20:39.824704 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:41.325030 (+1500326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.435042 (+110012us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400570b54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:41.435311 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3351482624}
I20260709 12:20:41.368404 17708 raft_consensus.cc:697] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:41.437521 17842 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:41.280599 17500 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.396808 13175 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:41.437848 17708 consensus_queue.cc:237] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:41.453437 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 56736.1us
I20260709 12:20:41.453781 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.454602 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:41.455013 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.458475 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.459012 13132 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:41.459995 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:41.462255 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 225910us
I20260709 12:20:41.465526 17842 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:41.466251 17842 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.467686 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.468818 13284 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:41.469326 17801 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:41.469871 17801 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:41.470050 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.470767 17801 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.481462 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:41.491174 13128 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:41.492028 13885 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:41.495805 13131 raft_consensus.cc:1217] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 5.5->[7.6-12.8]   Dedup: 7.6->[9.7-12.8]
I20260709 12:20:41.496321 13131 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: [7.6-12.8]
I20260709 12:20:41.496572 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:41.492779 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:41.499121 13102 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:41.493723 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:41.397969 17690 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:20:41.506704 13136 raft_consensus.cc:2393] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:41.489751 17651 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:41.439035 17679 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.522475 17852 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.523082 17500 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:41.506255 17819 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:41.524019 17819 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.524478 17819 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:41.524693 17465 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.524914 17545 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.507210 17801 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:41.484279 17467 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:20:41.505781 17712 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.514369 17798 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:41.513772 17651 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:41.523126 17852 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.420276 17795 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.547389 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.536273 17801 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.553362 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.554839 13285 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:41.536552 17851 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:41.543722 17651 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:41.570466 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.571144 13136 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:41.557825 17801 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:41.565850 17851 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.574807 17842 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:41.605291 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 99953.2us
I20260709 12:20:41.607448 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:41.608111 13206 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:41.608522 17795 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.584414 17851 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:41.624614 13206 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:41.651121 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.620158 17763 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:41.648962 13249 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:41.676530 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 177499us
W20260709 12:20:41.679663 17855 log.cc:927] Time spent T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:20:41.666900 17842 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:41.688547 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.691689 17785 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:20:41.697767 17785 raft_consensus.cc:3055] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:41.698171 17785 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:41.700012 17690 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:41.700623 17690 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.703115 17690 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:41.709256 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:41.695226 17797 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 1.158s	user 0.001s	sys 0.003s
I20260709 12:20:41.712328 13208 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:20:41.712458 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.713076 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.718933 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.719048 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.719164 13212 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:41.719880 13133 raft_consensus.cc:2410] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:20:41.713675 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.713979 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.714728 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:41.716316 13130 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:41.729722 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:41.730718 17873 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:41.677369 17679 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.722316 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:41.733014 13252 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:41.734629 13175 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:41.690322 17842 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:41.736362 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 59046.5us
I20260709 12:20:41.727615 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.742475 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.743592 17658 consensus_queue.cc:1059] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:41.712085 17708 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:41.748533 13252 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:41.748760 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:41.750415 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.751084 13252 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:41.763468 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.764132 13277 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
W20260709 12:20:41.765093 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.765659 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.766229 13277 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:41.768051 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.768381 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.768563 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.769711 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.771121 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.771847 13278 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:41.772926 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.775108 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.775409 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.776257 13278 raft_consensus.cc:2410] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:20:41.776994 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.777570 13277 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:41.778380 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:41.803673 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 53494.6us
I20260709 12:20:41.739967 17560 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:41.741490 17842 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:41.749848 17679 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:41.749601 17712 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:41.699105 17785 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.761919 17778 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:41.746858 17708 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:41.808802 17807 consensus_meta.cc:287] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260709 12:20:41.802677 17739 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.817405 17644 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:41.851709 17739 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.852115 17644 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:41.852530 17644 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:41.853792 17739 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:41.827915 17785 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:41.856092 17851 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.828325 17807 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.832034 13206 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:41.833298 17708 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:41.834275 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:41.818337 17712 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.821228 17778 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.835816 13132 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:41.840390 17801 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:41.846499 17819 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.819588 17875 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:41.898533 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:41.809391 17852 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:41.850613 17560 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.887877 17712 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:41.872505 13279 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:20:41.886509 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.891825 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.893644 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.904685 13283 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:41.894594 13135 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:41.891974 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:41.875067 17873 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:41.899508 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 94756.1us
W20260709 12:20:41.901587 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 685577us
I20260709 12:20:41.901644 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:41.870620 17851 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.887451 17778 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:41.902745 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:41.908306 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:41.910398 13134 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:41.910579 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:41.914988 13252 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:41.896977 17815 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:41.921270 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.922216 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.927765 13284 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:20:41.911697 17708 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:41.946651 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:41.917611 17220 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:41.914058 17658 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:41.926425 17739 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:42.020366 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 464131us
I20260709 12:20:41.956554 13207 raft_consensus.cc:2393] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:41.993551 17605 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:41.999396 17545 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:42.005235 17838 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:20:42.008482 17780 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:42.030089 17780 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:42.032305 17807 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:42.036162 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 128244us
I20260709 12:20:42.018978 17725 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:41.931603 17851 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:42.037760 13841 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:42.018821 17801 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:41.906488 17560 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:42.065604 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 880) took 1470 ms. Trace:
I20260709 12:20:42.066356 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:42.067250 13884 raft_consensus.cc:2393] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:42.067461 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:42.066047 13887 rpcz_store.cc:276] 0709 12:20:40.595062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.637323 (+ 42261us) service_pool.cc:224] Handling call
0709 12:20:40.644674 (+  7351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:40.760738 (+116064us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:40.866245 (+105507us) log.cc:844] Serialized 14 byte log entry
0709 12:20:41.055140 (+188895us) log.cc:844] Serialized 14 byte log entry
0709 12:20:41.055481 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 12:20:41.079535 (+ 24054us) log.cc:844] Serialized 14 byte log entry
0709 12:20:41.351620 (+272085us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b1800267940. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:41.628176 (+276556us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b1800267940. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:41.874907 (+246731us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b1800267940. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d1ac0a 00007f70fb45a219 00007f70f1da2a40 00007f70f1d9d4e4 00007f70f1d9d455 00007f70f4e85060 00007f70f4e97716 00007f70f4ea8287 00007f70f4ea8208
0709 12:20:41.875057 (+   150us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:41.875619 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 12:20:41.875768 (+   149us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:41.875805 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.875873 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:42.011752 (+135879us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800267940. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:42.065352 (+ 53600us) raft_consensus.cc:1685] finished
0709 12:20:42.065381 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.065538 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2220616,"prepare.queue_time_us":1280925,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":4549,"raft.queue_time_us":855084,"raft.run_cpu_time_us":963,"raft.run_wall_time_us":52894,"spinlock_wait_cycles":206647424,"thread_start_us":363784,"threads_started":3,"wal-append.queue_time_us":303172}
I20260709 12:20:42.068061 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:42.068879 13879 raft_consensus.cc:2410] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:20:42.069465 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:41.913699 17852 consensus_queue.cc:1059] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:20:42.070009 13880 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:42.064973 13840 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:42.031227 17780 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:42.068094 13878 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:42.020468 17658 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.057109 17870 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:20:42.089686 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 52009.4us
I20260709 12:20:42.076718 13132 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:42.106163 13838 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:42.106642 13841 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:42.110553 13880 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:42.122602 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:42.149214 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 43601.6us
I20260709 12:20:42.068410 17560 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:42.152488 17869 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:42.152962 17630 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:42.154458 13841 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:42.104804 17658 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:42.075589 17759 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:42.122534 17767 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:42.113564 17852 consensus_queue.cc:1243] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:42.122664 17811 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:42.163369 17767 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.167850 17819 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:42.105340 17870 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:42.168078 17550 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:42.123782 17780 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:42.073206 17651 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:42.169528 13208 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:20:42.070312 17725 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.173902 17767 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:42.192114 13204 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:42.193837 17725 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:42.178397 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1592) took 1261 ms. Trace:
I20260709 12:20:42.073313 17842 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:41.941763 17815 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.171372 17811 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.020916 17717 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:42.187769 17550 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:42.178129 17870 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:42.191507 17651 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:42.221323 17811 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:42.197623 13285 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 10. Ops: []
I20260709 12:20:42.196013 13129 rpcz_store.cc:276] 0709 12:20:40.917588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.917812 (+   224us) service_pool.cc:224] Handling call
0709 12:20:40.918201 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.010424 (+ 92223us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:41.010746 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 12:20:41.177377 (+166631us) log.cc:844] Serialized 14 byte log entry
0709 12:20:41.183989 (+  6612us) log.cc:844] Serialized 14 byte log entry
0709 12:20:41.186580 (+  2591us) log.cc:844] Serialized 14 byte log entry
0709 12:20:41.187089 (+   509us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:41.187142 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:41.187192 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.350193 (+163001us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b1800472fc0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:41.743086 (+392893us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b1800472fc0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:42.177555 (+434469us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b1800472fc0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d6e2a6 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419
0709 12:20:42.178180 (+   625us) spinlock_profiling.cc:243] Waited 92 ms on lock 0x7b540027ef54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:42.178212 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.178336 (+   124us) inbound_call.cc:177] Queueing success response
0709 12:20:42.193922 (+ 15586us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b1800472fc0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d1ac0a 00007f70fb45a219 00007f70f9db6328 00007f70f9dad901 00007f70f9dad8a7 00007f70f9ea5288 00007f70f9ea4f37 00007f70f9eb955c 00007f70f9eb9508
Metrics: {"mutex_wait_us":454849,"prepare.queue_time_us":338856,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":124,"raft.queue_time_us":6491,"raft.run_cpu_time_us":3441,"raft.run_wall_time_us":1465944,"spinlock_wait_cycles":255650560,"thread_start_us":164377,"threads_started":1,"wal-append.queue_time_us":219966}
I20260709 12:20:42.202379 17842 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:42.204200 13885 raft_consensus.cc:2955] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 2 to 8, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:42.178714 17759 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.222393 17550 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:42.222572 17870 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:42.221724 17717 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:42.247802 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 93419.4us
I20260709 12:20:42.247072 17717 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:42.256115 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 347865us
I20260709 12:20:42.251703 17500 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:42.261686 13177 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:42.267189 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.261417 13841 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:42.277781 13841 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:42.276643 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.252171 17842 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:42.278796 17842 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.282878 13177 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:42.289397 17815 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:42.295310 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1778) took 4117 ms. Trace:
I20260709 12:20:42.284258 17555 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:42.284763 17648 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:42.296526 13210 rpcz_store.cc:276] 0709 12:20:38.177760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.177924 (+   164us) service_pool.cc:224] Handling call
0709 12:20:41.271862 (+3093938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.276680 (+  4818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.295101 (+1018421us) spinlock_profiling.cc:243] Waited 3.09 s on lock 0x7b54002a30d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:42.295248 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7101625088}
I20260709 12:20:42.285501 17651 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:42.297031 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 370686us
I20260709 12:20:42.306638 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:42.307394 13282 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:42.308234 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:42.309027 13284 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:42.310637 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:42.290793 17785 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:42.314312 13284 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:42.301136 13177 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:42.287169 17708 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:42.287700 17879 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.321883 13177 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:42.276304 17875 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:42.323019 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:42.323763 13282 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:42.326217 13177 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:42.327608 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:42.311583 17555 raft_consensus.cc:697] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:42.332839 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:42.330295 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:42.333525 13280 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:42.334462 13102 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:42.335752 13102 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:42.336809 13102 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:42.337383 13100 leader_election.cc:336] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 2.642s (SENT)
I20260709 12:20:42.337972 13100 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:42.340512 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:42.330719 17801 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:42.327193 17651 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:42.344131 17880 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:42.346264 13177 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:42.339116 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 233002us
I20260709 12:20:42.330534 17881 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:42.356109 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:42.335942 17838 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:42.320748 17785 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.330643 17560 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:42.340739 17772 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:42.358632 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:42.359117 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:42.346897 17802 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:42.382058 13177 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:42.372167 13282 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:42.344564 17774 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:42.376784 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 477723us
I20260709 12:20:42.383029 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:42.388091 13134 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:20:42.375821 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 414712us
I20260709 12:20:42.350240 17791 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:42.365900 17638 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:42.379655 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.355552 17880 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:42.357962 17708 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:42.326047 17879 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:42.390792 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:42.394479 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:42.348790 17727 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:20:42.388833 13838 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:42.391616 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:42.400285 13134 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:42.376008 17605 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.379070 17772 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.411206 13132 raft_consensus.cc:2393] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 15: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:20:42.411501 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.413158 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:42.414145 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:42.413780 13131 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:42.414777 13205 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:42.389919 17815 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:42.417544 13280 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:20:42.418208 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.421535 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:42.393633 17500 raft_consensus.cc:2764] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:20:42.374208 17651 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:20:42.424017 13134 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:42.378628 17648 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:20:42.438028 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:42.438921 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:42.439061 13130 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:42.440745 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:42.442404 13210 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:20:42.399130 17791 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:42.408454 17810 raft_consensus.cc:3055] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:42.465731 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:42.466579 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:42.467212 13136 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:42.451954 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:42.452328 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:42.415524 17772 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:42.409220 17842 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:42.400200 17880 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:42.427950 17724 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:42.463774 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:42.471182 13207 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:42.496079 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:42.471184 13286 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:42.481933 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:42.474429 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:42.433612 17838 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:42.501098 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:20:42.482574 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 43725.6us
I20260709 12:20:42.436434 17708 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:42.417371 17883 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:42.430294 17774 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:42.463192 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 81215.5us
I20260709 12:20:42.460742 17791 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:42.497269 13131 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:42.497681 13130 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
I20260709 12:20:42.496868 13878 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 7.
W20260709 12:20:42.497416 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 59475.3us
I20260709 12:20:42.436715 17875 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.465890 17810 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:42.415318 17605 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:42.609987 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 856) took 1656 ms. Trace:
I20260709 12:20:42.406927 17555 consensus_queue.cc:237] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.560398 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:42.520406 13103 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:42.540881 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:42.511117 13207 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
W20260709 12:20:42.597919 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:42.599612 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 54643.4us
W20260709 12:20:42.598539 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:42.510082 17712 consensus_meta.cc:287] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
W20260709 12:20:42.586483 17778 consensus_meta.cc:287] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
W20260709 12:20:42.517573 17644 consensus_meta.cc:287] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.003s
I20260709 12:20:42.643941 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:42.644721 13136 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:42.532565 17220 consensus_meta.cc:287] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 12:20:42.630463 13878 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:42.632899 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:42.637800 13278 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:42.658659 13130 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:20:42.638075 13137 rpcz_store.cc:276] 0709 12:20:40.953892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.019844 (+ 65952us) service_pool.cc:224] Handling call
0709 12:20:41.073747 (+ 53903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.074933 (+  1186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.074977 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:41.075036 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:41.075088 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.609748 (+1534660us) spinlock_profiling.cc:243] Waited 954 us on lock 0x7b54003ac5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:42.609797 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.609920 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2194304}
I20260709 12:20:42.640069 17898 raft_consensus.cc:3055] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:42.641582 17605 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:42.659473 17898 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:42.659526 17814 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:42.660204 17814 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:42.659535 17866 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:20:42.636855 13249 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:42.497869 17815 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:42.501133 17838 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:42.662762 17838 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:42.663031 17815 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.511587 17808 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:42.660502 17898 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.665217 17808 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:42.665621 17808 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:42.650125 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:42.667711 13131 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:42.682078 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:42.683327 13137 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 11: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:42.686053 13137 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:20:42.481117 17658 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:42.605532 17800 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:42.533759 17877 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:42.539358 17881 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:42.528086 17883 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:42.513105 17879 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:42.507402 17606 consensus_queue.cc:1059] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.189s
I20260709 12:20:42.529950 17774 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.641793 17810 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.501679 17724 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.501616 17767 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.529867 17550 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.504118 17621 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.336s
I20260709 12:20:42.533595 17888 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.618s
I20260709 12:20:42.519187 17811 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.533362 17889 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.574s
W20260709 12:20:43.109166 13284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.014s	sys 0.013s
W20260709 12:20:42.769776 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.408860 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3029) took 1090 ms. Trace:
W20260709 12:20:42.869562 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:42.713840 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 194455us
W20260709 12:20:43.410763 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.532743 17893 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:43.412174 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:43.412508 13286 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:43.073770 13136 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
W20260709 12:20:43.407897 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 771023us
I20260709 12:20:43.426255 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:43.372141 17717 consensus_meta.cc:287] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 1.084s	user 0.011s	sys 0.001s
I20260709 12:20:43.430938 13278 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:20:43.434007 13278 pending_rounds.cc:85] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 6
I20260709 12:20:42.714661 13131 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
W20260709 12:20:42.929840 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:43.243131 17851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.000s	sys 0.008s
I20260709 12:20:42.651563 17802 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:43.403023 17870 consensus_meta.cc:287] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.177s	user 0.011s	sys 0.002s
W20260709 12:20:43.075253 17780 consensus_meta.cc:287] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.887s	user 0.008s	sys 0.004s
I20260709 12:20:43.042160 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:43.431026 13880 raft_consensus.cc:1240] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:43.445206 13203 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:42.539880 17782 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.934s
I20260709 12:20:42.689178 17778 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.434069 17586 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:43.326572 17887 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.327700 17727 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.689357 17644 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:42.700191 17220 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:43.362911 17884 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:43.407845 17898 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:43.438092 13879 raft_consensus.cc:2368] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:20:43.136507 17725 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:43.162778 17764 raft_consensus.cc:3055] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:43.102809 17583 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:43.136184 17892 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:42.928097 17842 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:43.416817 17800 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.497813 17800 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:43.503619 17220 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.504200 17220 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.506389 17220 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:43.042840 17785 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:42.649761 17712 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:43.510532 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1821) took 1800 ms. Trace:
W20260709 12:20:43.436376 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.419396 17893 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.939724 17651 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.501s
I20260709 12:20:43.348361 17900 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:43.432844 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:43.438990 17851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.000s	sys 0.009s
I20260709 12:20:42.927508 17891 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:43.457688 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:43.433530 17757 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.435298 17836 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:43.556071 17808 consensus_meta.cc:287] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.890s	user 0.010s	sys 0.002s
I20260709 12:20:43.556236 17836 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.556741 17808 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.421442 17606 consensus_queue.cc:1243] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:43.434592 13278 pending_rounds.cc:107] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 8.7
W20260709 12:20:43.465214 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.430514 17810 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:43.558291 13278 raft_consensus.cc:2889] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:43.559190 13278 pending_rounds.cc:107] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:20:43.559482 13278 raft_consensus.cc:2889] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:43.475471 13203 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:43.460937 17586 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.435930 17717 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:43.496099 13283 raft_consensus.cc:1240] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:43.496830 17882 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:20:43.497287 17658 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:43.575963 17808 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:43.511077 13206 rpcz_store.cc:276] 0709 12:20:41.710008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.727271 (+ 17263us) service_pool.cc:224] Handling call
0709 12:20:43.510293 (+1783022us) spinlock_profiling.cc:243] Waited 93.7 ms on lock 0x7b54000b7554. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:43.510451 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215510400}
I20260709 12:20:43.445755 17802 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:43.530824 13177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.012s	sys 0.019s
W20260709 12:20:43.586154 13177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.012s	sys 0.019s
I20260709 12:20:43.493829 17892 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.544648 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1822) took 1834 ms. Trace:
I20260709 12:20:43.600636 13204 rpcz_store.cc:276] 0709 12:20:41.710295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.710408 (+   113us) service_pool.cc:224] Handling call
0709 12:20:41.710754 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.192566 (+481812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.544331 (+1351765us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54002f08d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:43.544570 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106420608}
I20260709 12:20:43.602666 13204 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:43.492137 17881 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.493645 17764 raft_consensus.cc:740] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:43.552979 13212 raft_consensus.cc:2393] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:43.466028 17727 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:43.561267 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:43.422593 17877 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.532714 17893 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:43.581478 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:43.592161 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.476468 17887 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:43.661552 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.615249 13204 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:43.573638 17790 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:43.494371 17583 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.494048 17884 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:43.571854 17901 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.651446 13206 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:43.565722 17586 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:43.658535 13203 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:43.476744 17883 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:43.670487 17877 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:43.663240 13249 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:43.702549 13249 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:43.672832 17717 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:43.676215 17767 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:43.680658 17908 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:20:43.681985 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 889) took 1205 ms. Trace:
I20260709 12:20:43.684466 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:43.684607 17724 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:43.559715 17891 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:43.623915 17772 consensus_meta.cc:287] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.126s	user 0.006s	sys 0.005s
W20260709 12:20:43.625217 17838 consensus_meta.cc:287] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.962s	user 0.003s	sys 0.007s
W20260709 12:20:43.690332 13178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.018s	sys 0.012s
W20260709 12:20:43.693576 13132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.022s	sys 0.039s
W20260709 12:20:43.728407 13178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.018s	sys 0.012s
W20260709 12:20:43.728549 13132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.023s	sys 0.039s
I20260709 12:20:43.614217 17892 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:43.696664 13100 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.011s	sys 0.021s
W20260709 12:20:43.733065 13100 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.011s	sys 0.021s
W20260709 12:20:43.733431 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 557686us
I20260709 12:20:43.710773 17774 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:43.699673 17783 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:43.700332 17901 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:43.707499 13130 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.006s	sys 0.031s
I20260709 12:20:43.567528 17757 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.712844 13249 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:43.650137 17881 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.715881 13880 rpcz_store.cc:276] 0709 12:20:42.476591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.476817 (+   226us) service_pool.cc:224] Handling call
0709 12:20:42.477243 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.445303 (+968060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.681672 (+236369us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b5400456d54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:43.681905 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193015552}
I20260709 12:20:43.714672 17910 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:43.749620 17910 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.543735 17900 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:43.751027 17906 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:20:43.714015 17764 consensus_queue.cc:260] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:43.714876 17909 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:43.749879 17606 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:43.751931 17909 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:43.752364 17909 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:43.743182 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:43.716897 17877 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:43.726451 17800 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:43.838677 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.846287 13249 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:43.737097 17778 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:43.900986 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 54825.1us
I20260709 12:20:43.905224 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:43.908651 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:43.911242 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3035) took 1351 ms. Trace:
W20260709 12:20:43.912825 13100 leader_election.cc:336] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.775s (SENT)
I20260709 12:20:43.913424 13100 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:43.911767 13282 rpcz_store.cc:276] 0709 12:20:42.560160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.560274 (+   114us) service_pool.cc:224] Handling call
0709 12:20:42.629295 (+ 69021us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:42.629749 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.629786 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:42.657272 (+ 27486us) log.cc:844] Serialized 52 byte log entry
0709 12:20:43.492420 (+835148us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:43.492477 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.492572 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.740527 (+247955us) raft_consensus.cc:1685] finished
0709 12:20:43.740546 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.911167 (+170621us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18123,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":41799,"thread_start_us":451395,"threads_started":1,"wal-append.queue_time_us":784089}
I20260709 12:20:43.922683 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:20:43.904513 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 458104us
I20260709 12:20:43.785176 17606 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:43.934446 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:43.935309 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.803987 17782 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.936378 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:43.729846 17772 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.756616 17877 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:43.945356 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.785534 17634 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.888891 17764 raft_consensus.cc:3060] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:43.733592 17838 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:43.756359 17851 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:43.827675 17774 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.944254 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 858) took 2965 ms. Trace:
I20260709 12:20:43.762820 17644 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:43.921383 17870 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:20:43.928520 17605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.023s	sys 0.034s
W20260709 12:20:43.955493 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.906390 17811 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:43.905648 17717 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.960664 13135 rpcz_store.cc:276] 0709 12:20:40.955525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.355486 (+399961us) service_pool.cc:224] Handling call
0709 12:20:41.355758 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.905637 (+549879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.921061 (+2015424us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b540010d1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:43.921231 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238689024}
I20260709 12:20:43.756858 17783 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:43.953295 17877 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:43.971326 13209 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:43.944892 17808 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:43.954288 17851 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.957867 17606 raft_consensus.cc:697] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:43.977258 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.977409 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:43.977167 13103 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:20:43.968510 17605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.023s	sys 0.035s
W20260709 12:20:43.998792 17880 consensus_meta.cc:287] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.401s	user 0.011s	sys 0.000s
I20260709 12:20:43.980543 17808 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.980511 17920 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.990206 13208 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:44.033843 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:43.994081 13286 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:43.975929 17717 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.998091 17783 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:43.960834 17634 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:43.999181 17905 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:20:43.972522 17870 raft_consensus.cc:697] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:44.004303 17881 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:44.005229 17884 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:44.005693 17921 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:44.006137 17545 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:44.011494 17838 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:44.012014 17606 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.971302 17658 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:20:43.975536 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:44.079707 13282 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:43.973417 17900 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:44.013579 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1611) took 1583 ms. Trace:
I20260709 12:20:44.080797 13132 rpcz_store.cc:276] 0709 12:20:42.430303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.430468 (+   165us) service_pool.cc:224] Handling call
0709 12:20:42.430877 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:42.431318 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.431352 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:42.442247 (+ 10895us) log.cc:844] Serialized 26 byte log entry
0709 12:20:43.729117 (+1286870us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:43.729161 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.729264 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:44.013294 (+284030us) raft_consensus.cc:1685] finished
0709 12:20:44.013327 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:44.013502 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15969,"raft.queue_time_us":5945,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":18221,"thread_start_us":1229633,"threads_started":1,"wal-append.queue_time_us":1475443}
I20260709 12:20:44.017664 17586 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:44.022459 17727 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:44.018368 13281 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
W20260709 12:20:44.097308 13281 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2249) took 1457 ms (client timeout 1519 ms). Trace:
I20260709 12:20:43.991582 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:44.029309 17757 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:43.987448 17851 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:43.978891 17712 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:43.965140 17774 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:43.987622 17811 consensus_queue.cc:1059] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:20:44.027207 17802 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:44.030682 17772 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:44.098457 17798 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:44.026997 17891 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:44.025467 17893 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:44.123500 17808 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:44.041054 17587 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.124243 17587 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:44.059593 17910 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:44.125089 17893 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:43.957013 17782 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:44.096071 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 864) took 1464 ms. Trace:
I20260709 12:20:44.125715 13130 rpcz_store.cc:276] 0709 12:20:42.632078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.690846 (+ 58768us) service_pool.cc:224] Handling call
0709 12:20:42.986375 (+295529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.986656 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:43.741333 (+754677us) log.cc:844] Serialized 14 byte log entry
0709 12:20:44.095679 (+354346us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:44.095741 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:44.095793 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.095872 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:44.096014 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":182167,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":65995,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":3467,"thread_start_us":1043439,"threads_started":2}
I20260709 12:20:44.126961 17782 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:44.034873 13210 raft_consensus.cc:2410] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:20:44.098184 13203 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:44.033736 17880 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:44.128481 17918 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:20:44.129004 13886 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:44.097873 13281 rpcz_store.cc:269] 0709 12:20:42.679312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.832369 (+153057us) service_pool.cc:224] Handling call
0709 12:20:43.684247 (+851878us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b5800183f98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:20:44.097223 (+412976us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8434048}
I20260709 12:20:44.129726 17880 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:44.130265 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:44.130913 13281 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:44.117542 17757 raft_consensus.cc:3055] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:44.133939 17757 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:44.101589 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 137764us
I20260709 12:20:44.111625 13282 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:44.041213 17920 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:44.038462 17898 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.561s	user 0.002s	sys 0.008s
I20260709 12:20:44.116447 17545 consensus_queue.cc:1243] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:20:44.118971 17923 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 12:20:44.083509 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 172825us
I20260709 12:20:44.128412 17634 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:44.082870 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:44.104240 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 98927.7us
I20260709 12:20:44.158378 13286 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:44.135870 13281 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:20:44.138183 17891 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.159795 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:44.139786 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:44.142426 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.108129 17921 raft_consensus.cc:697] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:44.145947 13886 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
W20260709 12:20:44.148286 17791 consensus_meta.cc:287] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.503s	user 0.012s	sys 0.000s
I20260709 12:20:44.151198 17836 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:44.141227 17757 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:44.156683 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:44.157629 13135 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:44.134189 17892 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:44.265367 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:44.266671 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:44.192147 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:44.268601 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:44.269636 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:44.213297 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:44.271231 13882 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
W20260709 12:20:44.229792 13879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 886) took 1810 ms (client timeout 1867 ms). Trace:
W20260709 12:20:44.273383 13879 rpcz_store.cc:269] 0709 12:20:42.419299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.435035 (+ 15736us) service_pool.cc:224] Handling call
0709 12:20:44.229509 (+1794474us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b540036a6d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:44.229708 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2224569728}
I20260709 12:20:44.267221 13282 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:44.193233 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:44.275952 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:44.276726 13133 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:44.191597 13130 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:44.269598 13887 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:44.278826 13208 raft_consensus.cc:2410] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:44.279819 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:44.282637 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.283272 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.283838 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.284869 13885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 816) took 2219 ms. Trace:
I20260709 12:20:44.285250 13885 rpcz_store.cc:276] 0709 12:20:42.065202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.068466 (+  3264us) service_pool.cc:224] Handling call
0709 12:20:42.068725 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.204050 (+135325us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:42.251555 (+ 47505us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.428752 (+177197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:42.428832 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:42.428898 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.981197 (+1552299us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b18003a03c0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:44.284656 (+303459us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400729554. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:44.284714 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:44.284824 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42154,"raft.queue_time_us":12693,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":12310,"spinlock_wait_cycles":369712256,"thread_start_us":164171,"threads_started":1,"wal-append.queue_time_us":268383}
W20260709 12:20:44.213457 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 65620.6us
I20260709 12:20:44.296689 13208 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 11: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:44.296782 13102 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:44.297667 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.278219 17800 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:44.300755 13210 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:20:44.300321 17802 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:20:44.306747 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:44.300179 17931 consensus_queue.cc:1059] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:20:44.307366 13210 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:44.312986 17802 raft_consensus.cc:3055] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:20:44.300999 17790 consensus_meta.cc:287] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.002s
I20260709 12:20:44.300165 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:44.309002 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:44.314003 13277 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:20:44.314296 17550 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:44.314563 17903 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.300733 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:44.315553 13203 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:44.313432 17802 raft_consensus.cc:740] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:44.317152 13207 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:20:44.316640 17802 consensus_queue.cc:260] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:44.318010 17802 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:44.300437 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:44.317519 13207 pending_rounds.cc:85] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 8
I20260709 12:20:44.299044 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:44.322589 13207 pending_rounds.cc:107] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:20:44.322948 13207 raft_consensus.cc:2889] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:44.328631 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:44.168547 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:44.331126 13128 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:44.298476 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:44.193994 13103 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:44.334774 13207 raft_consensus.cc:1240] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:20:44.339624 13881 raft_consensus.cc:2368] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:20:44.340262 13286 raft_consensus.cc:2410] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:20:44.336071 13203 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:44.341652 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:44.342242 13130 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:44.338653 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:44.343899 13282 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
W20260709 12:20:44.344426 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 47772.2us
I20260709 12:20:44.345043 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:44.342264 13249 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:44.194099 17910 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:44.315043 17903 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:44.356925 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.233026 17882 consensus_queue.cc:1059] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 1.011s
I20260709 12:20:44.327224 17891 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:44.191742 17898 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:45.244419 13210 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:45.244338 17898 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:44.364617 17791 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.246556 17891 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.246755 17898 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:44.144347 17894 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:20:45.247355 17791 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:44.234318 17901 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:45.149318 17885 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 2.665s	user 0.016s	sys 0.012s
I20260709 12:20:44.339999 17900 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.233268 17658 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:44.301534 17717 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:44.275418 17634 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:44.372136 17929 log.cc:927] Time spent T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:20:44.162285 17808 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:45.250340 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2157) took 1092 ms. Trace:
I20260709 12:20:44.155982 17870 consensus_queue.cc:237] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:45.250823 17630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.002s	sys 0.003s
W20260709 12:20:44.418879 17909 consensus_meta.cc:287] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.000s
I20260709 12:20:44.419953 17586 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:44.418635 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 224718us
I20260709 12:20:44.462816 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:45.299542 13131 rpcz_store.cc:276] 0709 12:20:44.157689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.157836 (+   147us) service_pool.cc:224] Handling call
0709 12:20:44.287193 (+129357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:44.312441 (+ 25248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:44.312473 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:44.312944 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:20:44.390710 (+ 77766us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:44.390752 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.390823 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.250120 (+859297us) raft_consensus.cc:1685] finished
0709 12:20:45.250139 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.250283 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":77354,"threads_started":1,"wal-append.queue_time_us":935367}
W20260709 12:20:44.425410 13841 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.11.163.62:33937, user_credentials={real_user=slave}} blocked reactor thread for 78819.4us
I20260709 12:20:45.301299 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2259) took 1158 ms. Trace:
I20260709 12:20:44.435335 13133 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:45.302747 13286 rpcz_store.cc:276] 0709 12:20:44.142408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.341324 (+198916us) service_pool.cc:224] Handling call
0709 12:20:45.301241 (+959917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.290616 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:45.248467 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.478910 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 140051us
I20260709 12:20:45.304843 13282 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:45.305440 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2255) took 1164 ms. Trace:
I20260709 12:20:45.307260 17759 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:45.306252 17808 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.312364 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.303081 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2160) took 1110 ms. Trace:
I20260709 12:20:45.313740 13133 rpcz_store.cc:276] 0709 12:20:44.192322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.192922 (+   600us) service_pool.cc:224] Handling call
0709 12:20:45.303022 (+1110100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.318220 13881 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 14. Ops: []
I20260709 12:20:45.319520 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:45.303593 17630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.003s	sys 0.004s
I20260709 12:20:44.578640 13177 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:45.305738 13282 rpcz_store.cc:276] 0709 12:20:44.140912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.290248 (+1149336us) service_pool.cc:224] Handling call
0709 12:20:45.305381 (+ 15133us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:44.671512 17851 consensus_meta.cc:287] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.558s	user 0.003s	sys 0.007s
I20260709 12:20:45.252079 17892 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:44.346858 17751 consensus_queue.cc:1059] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.973s
I20260709 12:20:45.319617 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:44.416816 17921 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:45.322395 13130 consensus_meta.cc:287] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.980s	user 0.007s	sys 0.004s
I20260709 12:20:45.634631 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:45.635007 13130 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:45.636444 13131 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:45.636569 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 868) took 1313 ms. Trace:
I20260709 12:20:45.637344 13130 rpcz_store.cc:276] 0709 12:20:44.323113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.341427 (+ 18314us) service_pool.cc:224] Handling call
0709 12:20:45.636419 (+1294992us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.639135 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:45.640386 13130 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:45.644424 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1625) took 1698 ms. Trace:
I20260709 12:20:45.323310 13175 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:45.645028 13137 rpcz_store.cc:276] 0709 12:20:43.946151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.946268 (+   117us) service_pool.cc:224] Handling call
0709 12:20:43.946583 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:43.947097 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:43.947133 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:43.947661 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:20:44.041295 (+ 93634us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:44.041342 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.041415 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.643731 (+1602316us) raft_consensus.cc:1685] finished
0709 12:20:45.643774 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.644135 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2757,"raft.queue_time_us":7104,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":2728,"spinlock_wait_cycles":1985920,"thread_start_us":72716,"threads_started":1,"wal-append.queue_time_us":188802}
W20260709 12:20:45.647068 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 323714us
I20260709 12:20:45.648586 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:45.652375 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:45.652789 13131 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
W20260709 12:20:45.470518 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 1.1282e+06us
I20260709 12:20:45.661513 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:45.661836 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:45.424103 13277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2243) took 3533 ms (client timeout 2202 ms). Trace:
I20260709 12:20:43.409340 13284 rpcz_store.cc:276] 0709 12:20:42.318064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.324044 (+  5980us) service_pool.cc:224] Handling call
0709 12:20:42.324381 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.324658 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:42.601816 (+277158us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.408528 (+806712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.408583 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:43.408632 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.408697 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.408807 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21255,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4997,"raft.queue_time_us":98,"thread_start_us":1069315,"threads_started":2}
I20260709 12:20:45.377540 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:45.671988 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.673178 13286 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:45.673635 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:45.674019 13286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2258) took 1531 ms (client timeout 1983 ms). Trace:
W20260709 12:20:45.675457 13286 rpcz_store.cc:269] 0709 12:20:44.142164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.303957 (+1161793us) service_pool.cc:224] Handling call
0709 12:20:45.673853 (+369896us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.676306 13249 leader_election.cc:400] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:20:45.676834 13249 leader_election.cc:403] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:20:45.677802 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:45.686364 13286 raft_consensus.cc:2410] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:20:45.680850 13102 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:45.383445 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.322638 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:20:45.674218 13277 rpcz_store.cc:269] 0709 12:20:41.890644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.893344 (+  2700us) service_pool.cc:224] Handling call
0709 12:20:45.423819 (+3530475us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b54004088d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:45.423981 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5540236672}
I20260709 12:20:45.686535 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:45.674755 13278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 3046) took 1526 ms (client timeout 2011 ms). Trace:
W20260709 12:20:45.688696 13278 rpcz_store.cc:269] 0709 12:20:44.148071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.660419 (+1512348us) service_pool.cc:224] Handling call
0709 12:20:45.674656 (+ 14237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.692301 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 871) took 1297 ms. Trace:
I20260709 12:20:45.247383 17898 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.695871 17779 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.322623 17587 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.697033 17779 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:45.312541 17634 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:44.372295 17545 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:45.701625 17545 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:45.702135 17545 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:45.694854 13131 rpcz_store.cc:276] 0709 12:20:44.371835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.633690 (+1261855us) service_pool.cc:224] Handling call
0709 12:20:45.669504 (+ 35814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:44.506068 17712 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:45.703858 17541 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.704413 17712 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.704936 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:45.704732 17541 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.706024 17717 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:45.706614 17717 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:45.707062 17717 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:45.567862 17814 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:45.320746 17877 consensus_meta.cc:287] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.325s	user 0.007s	sys 0.006s
I20260709 12:20:45.708264 17772 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:45.708611 17541 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.709273 17541 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.248297 17901 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:45.709373 17772 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:45.710487 17901 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.710130 17541 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.710933 17901 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:45.704972 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.564980 17725 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:45.712399 17725 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:45.712911 17814 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.713743 17814 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.714825 17541 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.252985 17757 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:45.712927 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:44.490757 17800 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:45.383625 17937 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:45.717478 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.717676 17937 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:44.424784 17838 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:45.718384 17937 raft_consensus.cc:697] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:45.718863 17838 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.719501 17541 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:45.720446 17814 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:45.720250 17541 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.720574 13838 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:45.721498 17838 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.722368 17944 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:45.722223 17838 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:45.722805 17541 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.723008 17944 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:45.723675 13131 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:45.309160 17658 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.418866 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:45.726507 17658 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.726639 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:45.727735 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2164) took 1412 ms. Trace:
I20260709 12:20:45.727931 17870 raft_consensus.cc:3060] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:45.728353 13130 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:45.729374 17586 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.729663 17772 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:45.730294 17772 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.729971 17586 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.731778 17791 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.731902 17798 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:45.732678 17798 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:45.309077 17910 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:45.736001 17851 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:45.715984 13884 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:45.717165 17800 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.719233 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.697155 17898 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.724673 17944 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.728322 13137 rpcz_store.cc:276] 0709 12:20:44.314838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.651890 (+1337052us) service_pool.cc:224] Handling call
0709 12:20:45.727604 (+ 75714us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.737368 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 867) took 1426 ms. Trace:
I20260709 12:20:45.746093 13130 rpcz_store.cc:276] 0709 12:20:44.311303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.638711 (+1327408us) service_pool.cc:224] Handling call
0709 12:20:45.737302 (+ 98591us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:44.460525 17875 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:45.741925 13284 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:45.420291 17882 raft_consensus.cc:3055] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:45.742303 17910 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:45.555064 17808 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:45.743494 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 63129.5us
I20260709 12:20:45.736915 17798 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:45.743731 17791 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.783916 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.752409 17937 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.784722 13881 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:45.785743 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.786159 17791 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.786984 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:45.741117 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 3048) took 1590 ms. Trace:
I20260709 12:20:45.849325 13286 rpcz_store.cc:276] 0709 12:20:44.148575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.677267 (+1528692us) service_pool.cc:224] Handling call
0709 12:20:45.738650 (+ 61383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.744896 17898 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.747773 17892 raft_consensus.cc:3055] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:45.749063 17634 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:45.709404 17877 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:45.727349 17658 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:45.857170 17658 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.961814 17920 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.752735 13278 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:20:45.768524 13131 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:20:45.421653 17638 raft_consensus.cc:3055] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:45.743784 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.762876 17779 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:45.415835 17679 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:45.791662 13100 leader_election.cc:336] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.605s (SENT)
I20260709 12:20:45.791922 17882 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:45.778743 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 3047) took 1628 ms. Trace:
I20260709 12:20:45.793433 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:45.794312 13134 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2149) took 3403 ms (client timeout 1851 ms). Trace:
I20260709 12:20:45.795001 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:45.797286 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3082) took 3145 ms. Trace:
I20260709 12:20:45.798645 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3080) took 3192 ms. Trace:
I20260709 12:20:45.873237 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2253) took 1943 ms. Trace:
I20260709 12:20:45.803694 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:45.804327 13212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1834) took 3883 ms (client timeout 1530 ms). Trace:
I20260709 12:20:45.804426 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 945) took 1431 ms. Trace:
I20260709 12:20:45.809672 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3045) took 1663 ms. Trace:
I20260709 12:20:45.809414 17901 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.739876 17541 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.812198 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2230) took 4044 ms. Trace:
I20260709 12:20:45.795022 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:45.874548 13280 rpcz_store.cc:276] 0709 12:20:44.146431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.808236 (+1661805us) service_pool.cc:224] Handling call
0709 12:20:45.808705 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:45.809071 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.809110 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:45.809186 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:45.809256 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.809311 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.809482 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.812486 17545 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.814157 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:45.815706 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 1.19087e+06us
I20260709 12:20:45.752935 17879 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:45.750932 17800 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.882251 13177 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:45.882612 17545 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.816656 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:45.883571 13203 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:45.884725 17901 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.818281 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:45.885578 13137 raft_consensus.cc:2368] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9.
I20260709 12:20:45.885679 17879 raft_consensus.cc:697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:45.886304 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.886696 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:45.876621 17638 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:45.887579 13879 raft_consensus.cc:2410] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 12:20:45.888026 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 96572us
I20260709 12:20:44.621277 17774 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.821432 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.888613 17638 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.889771 13878 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:45.890105 17638 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:45.890755 13136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2156) took 1734 ms (client timeout 1678 ms). Trace:
I20260709 12:20:45.890877 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:20:45.872722 13134 rpcz_store.cc:269] 0709 12:20:42.390450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.390560 (+   110us) service_pool.cc:224] Handling call
0709 12:20:45.793846 (+3403286us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b54001f4ad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:45.794060 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13097728}
W20260709 12:20:45.891171 13136 rpcz_store.cc:269] 0709 12:20:44.156314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.156447 (+   133us) service_pool.cc:224] Handling call
0709 12:20:45.794593 (+1638146us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800001298. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:20:45.890666 (+ 96073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27462912}
I20260709 12:20:45.892340 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.892390 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:45.819751 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.822938 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.893556 13134 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:45.894527 13880 raft_consensus.cc:2410] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:20:45.894070 17882 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.895277 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:45.834142 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 50777.5us
I20260709 12:20:45.878937 17541 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.895754 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:45.896418 13134 raft_consensus.cc:2410] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:45.897225 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.897421 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:45.898303 13134 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:20:45.835587 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.898599 17541 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.898718 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.824615 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.899467 17808 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.900020 13137 raft_consensus.cc:2368] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:45.900439 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:45.826038 13886 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 899) took 1903 ms (client timeout 1617 ms). Trace:
I20260709 12:20:45.900058 17808 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:45.901564 13886 rpcz_store.cc:269] 0709 12:20:43.922165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.922435 (+   270us) service_pool.cc:224] Handling call
0709 12:20:45.825633 (+1903198us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400691ed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:45.825795 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472949504}
I20260709 12:20:45.901382 13887 raft_consensus.cc:2368] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:45.903240 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:45.903708 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.903977 13886 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:20:45.905103 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.837004 17870 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:20:45.892832 17679 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.909446 13882 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
W20260709 12:20:45.910050 13882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 827) took 1603 ms (client timeout 1609 ms). Trace:
I20260709 12:20:45.910298 17781 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:45.910482 13882 rpcz_store.cc:269] 0709 12:20:44.306499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.819266 (+1512767us) service_pool.cc:224] Handling call
0709 12:20:45.909993 (+ 90727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.911155 17781 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.838855 17725 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:45.846632 17727 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:45.308183 17909 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:45.911604 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:45.853849 17892 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:45.311419 17900 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.763302 13282 raft_consensus.cc:2393] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 8: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:45.911875 17779 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:45.922590 17779 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.917011 13280 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:45.853183 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 203543us
I20260709 12:20:45.730966 17772 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:45.756743 17712 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.860381 13277 raft_consensus.cc:1240] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:20:45.867734 13884 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:45.873724 13278 rpcz_store.cc:276] 0709 12:20:43.927902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.751515 (+1823613us) service_pool.cc:224] Handling call
0709 12:20:45.752211 (+   696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:45.870608 (+118397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.870837 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.913913 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:45.874415 13207 rpcz_store.cc:276] 0709 12:20:44.372932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.802961 (+1430029us) service_pool.cc:224] Handling call
0709 12:20:45.803670 (+   709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:45.803904 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.803927 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:45.803994 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:45.804022 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.804076 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.804202 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.859547 17658 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:45.873992 13212 rpcz_store.cc:269] 0709 12:20:41.920931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.921049 (+   118us) service_pool.cc:224] Handling call
0709 12:20:45.803730 (+3882681us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54002d5854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:45.804020 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3737942400}
I20260709 12:20:45.872352 13132 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:45.873092 13206 rpcz_store.cc:276] 0709 12:20:42.652104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.580340 (+928236us) service_pool.cc:224] Handling call
0709 12:20:43.580723 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.696940 (+116217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.796650 (+2099710us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b54002d5d54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:45.796990 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100547328}
I20260709 12:20:45.877159 13285 rpcz_store.cc:276] 0709 12:20:41.767354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.767509 (+   155us) service_pool.cc:224] Handling call
0709 12:20:41.768004 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.223263 (+455259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.811675 (+3588412us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b540023cb54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:45.812022 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987456384}
I20260709 12:20:45.873565 13209 rpcz_store.cc:276] 0709 12:20:42.605773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.562577 (+956804us) service_pool.cc:224] Handling call
0709 12:20:43.562929 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.975200 (+412271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.798071 (+1822871us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b540002f154. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:45.798455 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938605952}
I20260709 12:20:45.880358 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:45.880550 13208 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:45.880725 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:45.932454 13132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2161) took 1670 ms (client timeout 1568 ms). Trace:
I20260709 12:20:45.893625 17903 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.837402 17583 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.837512 13838 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:45.892416 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:45.888863 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:45.893347 13878 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:45.886996 17879 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.920136 17727 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:45.920782 17877 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:45.911917 13134 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:45.856230 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:45.927021 13131 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:45.871977 13284 rpcz_store.cc:276] 0709 12:20:44.148337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.672994 (+1524657us) service_pool.cc:224] Handling call
0709 12:20:45.777010 (+104016us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:45.919669 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2150) took 3528 ms. Trace:
I20260709 12:20:45.959224 13878 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:45.948680 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:45.859807 17717 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:45.884655 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:45.914343 17800 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:45.915632 17882 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:45.940968 17781 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.941558 13177 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:45.943868 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:45.945160 13136 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:45.947999 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:45.948463 13885 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:45.948737 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:45.949460 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:45.949851 13207 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:45.915031 17875 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:45.950734 17772 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:45.951442 13176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.010s	sys 0.001s
I20260709 12:20:45.951640 17901 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:45.953004 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.954093 17708 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:45.955533 17903 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:45.933043 13132 rpcz_store.cc:269] 0709 12:20:44.261796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.274636 (+ 12840us) service_pool.cc:224] Handling call
0709 12:20:45.793057 (+1518421us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5800001298. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:20:45.932359 (+139302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47359232}
I20260709 12:20:45.959769 13886 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
W20260709 12:20:45.960462 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 192275us
I20260709 12:20:45.964393 13130 raft_consensus.cc:2410] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:20:45.966241 17725 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:45.959712 13878 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:45.911309 17679 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:45.973953 13134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 866) took 1649 ms. Trace:
I20260709 12:20:45.989998 13203 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:45.999949 17883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.065s	user 0.010s	sys 0.014s
I20260709 12:20:45.999877 17937 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:46.002607 13131 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:46.045607 13134 rpcz_store.cc:276] 0709 12:20:44.309873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.898914 (+1589041us) service_pool.cc:224] Handling call
0709 12:20:45.899339 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:45.959253 (+ 59914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.959462 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:46.027822 13212 raft_consensus.cc:2393] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 11: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:46.047117 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 870) took 1707 ms. Trace:
I20260709 12:20:46.025738 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.048189 13130 rpcz_store.cc:276] 0709 12:20:44.339353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.776973 (+1437620us) service_pool.cc:224] Handling call
0709 12:20:46.047057 (+270084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:46.005143 13206 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:46.004199 13176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.010s	sys 0.002s
I20260709 12:20:46.024262 13209 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
W20260709 12:20:46.050185 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 108774us
I20260709 12:20:45.959575 13129 rpcz_store.cc:276] 0709 12:20:42.390736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.391222 (+   486us) service_pool.cc:224] Handling call
0709 12:20:42.391566 (+   344us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:20:42.409794 (+ 18228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.409823 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:20:43.677012 (+1267189us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b2c00000c88. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:20:43.677890 (+   878us) log.cc:844] Serialized 78 byte log entry
0709 12:20:43.960317 (+282427us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:44.030525 (+ 70208us) log.cc:844] Serialized 14 byte log entry
0709 12:20:44.030774 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.031476 (+   702us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.904223 (+1872747us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b18003da4a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:45.919193 (+ 14970us) raft_consensus.cc:1685] finished
0709 12:20:45.919216 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.919478 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74535,"prepare.queue_time_us":71285,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":18999,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":29142,"spinlock_wait_cycles":12446208,"thread_start_us":281816,"threads_started":1,"wal-append.queue_time_us":384994}
W20260709 12:20:46.057003 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 167174us
W20260709 12:20:46.048236 17883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.147s	user 0.011s	sys 0.015s
I20260709 12:20:46.024590 17832 raft_consensus.cc:2804] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:46.059988 17712 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:46.044524 17800 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:46.045915 17708 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:46.004729 17875 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:46.068470 13131 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:46.069201 13132 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:20:46.003189 17727 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.070019 17634 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.076092 17727 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:46.061379 17937 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:46.076335 17634 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.077951 17881 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:46.078570 17881 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:46.079035 17881 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:46.079077 13136 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:46.065624 13841 connection.cc:256] RPC call timeout handler was delayed by -2.13539396200008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 12:20:46.079414 17634 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:46.057904 13100 leader_election.cc:336] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.659s (SENT)
W20260709 12:20:46.079963 13841 connection.cc:256] RPC call timeout handler was delayed by -2.0147939620001125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 12:20:46.080456 13841 connection.cc:256] RPC call timeout handler was delayed by -2.0138939620001111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:20:46.080843 13841 connection.cc:256] RPC call timeout handler was delayed by -1.9580939620000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
W20260709 12:20:46.081234 13841 connection.cc:256] RPC call timeout handler was delayed by -1.9310939619999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 12:20:46.081600 13841 connection.cc:256] RPC call timeout handler was delayed by -1.9085939619999408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 12:20:46.081929 13841 connection.cc:256] RPC call timeout handler was delayed by -1.8590939620000881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 12:20:46.082291 13841 connection.cc:256] RPC call timeout handler was delayed by -1.852793962000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 12:20:46.082619 13841 connection.cc:256] RPC call timeout handler was delayed by -1.6601939619999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 12:20:46.082990 13841 connection.cc:256] RPC call timeout handler was delayed by -1.6259939619999386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 12:20:46.078042 17937 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.081248 13175 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:46.088048 17946 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:46.088606 17946 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:46.083335 13841 connection.cc:256] RPC call timeout handler was delayed by -1.4837939619999361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
I20260709 12:20:46.090878 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 941) took 1820 ms. Trace:
I20260709 12:20:46.089006 17946 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:46.091346 13210 rpcz_store.cc:276] 0709 12:20:44.270362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.313427 (+ 43065us) service_pool.cc:224] Handling call
0709 12:20:44.313791 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:45.245095 (+931304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.090369 (+845274us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54002166d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:46.090677 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139740416}
I20260709 12:20:46.095382 17914 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:46.095893 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.095636 17725 consensus_queue.cc:1059] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:46.096338 17914 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.096909 17725 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:46.097793 17725 consensus_queue.cc:1243] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:46.097875 17772 raft_consensus.cc:3055] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:46.098387 17725 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:46.098506 17772 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:46.098726 17947 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.098912 17725 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:46.099417 17947 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.099975 17772 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.101481 17772 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:46.101826 17947 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.103634 13177 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:46.075719 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 112852us
W20260709 12:20:46.108340 13252 connection.cc:256] RPC call timeout handler was delayed by -2.1915413750000425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26940000000000003s for a response
W20260709 12:20:46.109340 13252 connection.cc:256] RPC call timeout handler was delayed by -1.7207582789999378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 12:20:46.111128 17852 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:46.111819 17796 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:46.112049 17877 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:46.112385 17796 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:46.112871 17796 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:46.112957 17877 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.116297 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 944) took 1845 ms. Trace:
I20260709 12:20:46.116431 17708 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.111887 17852 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.117775 17708 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:46.118353 17851 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:46.120503 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.121383 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.122020 17892 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.123716 13209 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:46.123989 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.125907 17877 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.126176 17887 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:46.116851 13204 rpcz_store.cc:276] 0709 12:20:44.271061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.321851 (+ 50790us) service_pool.cc:224] Handling call
0709 12:20:45.248079 (+926228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:45.734447 (+486368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.734498 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:45.734562 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:45.734598 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.115786 (+381188us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b540041c8d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:46.115837 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:46.116070 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117575552}
I20260709 12:20:46.127182 17903 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.119184 17586 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.128690 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.129585 17903 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:46.119155 17852 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.124992 13285 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:46.129354 13210 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:46.133744 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.134374 17717 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.134423 13278 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:20:46.136171 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3079) took 3535 ms. Trace:
I20260709 12:20:46.136996 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.137681 13285 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:46.136615 13205 rpcz_store.cc:276] 0709 12:20:42.600245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.600438 (+   193us) service_pool.cc:224] Handling call
0709 12:20:43.512194 (+911756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.512463 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:43.512505 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.512566 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:43.512621 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.512698 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:46.135824 (+2623126us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54000b7550. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:46.136001 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096008064}
I20260709 12:20:46.138998 17779 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.139657 17838 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:46.140560 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.140426 17838 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:46.142057 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.142664 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.142791 17838 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.143833 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.144321 17900 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.144683 13284 raft_consensus.cc:2393] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:46.146906 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.147383 13208 raft_consensus.cc:2410] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:46.148102 17717 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:46.148241 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.149060 13285 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:46.148708 17717 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.151228 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.088949 13838 leader_election.cc:400] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9.
I20260709 12:20:46.151932 13838 leader_election.cc:403] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:46.151865 13286 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:46.152424 17658 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.153131 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.153764 13286 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:46.154564 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.155076 17891 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.155714 17891 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.156975 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.157994 17891 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.158259 17800 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.155217 13280 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:46.160382 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2260) took 2017 ms. Trace:
I20260709 12:20:46.160750 13277 rpcz_store.cc:276] 0709 12:20:44.142649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.745006 (+1602357us) service_pool.cc:224] Handling call
0709 12:20:45.791648 (+ 46642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:45.930291 (+138643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.160103 (+229812us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b5400097ed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:46.160308 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151711616}
I20260709 12:20:46.161973 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.124495 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:46.162343 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 911) took 3752 ms. Trace:
I20260709 12:20:46.162623 13277 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:46.162950 17851 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:46.163542 17851 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:46.163936 17851 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:46.164278 13282 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2256) took 2022 ms (client timeout 2088 ms). Trace:
W20260709 12:20:46.164690 13282 rpcz_store.cc:269] 0709 12:20:44.141580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.661114 (+1519534us) service_pool.cc:224] Handling call
0709 12:20:46.164093 (+502979us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b54000974d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:46.164222 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165179776}
I20260709 12:20:46.165834 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.166483 13282 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
W20260709 12:20:46.167989 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 43808.2us
I20260709 12:20:46.180624 17808 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:46.183274 13887 raft_consensus.cc:2410] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:20:46.184900 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:46.185775 13132 raft_consensus.cc:2393] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:46.185688 17717 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.099071 17914 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:46.124716 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1823) took 4414 ms. Trace:
I20260709 12:20:46.187697 13211 rpcz_store.cc:276] 0709 12:20:41.710588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.710987 (+   399us) service_pool.cc:224] Handling call
0709 12:20:41.961584 (+250597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:41.966107 (+  4523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.966137 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:42.006080 (+ 39943us) log.cc:844] Serialized 26 byte log entry
0709 12:20:42.298799 (+292719us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:42.298857 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.298951 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:44.591474 (+2292523us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:45.409666 (+818192us) raft_consensus.cc:1685] finished
0709 12:20:45.409698 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:46.124296 (+714598us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54002161d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:46.124466 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38068,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":581477504,"thread_start_us":292277,"threads_started":1,"wal-append.queue_time_us":380629}
I20260709 12:20:46.190124 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:46.190605 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.168926 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:46.191808 13135 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:46.191862 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.192361 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2162) took 1917 ms. Trace:
I20260709 12:20:46.162761 13283 rpcz_store.cc:276] 0709 12:20:42.410061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.412553 (+  2492us) service_pool.cc:224] Handling call
0709 12:20:42.412802 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.566126 (+1153324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.161903 (+2595777us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400096ad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:46.162154 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2490734464}
I20260709 12:20:46.067651 17712 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:46.176136 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3040) took 2272 ms. Trace:
I20260709 12:20:46.177726 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:46.005299 17909 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:46.136219 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.146762 17781 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:46.190768 13211 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:46.168437 17658 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.158777 17891 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:46.070901 13878 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.196421 13280 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:46.161598 17725 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.200152 13881 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:46.192734 13135 rpcz_store.cc:276] 0709 12:20:44.275670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.276666 (+   996us) service_pool.cc:224] Handling call
0709 12:20:46.168598 (+1891932us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b5800001298. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e530a0 00007f70f9e52984 00007f70f33cd6d4 00007f70f33cd662
0709 12:20:46.192308 (+ 23710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48648960}
I20260709 12:20:46.209311 13100 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:46.054215 17901 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.193308 13281 rpcz_store.cc:276] 0709 12:20:43.903108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.131499 (+228391us) service_pool.cc:224] Handling call
0709 12:20:44.135593 (+  4094us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:44.159161 (+ 23568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.175711 (+2016550us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b540023c150. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:46.175946 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8635648}
W20260709 12:20:46.211058 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.210352 13277 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:46.204161 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:46.216572 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.215409 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.219791 13203 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:46.221670 13206 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
W20260709 12:20:46.223874 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 135112us
I20260709 12:20:46.198866 17712 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:46.226018 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.215807 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:46.226979 13282 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:46.227526 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:46.219954 13128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 865) took 1906 ms (client timeout 1885 ms). Trace:
I20260709 12:20:46.228274 13277 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:46.220671 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:46.231441 13137 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:46.228166 13128 rpcz_store.cc:269] 0709 12:20:44.308330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.177305 (+1868975us) service_pool.cc:224] Handling call
0709 12:20:46.214301 (+ 36996us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:46.213670 17781 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.239457 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:46.239574 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.246223 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:46.246927 13252 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:46.211633 17832 raft_consensus.cc:697] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:46.247925 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.246256 13102 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:46.256208 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.258121 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:46.259665 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 181117us
I20260709 12:20:46.235885 17638 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9.
I20260709 12:20:46.256031 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.265122 13132 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:20:46.260408 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.265352 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.260497 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.266120 13277 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
W20260709 12:20:46.266897 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.270030 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.270777 13840 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.519s (SENT) [suppressed 18 similar messages]
W20260709 12:20:46.275318 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.277738 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 219906us
I20260709 12:20:46.278507 13278 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:46.284056 13878 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:46.284178 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:46.285650 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 74309.3us
I20260709 12:20:46.251096 17725 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:46.285017 13128 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:46.292161 13133 raft_consensus.cc:2393] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:46.293861 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.294695 13887 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:20:46.298317 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:46.299719 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.300828 13212 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:20:46.297158 13886 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:46.295045 13887 pending_rounds.cc:85] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: Aborting all ops after (but not including) 8
I20260709 12:20:46.304397 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.308619 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.309327 13277 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:46.251519 17891 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.312304 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:46.264333 17909 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:46.288506 17876 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:46.315730 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.318437 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:46.319240 13128 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:46.323956 13135 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:20:46.324633 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.325438 13210 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 7.
I20260709 12:20:46.325682 17832 consensus_queue.cc:237] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.326545 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.327572 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.328298 13205 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:46.329345 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:46.330447 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.304276 13887 pending_rounds.cc:107] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:20:46.332050 17781 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:46.332435 13887 raft_consensus.cc:2889] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:46.334031 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:46.335878 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.335564 13032 catalog_manager.cc:5697] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 4 to 6, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 6 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:46.336731 13203 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:46.337841 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.338524 13203 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
W20260709 12:20:46.339155 13100 leader_election.cc:336] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.734s (SENT)
I20260709 12:20:46.323765 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.339354 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.346493 13177 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:46.327270 13210 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:46.356823 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.345113 13280 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
W20260709 12:20:46.360030 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 132781us
I20260709 12:20:46.340044 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.362238 13131 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 7.
I20260709 12:20:46.372974 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.373709 13280 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:20:46.303802 17879 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:46.382616 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.384660 13204 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:46.385330 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.387197 13277 raft_consensus.cc:2368] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9.
I20260709 12:20:46.338539 17881 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.394531 17560 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:46.395344 13205 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:46.395004 17560 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:46.434317 17937 consensus_queue.cc:1059] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:20:46.444057 17937 raft_consensus.cc:3055] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:46.444448 17937 raft_consensus.cc:740] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:46.445431 17937 consensus_queue.cc:260] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:46.455215 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 239326us
I20260709 12:20:46.380142 17800 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:46.464042 17875 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.467635 13134 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:46.471776 17800 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:46.472528 17800 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:46.349182 17851 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.540863 13286 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:46.559350 13278 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:46.586838 13211 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:46.435949 17560 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:46.589811 13282 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:46.591223 13283 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:46.591747 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.595597 13285 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:46.378950 17796 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:46.597182 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 320248us
I20260709 12:20:46.500563 17937 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:46.603178 17879 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:46.603639 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 264511us
I20260709 12:20:46.604179 17879 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:46.605511 13100 leader_election.cc:336] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.765s (SENT)
W20260709 12:20:46.606851 13100 leader_election.cc:336] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.817s (SENT)
W20260709 12:20:46.610487 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 292950us
I20260709 12:20:46.590356 17892 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:46.593531 17875 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:46.561062 17946 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.614920 13177 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:46.607510 17779 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.607568 17690 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:46.619660 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.622627 13175 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:46.607661 17881 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:46.608865 17879 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:46.638278 17651 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:46.625825 17914 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:46.645648 17946 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.648679 17796 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.630120 17887 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.661217 17887 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.661477 17944 consensus_queue.cc:1059] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:46.662014 17712 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.664039 13209 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:46.665258 13035 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51922 (request call id 207) took 44023 ms (client timeout 15000 ms). Trace:
I20260709 12:20:46.664794 13032 catalog_manager.cc:5697] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 8 to 10, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 10 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.673309 17712 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.635147 17891 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:46.656016 17772 consensus_meta.cc:287] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.002s
W20260709 12:20:46.675357 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.626341 17658 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:46.681456 13278 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:20:46.636268 17638 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:20:46.656371 17914 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:46.684700 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 869) took 2359 ms. Trace:
I20260709 12:20:46.690250 13137 rpcz_store.cc:276] 0709 12:20:44.325167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.900763 (+1575596us) service_pool.cc:224] Handling call
0709 12:20:45.901164 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:46.236965 (+335801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.684455 (+447490us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54002b5054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:46.684641 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758891392}
I20260709 12:20:46.691468 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.666887 13032 catalog_manager.cc:5697] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:20:46.635967 17690 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.693100 17658 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.694911 17690 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:46.642910 17779 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.695906 13277 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:46.696316 17658 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:46.696914 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.697511 17779 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.698150 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.700062 13285 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:46.700206 17851 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:46.701782 13285 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:46.702288 13100 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:46.703357 17879 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:46.704988 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.641058 17901 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:46.710131 13286 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:46.688870 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.712644 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:46.713593 13878 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:46.714358 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1168) took 1283 ms. Trace:
I20260709 12:20:46.722298 13282 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:46.723001 13280 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 12:20:46.725234 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.725994 13211 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:46.721329 13878 rpcz_store.cc:276] 0709 12:20:45.430725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.956693 (+525968us) service_pool.cc:224] Handling call
0709 12:20:45.957105 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:46.713924 (+756819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.714085 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:46.729439 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.705839 17914 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:46.715843 17708 consensus_meta.cc:287] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.598s	user 0.015s	sys 0.000s
I20260709 12:20:46.733259 13285 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:20:46.734169 13277 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:46.740885 13205 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:46.744983 13278 raft_consensus.cc:1275] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:20:46.665690 13035 rpcz_store.cc:269] 0709 12:20:02.641940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.642248 (+   308us) service_pool.cc:224] Handling call
0709 12:20:46.664784 (+44022536us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:36.846897 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:37.016254 (+169357us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:37.016310 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:20:37.016331 (+    21us) tablet.cc:662] Decoding operations
0709 12:20:37.031154 (+ 14823us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:37.062169 (+ 31015us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:37.064839 (+  2670us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:20:37.076950 (+ 12111us) tablet.cc:701] Row locks acquired
0709 12:20:37.077002 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:20:37.077152 (+   150us) write_op.cc:270] Start()
0709 12:20:37.077313 (+   161us) write_op.cc:276] Timestamp: P: 1783599637077095 usec, L: 0
0709 12:20:37.077350 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:20:37.078055 (+   705us) log.cc:844] Serialized 2054 byte log entry
0709 12:20:37.996340 (+918285us) op_driver.cc:464] REPLICATION: finished
0709 12:20:38.172357 (+176017us) write_op.cc:301] APPLY: starting
0709 12:20:38.172488 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:38.213171 (+ 40683us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:38.213297 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:38.262194 (+ 48897us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:38.280510 (+ 18316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:20:38.280565 (+    55us) write_op.cc:312] APPLY: finished
0709 12:20:38.280916 (+   351us) log.cc:844] Serialized 57 byte log entry
0709 12:20:38.281108 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:38.281215 (+   107us) write_op.cc:454] Released schema lock
0709 12:20:38.281276 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:38.281805 (+   529us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:38.281833 (+    28us) write_op.cc:454] Released schema lock
0709 12:20:38.652705 (+370872us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b54003633d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8a32a 00007f70f4e0ff14 00007f70f4e0fec3 00007f70f4e0fe38 00007f70f4e0fdf3 00007f70f4e0f0dc 00007f70f4e38e16 00007f70f4e20cbb 00007f70f4e0b39d 00007f70f4e0ed75
Metrics: {"mutex_wait_us":381642,"reported_tablets":35,"spinlock_wait_cycles":9600,"child_traces":[["op",{"apply.queue_time_us":175547,"apply.run_cpu_time_us":10496,"apply.run_wall_time_us":109462,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":405133,"prepare.run_cpu_time_us":85928,"prepare.run_wall_time_us":490376,"raft.queue_time_us":337913,"raft.run_cpu_time_us":15436,"raft.run_wall_time_us":697552,"replication_time_us":894179,"spinlock_wait_cycles":7755520,"thread_start_us":801023,"threads_started":4,"wal-append.queue_time_us":231311,"wal-append.run_cpu_time_us":88160,"wal-append.run_wall_time_us":1957762}]]}
I20260709 12:20:46.730993 17879 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:46.748916 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.749833 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.749650 17879 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.732103 13032 catalog_manager.cc:5697] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca reported cstate change: config changed from index 3 to 6, term changed from 5 to 7, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1), VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2), VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3), VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 7 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:46.744710 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:46.771204 13840 leader_election.cc:400] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 8 pre-election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9.
I20260709 12:20:46.736384 17887 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:46.773451 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:46.768317 17708 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:20:46.775354 17708 consensus_queue.cc:1243] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:46.777091 13032 catalog_manager.cc:5697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 5 to 8, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 8 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:46.780277 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 70859.2us
I20260709 12:20:46.781440 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.784664 13032 catalog_manager.cc:5697] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 5 to 7, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 7 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:46.789192 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 68876.3us
I20260709 12:20:46.790419 13103 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:46.793998 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.790066 13879 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:46.801569 17658 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:46.802397 17658 consensus_queue.cc:1243] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:46.803860 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.804889 17708 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:20:46.768818 17560 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.778497 17946 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:20:46.801569 13032 catalog_manager.cc:5697] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:46.810154 13175 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:46.811039 17800 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.809268 17638 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:46.827716 13032 catalog_manager.cc:5697] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 8 to 9, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 9 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:20:46.831928 13211 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:46.834231 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.835925 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.831023 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:46.831768 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.824070 17946 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:46.842579 13175 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:46.842429 17630 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:46.844043 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:46.844991 17879 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:46.848541 13100 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:46.839740 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.854117 13885 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 11: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:46.854267 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.855780 13878 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:46.855865 13284 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:46.829095 17638 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.833804 17772 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:46.828890 17560 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:46.868041 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.853909 13032 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 8 to 9, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 9 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:46.870906 13177 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:46.874362 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:46.874852 13177 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:46.874615 13032 catalog_manager.cc:5697] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 3 to 8, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 8 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:46.860222 17638 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:46.871711 13286 pending_rounds.cc:85] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 4
I20260709 12:20:46.877624 13286 pending_rounds.cc:107] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:20:46.877964 13286 raft_consensus.cc:2889] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:46.880719 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:46.868578 17875 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:46.870868 17946 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:46.876432 17634 raft_consensus.cc:3055] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:46.873121 17772 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:46.876523 17920 consensus_queue.cc:1048] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:20:46.883170 17712 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:46.892561 17875 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.912533 13100 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:46.879799 13032 catalog_manager.cc:5697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 4 to 5, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 5 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:20:46.880264 17560 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:46.928725 17876 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:46.929405 17876 raft_consensus.cc:697] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:46.930387 17876 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:46.872004 17658 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:20:46.885952 17708 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:46.914796 13282 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:20:46.948939 13175 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:46.949180 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:46.904739 17772 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:46.898973 17634 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:46.905579 17920 consensus_queue.cc:1243] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:46.914368 17832 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.947335 13878 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:20:46.974745 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:46.913674 17875 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:46.911502 17712 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:46.989384 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 48133us
I20260709 12:20:46.942366 17560 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:46.989821 13032 catalog_manager.cc:5697] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:46.983669 17891 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:46.999413 17891 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:46.999946 17891 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:46.909080 17887 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
W20260709 12:20:47.006919 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 372448us
W20260709 12:20:47.009208 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 400031us
I20260709 12:20:46.986523 17708 raft_consensus.cc:697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:47.019497 17832 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.024899 13249 leader_election.cc:400] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:47.031652 13249 leader_election.cc:403] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:47.026804 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 117389us
I20260709 12:20:47.003962 17712 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:46.991250 17946 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:47.046403 17946 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:47.047358 17946 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.054555 13279 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:20:47.019940 17800 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:47.055845 17560 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.057706 17832 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:47.032671 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:47.033991 13032 catalog_manager.cc:5697] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 5 to 6, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 6 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.037873 17634 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.042593 17708 consensus_queue.cc:237] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.045270 17914 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:47.078599 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 53863.7us
W20260709 12:20:47.080219 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 295675us
I20260709 12:20:47.080514 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:47.091812 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 184303us
I20260709 12:20:47.099572 13282 pending_rounds.cc:85] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 7
I20260709 12:20:47.099972 13282 pending_rounds.cc:107] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:20:47.100224 13282 raft_consensus.cc:2889] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:47.083825 17779 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:47.111557 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:47.127897 17772 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.113603 17712 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:47.131508 17712 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.131893 17712 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:47.133208 17914 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:47.134334 17876 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.134938 17876 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:47.139461 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 106867us
I20260709 12:20:47.141000 13175 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:47.144670 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:47.150700 17876 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:47.145108 13032 catalog_manager.cc:5697] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 8 to 9, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 9 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:47.153146 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.153059 13032 catalog_manager.cc:5697] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:47.154670 17975 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:47.135838 17814 raft_consensus.cc:3055] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:47.135870 17634 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:47.138584 17772 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:47.170181 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.101198 17892 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:20:47.168919 13032 catalog_manager.cc:5697] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 6 to 8, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 8 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:47.179214 13103 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:20:47.181258 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 69938.4us
I20260709 12:20:47.166604 17972 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:20:47.167546 17725 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.173280 17560 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:47.185524 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 44643us
I20260709 12:20:47.186246 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:47.162812 17814 raft_consensus.cc:740] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:47.171237 17903 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:47.136914 17973 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:20:47.158738 17944 consensus_queue.cc:1059] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:20:47.189601 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:47.167837 17891 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.197001 13032 catalog_manager.cc:5697] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:20:47.185668 17887 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:47.221901 13131 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:47.189081 17560 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:47.226833 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:47.229646 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:47.230334 13135 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:47.224390 13249 leader_election.cc:400] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:47.207234 17946 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:47.196316 17903 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:47.264495 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 3058) took 1106 ms. Trace:
I20260709 12:20:47.265059 13279 rpcz_store.cc:276] 0709 12:20:46.155916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.156610 (+   694us) service_pool.cc:224] Handling call
0709 12:20:47.262115 (+1105505us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54002756d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:47.262257 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062545792}
I20260709 12:20:47.265519 13032 catalog_manager.cc:5697] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 6 to 8, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 8 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:47.268085 17978 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:20:47.269551 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:47.270241 13136 raft_consensus.cc:2376] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14. Re-sending same reply.
I20260709 12:20:47.271350 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3101) took 1102 ms. Trace:
I20260709 12:20:47.271598 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:47.272584 13285 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:47.271812 13208 rpcz_store.cc:276] 0709 12:20:46.169245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.179545 (+ 10300us) service_pool.cc:224] Handling call
0709 12:20:46.179881 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:46.743612 (+563731us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:47.080011 (+336399us) log.cc:844] Serialized 14 byte log entry
0709 12:20:47.173957 (+ 93946us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:47.174031 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:47.177896 (+  3865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.271104 (+ 93208us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54002157d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:47.271152 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:47.271291 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":393037,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":7670,"raft.queue_time_us":17315,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":21586,"spinlock_wait_cycles":1281989888,"thread_start_us":365924,"threads_started":2}
I20260709 12:20:47.273654 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:47.274314 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:47.274682 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:47.275646 13277 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:47.274325 13281 raft_consensus.cc:2376] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11. Re-sending same reply.
I20260709 12:20:47.262032 17903 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:47.283809 17832 consensus_queue.cc:1059] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:47.288810 17969 log.cc:927] Time spent T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 12:20:47.289784 17979 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:20:47.213658 17887 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:47.293872 13032 catalog_manager.cc:5697] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 5 to 8, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 8 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:47.263298 13249 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:47.276849 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:47.298214 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 118758us
I20260709 12:20:47.301265 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:47.232956 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:47.301048 13279 raft_consensus.cc:2376] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13. Re-sending same reply.
I20260709 12:20:47.307804 13103 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:47.310528 13284 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
W20260709 12:20:47.311721 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 78907.8us
I20260709 12:20:47.313865 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:47.312579 13103 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:20:47.316579 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 145682us
I20260709 12:20:47.317242 13841 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:47.318236 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 55067.2us
I20260709 12:20:47.309507 13032 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:47.209287 17725 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.279464 17967 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:20:47.298187 17887 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:47.230741 17560 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:47.299845 17832 raft_consensus.cc:3055] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:47.330945 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:47.230156 17779 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:47.334764 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:47.340597 13032 catalog_manager.cc:5697] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 8 to 11, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 11 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.326406 17920 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:47.358826 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.364859 13209 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:47.349457 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.329274 17772 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:47.351269 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:47.366674 17772 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:47.332664 17991 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:47.359843 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.368315 13204 raft_consensus.cc:2393] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:47.346302 17987 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.337142 17814 consensus_queue.cc:260] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.369215 17987 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.370334 17814 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:47.360944 13208 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:47.360785 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.371942 13205 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:47.373322 17712 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.362097 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.375890 13212 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:47.346824 13032 catalog_manager.cc:5697] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 7 to 10, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 10 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.363698 13206 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:47.362794 17891 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:47.367189 17772 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:47.327575 17976 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:47.378237 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:47.333393 17946 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:20:47.390009 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 59356.6us
I20260709 12:20:47.329456 17892 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:47.400590 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.398650 13103 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:47.340096 17832 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:47.419956 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.420174 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 241501us
I20260709 12:20:47.351116 17875 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:47.425503 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 97640.3us
I20260709 12:20:47.396790 17967 raft_consensus.cc:3055] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:47.412688 13032 catalog_manager.cc:5697] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.399794 17974 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:47.391100 17976 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:47.403687 17638 consensus_meta.cc:287] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.002s
I20260709 12:20:47.400051 17892 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.397665 17946 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:47.439975 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:47.445070 13886 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:47.412946 17712 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:47.418959 17975 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:47.454641 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:47.428064 17876 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:47.462364 17876 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.462791 17876 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:47.457085 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.466953 13203 raft_consensus.cc:2368] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:47.466635 17903 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.467597 17725 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:47.467697 17987 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:47.456632 13032 catalog_manager.cc:5697] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 5 to 7, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 7 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:47.391347 17901 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:20:47.471146 17779 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:47.471561 17779 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:47.460198 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:47.471750 17832 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.472738 17875 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:47.473167 17832 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:47.473344 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:47.473598 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:47.473871 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:47.474529 13885 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:47.474568 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:47.474768 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:47.475528 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:47.453157 17638 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.477546 17638 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:47.478293 13887 raft_consensus.cc:2393] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:47.479117 13103 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:47.442153 13840 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:47.476260 13032 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 6 to 7, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 7 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:47.481262 13032 catalog_manager.cc:5697] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 5 to 6, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 6 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:20:47.461745 17880 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:47.483002 17876 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.483632 17880 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.484114 17880 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:47.485062 13132 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:47.483629 17987 consensus_queue.cc:1059] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:20:47.486438 17987 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:47.482726 13032 catalog_manager.cc:5697] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.444561 17892 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:47.486901 17987 raft_consensus.cc:697] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:47.487857 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:47.487920 17987 consensus_queue.cc:237] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.488724 13135 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 11: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:47.488265 13032 catalog_manager.cc:5697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:47.461359 13205 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:47.452966 17946 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:47.491343 17876 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:47.493310 17876 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:47.494158 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:47.495361 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:47.495658 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:47.496488 13131 raft_consensus.cc:2393] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 11: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:47.497377 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:47.444255 17976 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:47.490075 13032 catalog_manager.cc:5697] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 7 to 8, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 8 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:47.493661 17876 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:47.428296 17967 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:47.501395 17876 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.506299 17967 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.506889 17876 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:47.504509 13032 catalog_manager.cc:5697] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 8 to 9, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 9 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.515885 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:47.518728 13878 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:47.519683 17560 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.515952 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:47.520670 13128 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:47.520682 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.520917 17973 raft_consensus.cc:3055] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:47.521406 17973 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:47.521620 13203 raft_consensus.cc:2410] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:47.521724 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.522396 13208 raft_consensus.cc:2376] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13. Re-sending same reply.
I20260709 12:20:47.522583 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.522264 17973 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.523732 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.523936 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.524299 13207 raft_consensus.cc:2376] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11. Re-sending same reply.
I20260709 12:20:47.523874 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.525022 13210 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:47.525336 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.525807 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.526398 13210 raft_consensus.cc:2376] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14. Re-sending same reply.
I20260709 12:20:47.526569 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.523313 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.526850 17630 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:47.527186 13208 raft_consensus.cc:2376] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14. Re-sending same reply.
I20260709 12:20:47.528025 17875 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:47.528563 17875 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.529080 17973 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:47.483546 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.531850 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.532053 17875 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:47.525985 13211 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:20:47.532075 13212 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:47.523245 13203 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:47.527297 17630 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:47.525347 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.541020 13100 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:47.540169 13209 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
W20260709 12:20:47.543290 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 210808us
I20260709 12:20:47.544842 13249 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:47.549729 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.550611 13208 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:47.535084 17944 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 12:20:47.552582 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 99146.5us
I20260709 12:20:47.560211 13205 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:20:47.570025 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 129794us
I20260709 12:20:47.563925 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.576481 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.577409 13210 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:47.543905 17975 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:47.580193 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.586995 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.611048 13212 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:47.607129 13838 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:47.562515 17967 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:47.620290 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.613104 13211 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:47.613842 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.616430 13212 raft_consensus.cc:1240] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:20:47.617928 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.627766 13284 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:20:47.612499 17985 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:47.633196 13208 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:47.607139 17879 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:47.636081 13207 pending_rounds.cc:85] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 4
I20260709 12:20:47.644769 13207 pending_rounds.cc:107] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:20:47.645116 13207 raft_consensus.cc:2889] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:47.607200 17993 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:47.647266 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 102527us
W20260709 12:20:47.636359 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 65244.7us
I20260709 12:20:47.570183 17875 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:20:47.650501 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:47.612322 17725 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:47.676571 13205 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:47.686302 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.687675 13209 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:47.694988 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 154041us
I20260709 12:20:47.606576 17996 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:20:47.647380 17995 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:47.709915 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.711889 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 104839us
I20260709 12:20:47.713785 17995 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.634656 17887 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.719983 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.636834 17880 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:47.727715 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 77319.7us
I20260709 12:20:47.728230 17634 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:47.728536 17996 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:47.728682 17991 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:47.757256 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 105295us
I20260709 12:20:47.731763 17944 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.738516 18000 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:47.744616 17975 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.806754 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:47.722448 13100 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:47.766834 13132 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:47.770841 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 57955.4us
I20260709 12:20:47.804463 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:47.810663 13284 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:47.721820 17993 raft_consensus.cc:697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:47.722590 17989 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:47.754489 17974 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:47.757324 17901 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:47.828025 13282 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:47.724869 17725 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.840204 13103 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:47.751113 17772 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.770040 18000 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:47.810382 17996 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:47.765707 17634 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.836731 17875 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.865501 18013 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:47.866179 13879 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:47.882254 13838 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:47.865876 17993 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.843498 13103 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:47.864648 17887 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:47.839984 17876 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:47.888368 13131 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:47.857806 18006 consensus_queue.cc:1059] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:20:47.807140 17944 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.867697 17779 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.873566 17987 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:47.869414 13841 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:47.868773 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 172441us
I20260709 12:20:47.897565 13100 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:47.885154 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:47.819485 17796 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:20:47.894241 13204 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:47.769798 17991 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.872994 17903 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:47.906518 17976 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.865176 17880 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:47.873473 18000 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:47.913676 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 70272.9us
W20260709 12:20:47.903326 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 97174.8us
I20260709 12:20:47.904942 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:47.915314 13203 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:47.901226 17779 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:47.875126 17712 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:20:47.840732 17560 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:47.885907 17974 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:20:47.904352 17832 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:47.897037 17987 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:47.931121 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:47.933406 13284 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:20:47.883399 17875 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.884742 17946 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:47.920499 17879 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:47.948410 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.926312 17887 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:47.951607 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 82295.6us
W20260709 12:20:47.938446 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 134069us
I20260709 12:20:47.949324 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:47.964694 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:47.942092 18014 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.965370 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:47.966522 13203 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:20:47.889053 18013 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.932895 17814 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:48.010682 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.944227 17976 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:48.005549 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:47.840590 17901 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.001137 17973 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:47.942672 17988 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:48.027647 17988 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.028028 17638 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.028566 17638 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.028961 17779 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:48.029198 17630 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.030774 17638 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:48.002379 13252 leader_election.cc:336] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.530s (SENT)
I20260709 12:20:48.004271 17634 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:47.948400 17987 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:48.002938 13284 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:47.951328 18018 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:48.012401 13212 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:48.012549 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 47253.1us
I20260709 12:20:48.011404 13210 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:47.943645 17725 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:47.962489 17879 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.919827 18011 consensus_queue.cc:1059] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:20:47.969547 17887 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.024076 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:48.053774 13203 raft_consensus.cc:2410] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:20:48.026741 17946 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:48.031741 17772 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:47.957048 17880 consensus_queue.cc:1059] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:20:48.044734 17990 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.048686 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:48.048811 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 83969.1us
I20260709 12:20:48.050385 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.051748 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:48.071012 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:47.968215 17995 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:48.072494 13210 raft_consensus.cc:2368] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:20:48.034231 18007 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:20:48.060983 17892 consensus_meta.cc:287] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.574s	user 0.005s	sys 0.005s
W20260709 12:20:48.070715 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 106434us
I20260709 12:20:48.028069 17988 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:48.070812 13841 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:48.052858 17879 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:48.061206 17887 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:48.075368 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 110779us
I20260709 12:20:48.049777 17973 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:48.079734 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:48.081223 17944 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:48.075173 17990 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.106096 17990 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:48.106594 13212 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:48.106751 13249 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:48.107973 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:48.109160 18018 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:48.109977 18018 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:48.111557 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.081427 17880 raft_consensus.cc:3055] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:48.081463 17779 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:48.083515 17991 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:48.076090 17892 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:48.068717 17560 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:20:48.088788 18000 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:48.127542 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 179259us
I20260709 12:20:48.090421 18013 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:48.095674 18011 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.011212 18014 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:47.973161 17996 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.099752 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.098626 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.131477 13203 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:48.131971 13204 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:48.102769 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.102846 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:48.117213 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 46476.8us
I20260709 12:20:48.133626 13841 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:48.134684 17991 raft_consensus.cc:2764] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:20:48.135316 13129 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:48.136482 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.136754 17991 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:48.137545 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.074266 18007 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.138119 13129 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:48.138406 18007 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:48.139042 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:48.139293 13129 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:20:48.139979 17991 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:48.140353 17991 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.140673 17991 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:48.119689 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:48.123980 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:48.142638 13879 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:48.143611 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:48.143250 13211 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:48.144898 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:48.145381 18026 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:48.146329 18026 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:48.147404 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.147547 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.147608 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.148362 13878 raft_consensus.cc:2376] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11. Re-sending same reply.
W20260709 12:20:48.128244 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.110348 18018 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:48.136714 13841 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:48.129995 17944 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:48.125181 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:48.154273 13212 raft_consensus.cc:2393] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:48.109161 18024 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:48.160121 13284 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:48.160821 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.116494 17880 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:48.166240 13135 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:48.166774 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.167106 13286 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:48.162151 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:48.167650 13209 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:48.168123 13206 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:48.156878 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.168917 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.164099 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.169955 13204 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:48.164000 17712 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.164721 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.164927 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:48.171579 13203 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:48.172415 13134 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:48.173695 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.176761 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.180222 13207 raft_consensus.cc:2393] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:48.182030 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.181716 17973 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.183238 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.183880 13130 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:48.184509 17901 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:48.184739 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.185647 13130 raft_consensus.cc:2410] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:20:48.186535 13135 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:48.187582 17994 consensus_queue.cc:1059] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:20:48.188658 17994 raft_consensus.cc:3055] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:48.188983 17994 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:48.130690 17975 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:20:48.189868 17994 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.191121 17994 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:48.192400 18000 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:48.192304 17987 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:48.194124 17892 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:48.203202 13838 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:48.203649 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:48.201054 13206 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:20:48.156502 18018 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:48.205626 13210 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:48.176235 17974 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:48.208477 13211 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:48.207981 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.206389 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:48.209473 13135 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:48.153198 18011 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.209570 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.210534 13277 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:48.206897 17944 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:48.211400 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.211793 18011 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:48.209681 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.151333 17887 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.208611 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.175872 17712 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:48.189896 18014 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:48.219942 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.496371 13277 raft_consensus.cc:2393] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:48.497277 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.497872 13277 raft_consensus.cc:2376] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11. Re-sending same reply.
I20260709 12:20:48.498719 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.498878 13249 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:48.453195 17988 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.500392 18007 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:48.228245 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.481959 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:48.502691 13278 raft_consensus.cc:2376] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13. Re-sending same reply.
I20260709 12:20:48.274290 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:48.407783 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.503599 13878 raft_consensus.cc:2410] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:20:48.503710 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.504448 13278 raft_consensus.cc:2393] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:48.228340 17944 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.277s
I20260709 12:20:48.505301 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.505769 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:48.499240 13277 raft_consensus.cc:2376] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11. Re-sending same reply.
I20260709 12:20:48.507507 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.228842 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.452217 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.228681 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.510747 13129 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:48.511878 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.228037 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.504256 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.206981 18024 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:48.229193 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.516184 13285 raft_consensus.cc:2393] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:48.276005 13207 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:48.511969 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.519141 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.506383 13211 raft_consensus.cc:2376] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9. Re-sending same reply.
W20260709 12:20:48.521944 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 385289us
W20260709 12:20:48.325078 18027 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:20:48.526268 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:48.527117 13206 raft_consensus.cc:2368] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:20:48.528038 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.521023 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:48.528116 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.528790 13211 raft_consensus.cc:2376] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11. Re-sending same reply.
I20260709 12:20:48.523001 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.524124 13103 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:48.524061 13249 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:48.317835 17903 raft_consensus.cc:3055] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:48.205493 17967 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.310s
I20260709 12:20:48.526038 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:48.526633 18024 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:48.506398 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.519718 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.530717 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.546326 13211 raft_consensus.cc:2393] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:48.450383 18032 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.532399 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:48.538407 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.539459 13205 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:48.544281 13278 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:48.522256 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.337199 17974 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.548799 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:48.531621 17903 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:48.553472 17967 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:48.554971 18024 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:48.584503 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:48.595804 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 69820.8us
I20260709 12:20:48.611814 13208 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:48.574079 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.587090 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.529436 18021 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:48.586318 13252 leader_election.cc:336] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.863s (SENT)
I20260709 12:20:48.597958 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.614596 13252 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:48.559676 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.617502 13210 raft_consensus.cc:2368] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:48.618182 13841 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:48.610826 13207 raft_consensus.cc:2376] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14. Re-sending same reply.
I20260709 12:20:48.587612 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:48.625546 18011 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:48.627210 13203 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:48.627856 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:48.627933 17903 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:48.629168 17903 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:48.634259 18007 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:48.583021 18028 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.635722 17880 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:48.635967 18028 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.636798 17880 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:48.637840 17991 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.640605 13887 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:20:48.644968 13207 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:48.648205 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.659512 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.559880 18013 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:48.544059 18014 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:48.584882 18006 raft_consensus.cc:3055] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:48.660218 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:48.668530 13277 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:20:48.667477 13279 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:48.674649 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:48.618618 17974 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.682937 13130 raft_consensus.cc:2368] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14.
I20260709 12:20:48.684147 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:48.684854 17974 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:48.622437 17987 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:48.687619 17887 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:48.640383 18024 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:48.677301 13136 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
W20260709 12:20:48.695823 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 53529.6us
I20260709 12:20:48.646121 18028 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:48.697191 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 110919us
W20260709 12:20:48.702600 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.709968 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:48.700160 13102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.008s	sys 0.021s
W20260709 12:20:48.790851 13102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.010s	sys 0.021s
W20260709 12:20:48.791309 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 644379us
I20260709 12:20:48.558856 18032 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:48.689924 17973 raft_consensus.cc:2764] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:20:48.868577 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:48.869315 13100 leader_election.cc:336] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.615s (SENT)
I20260709 12:20:48.880728 13283 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:48.681278 18006 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:48.889377 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:48.890662 13886 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:48.699906 18024 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:48.875744 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 128517us
I20260709 12:20:48.701808 18021 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:48.896627 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 284422us
I20260709 12:20:48.926699 18021 raft_consensus.cc:697] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:48.929353 17993 consensus_queue.cc:1059] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:48.901043 17920 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:48.930406 17993 consensus_queue.cc:1059] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:48.931607 17996 raft_consensus.cc:3055] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:48.931712 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:48.931983 17996 raft_consensus.cc:740] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:48.932876 17996 consensus_queue.cc:260] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.934051 17996 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:48.934823 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.935590 17989 raft_consensus.cc:3055] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:48.935765 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.936003 17989 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:48.936206 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.936900 18022 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.936841 17989 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.937461 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.901906 17892 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:48.938354 17989 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:48.939777 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:20:48.941040 17994 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.738s	user 0.008s	sys 0.000s
I20260709 12:20:48.941524 13840 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:48.941720 17991 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:48.942272 17991 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:48.895821 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.928223 18021 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.699335 18013 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:48.916231 18024 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:48.916812 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:48.698778 18014 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.911127 18006 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:48.947849 18014 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:48.948447 18006 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:48.948547 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.949393 13884 raft_consensus.cc:2410] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 12:20:48.904345 18037 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 12:20:48.883062 18007 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.951059 13135 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:48.951169 18007 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:48.952031 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 69609.9us
I20260709 12:20:48.953452 18007 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:48.902026 13278 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:48.954361 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:48.955163 13135 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:48.942799 17991 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.951622 17712 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:48.937542 18022 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.929220 17967 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:48.955711 17993 consensus_queue.cc:1059] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:48.908887 18032 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:48.926728 18018 consensus_meta.cc:287] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.004s
I20260709 12:20:48.902908 13249 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:48.942298 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:48.960765 13102 leader_election.cc:336] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 2.011s (SENT)
W20260709 12:20:48.971637 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 68841.5us
I20260709 12:20:48.923478 13208 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:48.944052 18013 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:48.936856 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.975045 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:48.966269 13285 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:48.966745 13886 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:48.959961 17991 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:48.969144 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:48.973903 13879 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:48.978483 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.972864 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:48.979444 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.979967 13878 raft_consensus.cc:2376] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11. Re-sending same reply.
I20260709 12:20:48.980700 13883 raft_consensus.cc:2393] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:48.983853 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:48.983860 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:48.988143 13879 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:48.987257 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:48.991063 13886 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:48.989243 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:48.993476 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:48.994345 13880 raft_consensus.cc:2410] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:20:48.994772 13879 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:48.995667 13880 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:49.016372 13285 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:49.016145 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:49.021700 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.022562 13175 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.024451 13884 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:49.026698 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:48.971189 17994 consensus_queue.cc:1059] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:20:49.030385 13885 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:20:49.027560 13285 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:48.975934 18018 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.030906 13885 pending_rounds.cc:85] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Aborting all ops after (but not including) 8
I20260709 12:20:49.045078 13885 pending_rounds.cc:107] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:20:49.045444 13885 raft_consensus.cc:2889] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:49.041007 18041 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:49.051297 18018 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:49.051941 18018 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.052407 18018 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.053498 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.054311 18018 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:49.054857 18018 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:49.057050 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.057797 13130 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:49.058568 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.059094 13130 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:49.059980 13282 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
W20260709 12:20:49.060628 13100 leader_election.cc:336] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.515s (SENT)
I20260709 12:20:49.061781 13278 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:49.061715 17903 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:49.062748 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.063318 13133 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:49.055255 18018 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.065646 18018 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:49.067996 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1645) took 1551 ms. Trace:
I20260709 12:20:49.068385 13132 rpcz_store.cc:276] 0709 12:20:47.516328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.518268 (+  1940us) service_pool.cc:224] Handling call
0709 12:20:47.518600 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:47.808216 (+289616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.067768 (+1259552us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54001379d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:49.067939 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570452352}
I20260709 12:20:49.068779 17914 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:49.069303 17914 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.069646 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.071341 17914 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:49.073279 17914 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:49.024714 17712 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.081099 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.081842 13135 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:49.124745 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:49.121940 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:49.125648 13885 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:49.043453 17891 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:49.151355 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.152376 13130 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:49.176994 13133 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:20:49.181676 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.182674 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.187493 13100 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.193384 13100 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:49.195025 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:49.195588 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.196692 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.198228 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.197505 13133 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:49.202165 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:49.203251 13883 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:49.214684 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:49.215250 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 192753us
I20260709 12:20:49.216419 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.218081 13135 raft_consensus.cc:2368] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12.
I20260709 12:20:49.085409 17712 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.230235 13133 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:49.050340 18041 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.233137 17757 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.233745 18041 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:49.236140 17630 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:49.253346 13203 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:20:49.256901 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 81132.5us
W20260709 12:20:49.260438 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 44118.2us
I20260709 12:20:49.260898 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 3082) took 1045 ms. Trace:
I20260709 12:20:49.261548 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.261443 13282 rpcz_store.cc:276] 0709 12:20:48.215069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.527810 (+312741us) service_pool.cc:224] Handling call
0709 12:20:49.260624 (+732814us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400230fd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:49.260778 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220572928}
I20260709 12:20:49.265058 17920 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:49.265376 17875 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:49.266976 17973 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:49.267719 17973 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.271512 17987 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:20:49.278529 13134 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:49.278244 13132 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:49.279367 13130 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:49.200224 18032 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:49.212682 18007 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:49.179760 17891 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.288697 13211 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:49.279645 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.287786 13175 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.251621 17990 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:20:49.296217 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.299492 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.304958 13175 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:49.286178 17879 consensus_meta.cc:287] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 1.168s	user 0.008s	sys 0.009s
I20260709 12:20:49.319929 13103 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.324378 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.284459 17973 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:49.285197 18007 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.288312 17920 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.283960 18054 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:49.233803 17757 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.312744 18053 consensus_queue.cc:1059] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:20:49.313653 13252 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:49.311401 18049 consensus_queue.cc:1059] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 12:20:49.309890 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 334344us
I20260709 12:20:49.337400 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:49.335669 13103 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:49.343629 13841 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:49.310146 18047 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:49.348711 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:49.451006 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 107461us
I20260709 12:20:49.406631 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.315474 17560 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:49.430148 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:49.446447 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 110858us
I20260709 12:20:49.453567 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:49.454502 13132 raft_consensus.cc:2393] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:49.278235 18014 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.335332 17974 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.461033 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 123751us
I20260709 12:20:49.457508 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:49.457993 13206 raft_consensus.cc:2393] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:49.452908 17560 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:49.459729 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:49.464785 13132 raft_consensus.cc:1240] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14. Ops: []
W20260709 12:20:49.408226 18048 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:20:49.344764 17708 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:49.408484 13137 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1640) took 1914 ms (client timeout 1599 ms). Trace:
W20260709 12:20:49.467386 13137 rpcz_store.cc:269] 0709 12:20:47.494131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.495052 (+   921us) service_pool.cc:224] Handling call
0709 12:20:49.408263 (+1913211us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54001f31d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:49.408404 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315282176}
I20260709 12:20:49.467967 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.343215 17987 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:49.335073 18041 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:49.375422 18007 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:49.465397 17973 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:49.452373 17725 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:49.471417 18052 raft_consensus.cc:2764] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:20:49.449536 18024 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.471879 18060 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:49.463804 18065 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.455523 18062 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:49.472757 17996 consensus_meta.cc:287] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.003s
I20260709 12:20:49.466629 17989 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:49.471407 18057 raft_consensus.cc:3055] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:49.389559 17914 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.408736 17891 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:49.485994 17725 raft_consensus.cc:697] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:49.487196 17725 consensus_queue.cc:237] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.487761 18057 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:49.488040 17967 raft_consensus.cc:3055] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:49.488467 17967 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:49.487193 18065 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.489413 17757 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:49.433542 18018 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.402573 17712 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:49.332243 17892 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 12:20:49.480126 13132 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:20:49.504710 13132 pending_rounds.cc:85] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 6
I20260709 12:20:49.454627 17920 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.504984 13132 pending_rounds.cc:107] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:20:49.504992 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.505292 13132 raft_consensus.cc:2889] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:49.462648 17991 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.344568 17875 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 12:20:49.338521 17879 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.491180 13137 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:49.388403 18059 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.492879 13882 raft_consensus.cc:2410] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:20:49.498318 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.503554 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:49.504130 13277 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:49.481532 18013 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:20:49.482340 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 168756us
I20260709 12:20:49.488183 17994 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.505812 13206 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:49.481848 17987 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:49.506660 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 44258.4us
W20260709 12:20:49.508940 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 46560.3us
I20260709 12:20:49.492412 18006 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:49.494081 17914 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.511725 13129 raft_consensus.cc:2368] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11.
I20260709 12:20:49.512356 18065 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:49.513262 17920 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:49.513609 13102 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.009s	sys 0.026s
W20260709 12:20:49.539541 13102 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.011s	sys 0.026s
W20260709 12:20:49.539862 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 553709us
I20260709 12:20:49.515574 17879 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:49.516305 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.516723 18024 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:49.517954 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:49.541540 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.518944 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.542129 13132 raft_consensus.cc:2368] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:49.519593 18049 consensus_queue.cc:1059] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:20:49.489352 17967 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.544775 17967 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:49.544936 18013 raft_consensus.cc:3055] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:49.545353 18013 raft_consensus.cc:740] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:49.545501 17987 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.546298 18013 consensus_queue.cc:260] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.531374 17994 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.479472 17974 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.550463 17974 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:49.550516 18022 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:49.521981 17991 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:49.544967 17914 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:49.551555 13132 raft_consensus.cc:1217] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 5.5->[7.6-13.9]   Dedup: 7.6->[9.7-13.9]
I20260709 12:20:49.552081 13132 pending_rounds.cc:85] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 6
I20260709 12:20:49.552292 13132 pending_rounds.cc:107] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:20:49.552521 13132 raft_consensus.cc:2889] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:49.522540 13884 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:49.525719 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.557096 13133 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:20:49.526597 18018 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:49.560004 13102 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:49.529093 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:49.530831 13252 leader_election.cc:336] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.544s (SENT)
I20260709 12:20:49.565789 13252 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.535624 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:49.538352 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.525695 18014 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:49.543715 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.566963 13206 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:49.520764 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:49.567114 13208 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:49.568157 13210 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:49.568306 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.569787 13131 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:49.570968 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.571156 13131 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:49.572841 13131 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:49.573678 18041 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:49.574249 13131 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:49.574376 17914 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:49.574831 17914 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.575232 17914 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:49.575543 13136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2175) took 1057 ms. Trace:
I20260709 12:20:49.575928 13136 rpcz_store.cc:276] 0709 12:20:48.518457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.519505 (+  1048us) service_pool.cc:224] Handling call
0709 12:20:49.575329 (+1055824us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400062054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:49.575486 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302442880}
I20260709 12:20:49.577505 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.577580 13131 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:49.579885 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 50853.5us
I20260709 12:20:49.583659 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:49.586058 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:49.587832 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.587229 13282 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:49.590315 13281 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:49.592267 13102 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.594926 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:49.595589 13282 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:49.600528 13175 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.601682 13249 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:49.601766 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.601956 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.603273 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:49.607931 13285 raft_consensus.cc:2393] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:49.609002 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:49.609611 13880 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:49.609860 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:49.610181 13175 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:49.612599 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 81766.5us
I20260709 12:20:49.612748 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:49.588297 18009 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:49.613360 13283 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:49.614569 13838 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:49.532392 18059 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.596374 18018 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:49.624107 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.633805 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:49.642642 13881 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:49.633235 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:49.635753 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.640242 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:49.643369 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:49.644162 13885 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:49.644718 13208 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:49.659713 17891 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:49.660737 13137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:49.632855 18047 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:49.605837 18021 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:49.610235 18022 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:49.666069 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2306) took 1565 ms. Trace:
I20260709 12:20:49.615521 18006 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:49.610459 17920 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:49.640817 18018 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.669482 13284 rpcz_store.cc:276] 0709 12:20:48.100407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.100556 (+   149us) service_pool.cc:224] Handling call
0709 12:20:48.100811 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:48.160584 (+ 59773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.665819 (+1505235us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b54001ad6d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:49.665993 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122443648}
I20260709 12:20:49.663887 18052 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:20:49.670329 13205 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1868) took 1469 ms (client timeout 1877 ms). Trace:
W20260709 12:20:49.683660 13205 rpcz_store.cc:269] 0709 12:20:48.195664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.195819 (+   155us) service_pool.cc:224] Handling call
0709 12:20:49.665309 (+1469490us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54002d5d54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:49.665409 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759087360}
I20260709 12:20:49.667075 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:49.685236 13131 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:49.688614 18018 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:49.615515 17875 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:49.693356 18053 raft_consensus.cc:3055] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:49.693779 18053 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:49.694623 18053 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.696270 18053 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:49.634896 17712 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 12:20:49.698505 18066 log.cc:927] Time spent T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 12:20:49.609440 18024 consensus_queue.cc:1059] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:20:49.633404 17973 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:49.672785 18047 raft_consensus.cc:697] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:49.646660 18054 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:20:49.698611 17712 raft_consensus.cc:3055] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:49.705559 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2301) took 1693 ms. Trace:
W20260709 12:20:49.707842 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 93340.2us
I20260709 12:20:49.712463 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:49.721617 13286 rpcz_store.cc:276] 0709 12:20:48.012130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.012762 (+   632us) service_pool.cc:224] Handling call
0709 12:20:48.032626 (+ 19864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:48.167660 (+135034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.705263 (+1537603us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400336654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:49.705479 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308704128}
W20260709 12:20:49.715250 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 79576.4us
I20260709 12:20:49.654057 18050 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:49.717285 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:49.717618 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.633819 18069 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:49.723201 13102 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:49.667665 13249 leader_election.cc:400] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:49.728088 13249 leader_election.cc:403] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:20:49.711671 18006 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:49.714427 17991 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:49.706126 18022 raft_consensus.cc:697] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:49.714711 17725 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:49.748582 17725 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:49.749622 17725 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.724287 18054 consensus_queue.cc:1243] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer cbc6af7757ec459ab451e47724fdf44b log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:20:49.721551 17712 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:49.724006 17973 raft_consensus.cc:697] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:49.760706 17757 consensus_queue.cc:1059] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:49.753120 18031 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:49.767656 18007 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.770848 18007 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:49.779902 18022 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.781224 13885 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:49.779827 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:49.782699 13881 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:49.782290 17973 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.787624 13208 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:49.790148 13881 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:49.730927 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:49.736901 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 69456.2us
I20260709 12:20:49.740298 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.740556 13131 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:20:49.795549 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.742542 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.740092 18052 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:49.747201 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.747530 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.799108 13210 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:49.739970 17987 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:49.802093 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 898) took 1094 ms. Trace:
W20260709 12:20:49.804454 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:49.797211 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 66375.7us
I20260709 12:20:49.797940 13880 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:49.798501 13283 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:49.797137 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.807834 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:49.800189 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 52766.6us
I20260709 12:20:49.809199 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.809303 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.812071 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:49.814054 13128 raft_consensus.cc:2393] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:49.814097 13175 leader_election.cc:400] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14.
W20260709 12:20:49.815290 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 172037us
I20260709 12:20:49.802695 13135 rpcz_store.cc:276] 0709 12:20:48.707144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.304620 (+597476us) service_pool.cc:224] Handling call
0709 12:20:49.312064 (+  7444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:49.320938 (+  8874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.321002 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:49.340169 (+ 19167us) log.cc:844] Serialized 26 byte log entry
0709 12:20:49.458751 (+118582us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:49.458777 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.458823 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:49.697742 (+238919us) spinlock_profiling.cc:243] Waited 951 us on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:49.796697 (+ 98955us) raft_consensus.cc:1685] finished
0709 12:20:49.796719 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.801987 (+  5268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":586,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":14501,"spinlock_wait_cycles":2188160,"thread_start_us":69398,"threads_started":1,"wal-append.queue_time_us":75339}
I20260709 12:20:49.815763 13175 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:49.817842 13102 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:49.817981 13175 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:49.820925 13175 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:49.821792 13102 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:49.823051 13252 leader_election.cc:336] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.602s (SENT)
I20260709 12:20:49.823793 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:49.825717 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:49.827898 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.828687 13210 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:49.829962 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.830790 13210 raft_consensus.cc:2368] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:49.833150 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.833869 13210 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:49.754910 17989 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:20:49.802165 18069 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:49.802404 17987 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.844632 13102 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:49.861760 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:49.866990 13102 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:49.844813 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.810070 18024 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:49.846848 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.870545 13131 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:49.816789 18050 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:49.816474 17891 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:49.871693 13209 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:49.815696 18007 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:49.824021 17879 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:49.818423 17920 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:49.873039 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 128250us
I20260709 12:20:49.871063 17987 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:49.890913 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.845782 17880 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:49.840281 17990 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:49.840157 18065 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:49.847489 17988 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:49.912154 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.921521 13131 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:49.912083 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:49.887585 13102 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:49.891053 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:49.918285 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:49.922976 13205 raft_consensus.cc:2368] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:49.918874 13135 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:49.810721 18052 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.890416 17772 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:49.910020 17891 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:49.935570 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.936439 13205 raft_consensus.cc:2393] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:49.943671 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:49.941583 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:49.922118 17875 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:49.948503 13135 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:49.945852 13205 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:49.947283 13212 raft_consensus.cc:2410] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:20:49.863920 18006 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:49.819008 18047 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.931855 18022 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:20:49.958148 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 135831us
I20260709 12:20:49.956776 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:49.960551 13252 leader_election.cc:336] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.617s (SENT)
W20260709 12:20:49.961012 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 140169us
I20260709 12:20:49.961172 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:49.961547 13252 leader_election.cc:336] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.599s (SENT)
I20260709 12:20:49.961738 13210 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:49.961962 13252 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:49.893687 17712 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.972472 13205 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:49.973687 13175 leader_election.cc:400] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12.
I20260709 12:20:49.976985 18041 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:49.977878 13137 raft_consensus.cc:606] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:20:49.978370 13137 raft_consensus.cc:614] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:49.945293 17772 consensus_queue.cc:1059] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:20:49.948424 18075 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:49.950695 18059 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:49.987335 13252 leader_election.cc:336] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.842s (SENT)
I20260709 12:20:49.935775 17560 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.988445 18077 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:49.988727 18053 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.988876 18071 log.cc:927] Time spent T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:20:49.989684 18074 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:20:49.989753 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:50.015209 13175 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:50.017503 13175 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:49.992964 18052 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:49.993959 13210 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:20:50.012904 18053 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:49.947899 18068 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.244s
I20260709 12:20:49.952625 17880 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:20:50.026583 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 79591us
I20260709 12:20:50.029707 18084 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:50.032325 18084 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.032804 18084 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.027244 17712 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:50.036043 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:50.021791 18065 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:50.024343 17891 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:50.024183 17920 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:50.025306 17560 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:50.049665 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 62381.9us
W20260709 12:20:50.070020 13252 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Timed out: RequestConsensusVote RPC to 127.11.163.2:34605 timed out after 1.844s (SENT)
I20260709 12:20:50.072330 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:50.037499 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:50.063915 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2186) took 1124 ms. Trace:
I20260709 12:20:50.073678 13133 rpcz_store.cc:276] 0709 12:20:48.939837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.558063 (+618226us) service_pool.cc:224] Handling call
0709 12:20:49.558351 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.558589 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:49.716822 (+158233us) log.cc:844] Serialized 14 byte log entry
0709 12:20:50.048145 (+331323us) log.cc:844] Serialized 14 byte log entry
0709 12:20:50.063478 (+ 15333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:50.063539 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:50.063599 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.063686 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.063842 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24481,"prepare.queue_time_us":306695,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":45394,"thread_start_us":466645,"threads_started":2}
I20260709 12:20:50.065482 18032 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:50.013612 18077 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.097070 18085 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:50.041977 18054 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:20:50.094730 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 55690.3us
I20260709 12:20:50.049212 18069 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:20:50.063449 18052 consensus_queue.cc:1059] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:20:50.010208 18075 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.112802 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:50.113641 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:50.098420 18084 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:50.101845 17967 consensus_meta.cc:287] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.001s
I20260709 12:20:50.119736 13883 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:20:50.105083 18054 consensus_queue.cc:1243] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:50.078538 18082 consensus_queue.cc:1059] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:20:50.126441 18082 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:50.126842 18082 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:50.116057 18085 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:50.131470 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1872) took 1858 ms. Trace:
I20260709 12:20:50.131855 13211 rpcz_store.cc:276] 0709 12:20:48.272561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.061661 (+789100us) service_pool.cc:224] Handling call
0709 12:20:49.061943 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.289203 (+227260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.131219 (+842016us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540032cdd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:50.131392 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520910592}
W20260709 12:20:50.133286 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.128950 17987 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.119262 18065 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:50.136703 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:50.141144 13204 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:50.141628 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 3145) took 1630 ms. Trace:
I20260709 12:20:50.137048 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 919) took 2004 ms. Trace:
I20260709 12:20:50.138827 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.141994 13204 rpcz_store.cc:276] 0709 12:20:48.511504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.136470 (+1624966us) service_pool.cc:224] Handling call
0709 12:20:50.141557 (+  5087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:50.167960 13284 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:20:50.125938 18052 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:50.142699 13887 rpcz_store.cc:276] 0709 12:20:48.128951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.129085 (+   134us) service_pool.cc:224] Handling call
0709 12:20:48.162915 (+ 33830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:48.641084 (+478169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.133431 (+1492347us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54006144d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:50.133618 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095421824}
I20260709 12:20:50.171005 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.171875 13284 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:50.172171 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.175393 13279 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:20:50.175817 13286 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:20:50.181921 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 109716us
I20260709 12:20:50.181854 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.182581 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.185941 13283 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:50.185364 13278 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:50.192123 13252 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:50.196516 18092 consensus_queue.cc:1059] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:20:50.197115 18011 raft_consensus.cc:3055] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:50.197585 18011 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:50.198455 18011 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.169966 18082 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.199687 18011 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:50.199841 18082 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:50.204008 17891 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:50.204490 17891 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:50.204739 18077 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:50.205148 18091 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:20:50.204026 18090 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:20:50.207001 18031 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:50.207273 13133 pending_rounds.cc:85] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 5
I20260709 12:20:50.207737 13133 pending_rounds.cc:107] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:20:50.208098 13133 raft_consensus.cc:2889] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:50.207489 18057 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.205468 17891 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.195570 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.209619 13131 raft_consensus.cc:2410] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:20:50.212025 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.212719 13283 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:50.216174 13252 leader_election.cc:400] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:50.177618 17920 raft_consensus.cc:697] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:50.208966 18057 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:50.231969 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:50.231187 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 58504.3us
I20260709 12:20:50.234628 13177 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:50.217540 18085 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:50.239501 18075 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:50.241284 17914 consensus_meta.cc:287] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.002s
I20260709 12:20:50.241770 17914 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.243341 18103 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:50.243832 18103 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:50.244226 18103 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:50.245050 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:50.245821 13137 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:50.229199 18101 consensus_queue.cc:1059] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:20:50.229633 17991 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:50.247709 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:50.248744 17914 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:50.248793 18101 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:50.256013 18098 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:20:50.258279 17987 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:50.233836 18018 consensus_meta.cc:287] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.544s	user 0.013s	sys 0.000s
I20260709 12:20:50.249209 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:50.269827 18018 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.276227 18018 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:50.276813 18021 raft_consensus.cc:3055] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:50.277230 18021 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:50.278003 18021 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.236852 18065 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:50.280481 13129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2176) took 1749 ms (client timeout 1601 ms). Trace:
W20260709 12:20:50.280905 13129 rpcz_store.cc:269] 0709 12:20:48.531071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.531225 (+   154us) service_pool.cc:224] Handling call
0709 12:20:50.280290 (+1749065us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54003cebd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:50.280415 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190829440}
W20260709 12:20:50.284183 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49930.4us
I20260709 12:20:50.285454 13252 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:50.286590 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:50.282908 18013 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:50.279227 18021 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:50.291957 13252 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:50.304561 17994 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:50.310542 17993 raft_consensus.cc:3055] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:50.311144 17993 raft_consensus.cc:740] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:50.312363 17993 consensus_queue.cc:260] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.314201 17993 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:50.316833 13206 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:50.306500 13884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1213) took 1261 ms. Trace:
I20260709 12:20:50.272905 18047 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:50.322537 13252 leader_election.cc:400] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:50.318693 13884 rpcz_store.cc:276] 0709 12:20:49.045505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.047706 (+  2201us) service_pool.cc:224] Handling call
0709 12:20:49.080810 (+ 33104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.555465 (+474655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.306158 (+750693us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54004d3354. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:50.306413 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015354752}
I20260709 12:20:50.290683 18018 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:50.324954 18050 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:50.326418 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3087) took 2010 ms. Trace:
I20260709 12:20:50.290130 17903 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:50.326906 13277 rpcz_store.cc:276] 0709 12:20:48.316088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.706338 (+390250us) service_pool.cc:224] Handling call
0709 12:20:48.888470 (+182132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.529026 (+640556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.326160 (+797134us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400336b54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:50.326361 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415387904}
I20260709 12:20:50.329048 13252 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:50.339218 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.331163 17880 raft_consensus.cc:3055] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:50.340601 13283 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:50.344977 13177 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:50.348515 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:50.349198 13286 raft_consensus.cc:1275] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:50.349530 13134 raft_consensus.cc:2368] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11.
I20260709 12:20:50.351699 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:50.352463 13878 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:50.359674 13284 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:50.361013 13278 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:50.348555 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:50.364666 13280 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:50.323959 18047 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.367714 13252 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:50.369913 13252 leader_election.cc:400] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11.
I20260709 12:20:50.340950 17880 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:50.363905 17708 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:50.372112 17708 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.372511 17708 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:50.372303 17880 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.372898 13203 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:20:50.373252 13203 pending_rounds.cc:85] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 11
I20260709 12:20:50.373452 13203 pending_rounds.cc:107] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:20:50.373553 17880 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:50.373706 13203 raft_consensus.cc:2889] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:50.382272 18085 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:50.383107 13277 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:50.389236 13284 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:50.390013 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.389984 13175 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:50.389686 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.396418 13175 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:50.365562 18092 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:50.398020 18092 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.383819 18103 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.400379 18092 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:50.402974 13279 raft_consensus.cc:2410] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:20:50.408058 13280 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:50.410727 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:50.412052 13249 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:50.412094 18092 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:50.412870 18092 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:50.413535 18013 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:50.414561 18013 raft_consensus.cc:3055] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:50.414901 18013 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:50.370710 18047 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:50.415759 18013 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.417018 18013 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:50.420032 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.420563 13278 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:50.423658 13252 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:50.429265 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 57554.5us
I20260709 12:20:50.370693 18075 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:50.439679 18103 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:50.444373 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:50.446430 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.448149 18085 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:50.448817 17891 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:50.430721 13252 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:50.433452 17914 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:50.433923 17560 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:50.434993 17708 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.435379 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:50.450618 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:50.383977 18050 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:50.454406 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 416941us
I20260709 12:20:50.457460 18047 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.459926 13102 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:50.460117 17772 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:50.454977 17990 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:50.461750 18031 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:50.462318 18031 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:50.464007 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 225248us
W20260709 12:20:50.464955 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.465476 13100 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:50.466379 18068 consensus_queue.cc:1059] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:50.466953 13840 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:50.464038 18053 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:50.468287 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.468894 13278 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:50.469614 17990 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:50.419741 18092 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:50.470691 17990 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.504113 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.474583 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:50.474903 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:50.471206 18092 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.346990 17920 consensus_queue.cc:237] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.485018 13210 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:20:50.482223 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:50.506086 13282 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:20:50.484411 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:50.537717 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 63212.2us
I20260709 12:20:50.538269 13211 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:50.461601 17772 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:50.521238 13205 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:50.525430 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:50.538918 13175 leader_election.cc:400] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11.
W20260709 12:20:50.521353 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 90688.6us
I20260709 12:20:50.539361 13175 leader_election.cc:403] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:50.516659 13286 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:20:50.478411 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:50.540647 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 152181us
I20260709 12:20:50.540647 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:50.431193 18065 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:50.523483 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:50.543341 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.544013 13284 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:50.525131 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:50.531069 13207 raft_consensus.cc:2410] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:20:50.539309 13285 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:50.536749 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:50.550212 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:50.550458 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 85037us
I20260709 12:20:50.550480 13177 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:50.559504 13100 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:50.559800 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 92919.3us
I20260709 12:20:50.552402 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:50.552892 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:50.524631 18050 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:50.555486 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:50.615473 13278 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:50.529778 18047 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:50.622995 13131 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:20:50.623615 13210 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:50.522404 17996 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 12:20:50.603714 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49411.5us
I20260709 12:20:50.628680 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:50.562027 13128 raft_consensus.cc:2393] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:50.538522 17994 raft_consensus.cc:3055] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:50.553251 17796 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:50.552670 17991 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.547739 18101 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:50.652766 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:50.530308 17757 consensus_queue.cc:1048] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 12:20:50.525031 18022 consensus_queue.cc:1059] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:20:50.463294 18031 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.617040 17712 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:50.614221 17988 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:50.619872 18057 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:50.658460 13285 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
W20260709 12:20:50.694766 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.553285 18103 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:50.552765 17973 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.552572 17993 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:50.676622 13210 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
W20260709 12:20:50.670518 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 119537us
W20260709 12:20:50.683527 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 128765us
I20260709 12:20:50.672104 13175 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:50.701670 13841 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:50.688088 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 127491us
I20260709 12:20:50.614495 17976 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:50.560609 18093 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:50.556411 18060 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:50.624259 18075 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:50.706089 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:50.709125 13878 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:50.694896 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:50.711083 13886 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:50.712878 18047 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:50.695734 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:50.638799 18049 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:50.714107 18049 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.716051 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:50.716480 18049 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:50.706161 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:50.658882 18077 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:50.717100 13206 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 11: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:50.717317 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:50.717600 18077 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.719008 13211 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:50.719915 18077 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:50.720114 13208 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:20:50.721263 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:50.722455 13252 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:50.655565 18082 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:50.724745 13207 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:50.687062 17988 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:50.729476 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.732074 13887 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:50.661253 17994 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:50.735960 18099 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:20:50.736249 18049 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:50.738292 18077 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:50.739573 18053 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:50.779870 17994 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.781240 17994 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:50.740645 13211 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:50.762785 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:50.784394 18084 raft_consensus.cc:3055] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:50.784579 13137 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:50.784906 18084 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:50.722218 17993 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.706583 17973 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.805922 17993 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:50.699368 17967 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:50.703581 17712 raft_consensus.cc:697] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:50.762259 18108 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:50.693275 18068 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:20:50.772888 18077 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.833070 18077 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:50.776325 18112 log.cc:927] Time spent T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:50.703821 18097 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.148s
I20260709 12:20:50.744813 17988 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:50.837294 18085 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:50.733743 18075 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.674218 17991 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.687281 18088 consensus_queue.cc:1059] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
W20260709 12:20:50.828366 18116 log.cc:927] Time spent T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:20:50.829419 18080 log.cc:927] Time spent T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:20:50.831048 18021 consensus_meta.cc:287] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.002s
I20260709 12:20:50.700536 18057 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:50.845489 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:50.852123 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 150529us
W20260709 12:20:50.853824 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:50.828387 18114 log.cc:927] Time spent T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:20:50.868865 13878 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:50.818657 18065 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.725678 18060 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.875294 13841 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:50.876519 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 173906us
W20260709 12:20:50.883670 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 61726.8us
I20260709 12:20:50.838922 18121 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:20:50.895747 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:50.895995 13128 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:50.897549 13130 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:50.899852 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:50.785887 18084 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.909003 17996 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:20:50.910449 18125 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:20:50.936520 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:50.937026 18060 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:50.937491 13128 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:50.938386 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:50.940101 13135 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:20:50.913727 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2184) took 1974 ms. Trace:
I20260709 12:20:50.941172 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:50.942289 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3642b79a5a004395947fefe912c71406"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:50.941263 13132 rpcz_store.cc:276] 0709 12:20:48.939073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.542599 (+603526us) service_pool.cc:224] Handling call
0709 12:20:49.542970 (+   371us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:20:49.553209 (+ 10239us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:49.633231 (+ 80022us) log.cc:844] Serialized 14 byte log entry
0709 12:20:49.928125 (+294894us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:20:49.938495 (+ 10370us) log.cc:844] Serialized 78 byte log entry
0709 12:20:49.938669 (+   174us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:49.939359 (+   690us) log.cc:844] Serialized 14 byte log entry
0709 12:20:49.976605 (+ 37246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.979393 (+  2788us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:50.437091 (+457698us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b18003da200. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:50.438629 (+  1538us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b18003da200. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:50.659870 (+221241us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b18003da200. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:50.913493 (+253623us) raft_consensus.cc:1685] finished
0709 12:20:50.913513 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.913668 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132810,"prepare.queue_time_us":287480,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":6176,"raft.queue_time_us":34727,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":16356,"spinlock_wait_cycles":21230976,"thread_start_us":324821,"threads_started":3,"wal-append.queue_time_us":299039}
I20260709 12:20:50.916605 17973 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:50.945508 18093 raft_consensus.cc:697] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:50.920526 13249 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:50.921700 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:50.948500 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:50.922902 18007 raft_consensus.cc:3055] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:50.926805 13883 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:50.923278 18021 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.923755 17708 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:50.942860 13135 raft_consensus.cc:606] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:20:50.948916 13880 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:50.955471 18007 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:50.958907 18007 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.960182 18007 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:50.961863 18108 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:50.962334 18108 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:50.962711 18108 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:50.839594 17967 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.964845 13102 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:50.966434 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1219) took 1359 ms. Trace:
I20260709 12:20:50.950614 13131 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:50.956319 13135 raft_consensus.cc:614] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:50.951869 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:50.970043 13132 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:20:50.952651 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:50.923717 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.948493 13103 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:50.966801 13879 rpcz_store.cc:276] 0709 12:20:49.606831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.612497 (+  5666us) service_pool.cc:224] Handling call
0709 12:20:49.612798 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:49.613225 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.613251 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:49.640325 (+ 27074us) log.cc:844] Serialized 26 byte log entry
0709 12:20:50.444101 (+803776us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b18004a88a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1 00007f70f4e48a0f
0709 12:20:50.526369 (+ 82268us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:50.526405 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.526492 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:50.966109 (+439617us) raft_consensus.cc:1685] finished
0709 12:20:50.966129 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.966370 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15200,"raft.queue_time_us":533,"raft.run_cpu_time_us":4170,"raft.run_wall_time_us":91582,"spinlock_wait_cycles":39559552,"thread_start_us":82099,"threads_started":1,"wal-append.queue_time_us":1005204}
I20260709 12:20:50.946610 18093 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.971767 18024 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:20:50.979043 17880 consensus_meta.cc:287] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.603s	user 0.013s	sys 0.000s
I20260709 12:20:50.919153 18065 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:50.995210 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 291557us
I20260709 12:20:50.984877 17991 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.006968 13137 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
W20260709 12:20:50.999020 17891 consensus_meta.cc:287] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 12:20:50.980055 17712 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:50.977520 17976 raft_consensus.cc:697] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:51.012763 17914 consensus_meta.cc:287] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.001s
I20260709 12:20:51.038570 18057 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:51.013286 18075 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:51.014374 18041 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:51.041129 18041 raft_consensus.cc:3055] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:51.041564 18041 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:51.042471 18041 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.015519 18022 consensus_queue.cc:1059] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:20:50.967605 18021 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:51.046103 18021 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:51.016695 18024 raft_consensus.cc:697] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:50.978987 17988 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.048234 18024 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.054580 17975 raft_consensus.cc:3055] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:51.055073 17975 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:51.056394 18041 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:51.007413 18053 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:51.017688 18122 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:20:51.023600 18009 raft_consensus.cc:3055] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:51.078186 18009 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:51.079202 18009 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.024801 17976 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:50.988700 17967 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.034720 18065 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.049367 17988 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.084757 18108 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.049600 17914 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:51.055994 17975 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.087996 13208 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:20:51.068356 13212 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:51.069221 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.089936 13210 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:51.017079 13878 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:20:51.067060 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.090966 13878 pending_rounds.cc:85] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Aborting all ops after (but not including) 10
I20260709 12:20:51.091244 13878 pending_rounds.cc:107] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:20:51.091536 13878 raft_consensus.cc:2889] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:51.075933 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:51.077081 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.093181 13209 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 8: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:51.087970 18108 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:50.985232 18077 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.095569 18009 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:51.099125 13252 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:51.081794 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:51.104152 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:51.105059 13883 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:51.106455 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:51.108341 13880 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:50.999400 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:51.122958 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:51.124166 13878 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:51.127125 13878 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:51.123070 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 123769us
I20260709 12:20:51.128793 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:51.129850 17967 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:51.041741 18101 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11.
I20260709 12:20:51.132889 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:51.133677 13209 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:51.135488 18054 consensus_queue.cc:1059] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:51.136636 18054 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:51.137058 18054 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:51.138074 18054 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.139338 18054 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:51.144377 13878 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:51.144927 13887 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:51.123884 17988 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:51.097373 18077 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.121884 18085 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:20:51.123817 18053 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:20:51.159562 17990 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:51.168692 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:51.224340 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 240550us
W20260709 12:20:51.176263 18129 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:20:51.232455 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:51.247138 13102 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:51.237556 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 60414us
I20260709 12:20:51.175913 17880 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:51.234982 13175 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:51.131608 13840 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:51.172237 13203 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:51.132164 18092 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:51.178066 17772 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:51.244808 13880 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:51.245535 13879 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:51.246431 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.247129 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.250924 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:51.251825 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:51.257215 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.257344 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.240501 17914 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:51.183058 18021 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:20:51.243302 18065 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.302623 13206 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:51.303936 13204 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:51.260708 13210 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
W20260709 12:20:51.356441 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:51.309792 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:51.309708 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 361270us
W20260709 12:20:51.381103 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:51.381872 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 119767us
W20260709 12:20:51.308987 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 177476us
I20260709 12:20:51.382184 13103 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:51.311107 13249 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:51.347342 13841 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:51.310112 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 56742.8us
I20260709 12:20:51.384093 13102 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:51.258275 18093 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:51.259045 18092 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:51.394037 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:51.394351 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 83370.6us
I20260709 12:20:51.398520 13209 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:51.261132 17891 raft_consensus.cc:2804] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:51.404094 13840 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:51.260849 18105 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 12:20:51.386974 17772 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:51.387027 18057 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.403499 18092 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:51.408221 18057 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.408979 17989 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:51.400332 18108 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.409543 17989 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.410176 18108 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:51.410705 18057 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:51.413709 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:51.414294 18087 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:51.415102 18087 raft_consensus.cc:697] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:51.407709 17772 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.416294 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:51.416113 18087 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.418533 17879 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:51.423341 13177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.039s	sys 0.076s
W20260709 12:20:51.424014 13177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.039s	sys 0.076s
I20260709 12:20:51.383158 18062 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:51.424463 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:51.410953 18031 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:51.414320 13135 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:51.427124 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:51.425141 13286 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:51.430976 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:51.432302 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 85080.6us
I20260709 12:20:51.433012 13841 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:51.354521 13212 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:51.431530 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:51.408253 18139 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:51.413194 17994 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:51.393852 18101 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.403621 18018 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.439199 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:51.440969 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:51.443696 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:51.459030 13286 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:51.439142 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:51.389081 17876 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:20:51.451912 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:51.462496 13281 raft_consensus.cc:3060] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:51.452673 13206 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:51.457747 13887 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:51.430518 17974 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.301458 17914 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:51.509379 17974 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.467247 13177 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:51.513724 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 46553.3us
I20260709 12:20:51.430127 18013 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:20:51.432842 17891 raft_consensus.cc:697] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:51.435509 18123 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.258036 18075 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.190s
I20260709 12:20:51.445557 17994 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.447054 18031 raft_consensus.cc:697] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:51.348423 18065 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.521796 13286 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:51.438933 18127 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:51.455463 17708 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.553802 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:51.559484 13286 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:51.557483 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.560714 13209 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:51.560752 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:51.562003 13286 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:51.564658 13286 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:20:51.565446 13286 pending_rounds.cc:85] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 8
I20260709 12:20:51.565858 13286 pending_rounds.cc:107] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:20:51.566233 13286 raft_consensus.cc:2889] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:51.466380 17989 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.469873 18062 raft_consensus.cc:697] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:51.570684 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:51.525527 18013 consensus_queue.cc:1243] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:51.577431 13280 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:51.578341 13840 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:51.521021 18099 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:51.549823 17914 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.512878 17974 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.524981 18122 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.537760 17994 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:51.524329 17988 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.586791 13840 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:51.526254 18049 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.469522 17990 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 12:20:51.604357 17987 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.606369 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.607661 13208 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:51.607546 17987 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.607932 17988 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.608765 18031 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.610471 17988 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.605007 18139 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.569201 18144 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:51.612331 18142 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:20:51.468689 18018 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:51.591082 17989 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:51.612852 18144 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.613565 17989 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:51.614032 17989 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:51.612135 18049 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:51.616266 18135 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:20:51.617027 18049 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:51.617525 13840 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:51.618872 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:51.585001 18133 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:51.619503 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.619637 17974 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:51.615901 18122 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.621066 18018 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:51.539239 18123 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.623979 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.611848 18139 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.624600 13209 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:51.625727 18123 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:51.626886 13282 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:20:51.563730 17725 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.572855 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:51.466207 18101 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:51.630278 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:51.649283 13840 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:51.627280 13282 pending_rounds.cc:85] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 6
I20260709 12:20:51.638667 13204 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:51.650570 13282 pending_rounds.cc:107] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:20:51.652587 13840 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:51.653487 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.653357 13282 raft_consensus.cc:2889] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:51.656630 13207 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:51.658722 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.658872 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.612313 17987 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:51.650655 13132 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:51.626070 18139 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:51.659581 13209 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:51.661417 13280 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:51.663698 13286 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:51.588358 18093 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.611088 17988 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:51.665202 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 247746us
W20260709 12:20:51.596140 18143 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 12:20:51.596877 18137 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:20:51.604569 18108 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:51.668202 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:51.622394 18122 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.573359 17708 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.691419 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:51.670396 18024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.011s	sys 0.011s
I20260709 12:20:51.654285 18123 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:51.663538 18127 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:51.664062 17974 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:51.701572 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 273742us
I20260709 12:20:51.707942 13129 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:51.699818 18024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.012s	sys 0.012s
I20260709 12:20:51.653023 17725 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:51.670964 17967 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:20:51.661460 18133 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.742002 13208 raft_consensus.cc:1217] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-14.9]   Dedup: 9.6->[10.7-14.9]
I20260709 12:20:51.742594 13208 pending_rounds.cc:85] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 6
I20260709 12:20:51.742928 13208 pending_rounds.cc:107] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:20:51.704566 18121 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:51.743228 13208 raft_consensus.cc:2889] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:51.687947 18139 consensus_queue.cc:1059] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:20:51.706815 17974 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.687752 17987 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:20:51.744474 13283 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:51.684072 18093 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:51.747094 18130 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.739s	user 0.003s	sys 0.000s
W20260709 12:20:51.788692 18140 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.263s	user 0.002s	sys 0.001s
I20260709 12:20:51.751899 18101 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.752161 18065 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:51.757085 18149 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.791947 18149 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.792932 17708 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:51.794035 18149 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:51.707726 18127 raft_consensus.cc:697] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:51.795720 13136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 910) took 1165 ms. Trace:
I20260709 12:20:51.795374 18127 consensus_queue.cc:237] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.796074 13136 rpcz_store.cc:276] 0709 12:20:50.630416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.632253 (+  1837us) service_pool.cc:224] Handling call
0709 12:20:50.632550 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:50.966769 (+334219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:50.966804 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:50.967330 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:20:51.060753 (+ 93423us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b48000d05d8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f9db6aa1 00007f70f9dadb37 00007f70f9dad9ca 00007f70f9ea526f 00007f70f9ea4f37 00007f70f9eb955c 00007f70f9eb9508 00007f70f9eb9488 00007f70f9eb9443 00007f70f9eb86ec 00007f70f8de2a96
0709 12:20:51.171234 (+110481us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:51.171262 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.171356 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.787982 (+616626us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:51.795504 (+  7522us) raft_consensus.cc:1685] finished
0709 12:20:51.795527 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.795658 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317985,"raft.queue_time_us":331087,"raft.run_cpu_time_us":2363,"raft.run_wall_time_us":79633,"spinlock_wait_cycles":46024320,"thread_start_us":190597,"threads_started":1,"wal-append.queue_time_us":450257}
I20260709 12:20:51.739249 18062 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.757542 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2203) took 1551 ms. Trace:
I20260709 12:20:51.798482 13133 rpcz_store.cc:276] 0709 12:20:50.205804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.206699 (+   895us) service_pool.cc:224] Handling call
0709 12:20:50.207070 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:50.467730 (+260660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:50.467762 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:50.468325 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 12:20:50.548603 (+ 80278us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:50.638597 (+ 89994us) log.cc:844] Serialized 14 byte log entry
0709 12:20:50.915806 (+277209us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b18003639a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d1ac0a 00007f70fb45a219 00007f70f1da2a40 00007f70f1d9d4e4 00007f70f1d9d455 00007f70f4e85060 00007f70f4e97716 00007f70f4ea8287 00007f70f4ea8208
0709 12:20:51.742026 (+826220us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.757152 (+ 15126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.757238 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.757353 (+   115us) raft_consensus.cc:1685] finished
0709 12:20:51.757367 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.757489 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1191058,"prepare.queue_time_us":917712,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":567072,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":10489,"spinlock_wait_cycles":8618880,"thread_start_us":67025,"threads_started":1,"wal-append.queue_time_us":225885}
I20260709 12:20:51.757929 18088 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:51.804762 13838 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:51.806016 13838 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:51.806708 17988 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.767729 17974 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:51.807612 17967 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:51.808177 17967 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:51.808561 17967 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:51.763255 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:51.765662 18024 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.817529 18024 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:51.818209 18084 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:51.773351 17725 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.778121 17994 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.779769 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:51.781076 18133 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:51.769594 18144 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:51.783694 18093 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:51.807673 13203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 3161) took 1369 ms (client timeout 1534 ms). Trace:
W20260709 12:20:51.827849 13203 rpcz_store.cc:269] 0709 12:20:50.438013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.521325 (+ 83312us) service_pool.cc:224] Handling call
0709 12:20:51.807513 (+1286188us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54002a1cd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:51.807616 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376769408}
I20260709 12:20:51.663313 17891 consensus_queue.cc:237] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:51.811378 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48214.7us
I20260709 12:20:51.830760 13841 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:51.813086 13281 raft_consensus.cc:2468] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:51.833923 18009 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.834468 18009 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:51.836508 18009 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:51.838196 13286 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:51.838305 17712 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.838886 17712 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.840835 17880 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:51.841504 17712 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:51.842342 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.842945 13203 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:51.807190 17988 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.845201 17988 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:51.845705 17988 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:51.846119 17988 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:51.847280 17975 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:51.847750 13883 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:51.847020 17988 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.849011 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:51.850816 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:51.851390 13886 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:51.852659 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:51.854007 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:51.841355 17880 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:51.810829 18145 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:20:51.810299 17989 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:51.816782 18119 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:51.817054 17996 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:51.825178 13887 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:51.885414 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.831049 13277 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:51.886621 13203 raft_consensus.cc:2410] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:20:51.769923 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:51.858175 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:51.887399 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 117574us
I20260709 12:20:51.879490 13883 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 12:20:51.877889 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 193318us
I20260709 12:20:51.882040 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:51.883061 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:51.898427 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.831480 18024 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:51.911938 13206 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:51.870476 18084 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.914674 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:51.918133 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:51.919762 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:51.884310 18119 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.888206 17996 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.923264 13841 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:51.855751 18092 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:51.928021 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:51.938723 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.905925 18152 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:51.883906 18144 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 12:20:51.973167 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.923581 18024 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:51.928198 18119 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:51.938239 17996 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:51.947209 18101 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.969830 17708 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.973658 18152 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.927878 17990 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:20:51.978663 18024 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.923704 18084 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:51.986356 18057 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.983800 18133 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:52.028537 13277 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:52.008911 18024 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:51.992861 18152 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:52.033778 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:51.983798 17974 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.035305 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:52.037410 13210 raft_consensus.cc:2376] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11. Re-sending same reply.
I20260709 12:20:51.992555 18101 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:52.052380 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 129191us
I20260709 12:20:51.993444 17708 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.034015 17988 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:52.059010 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:52.060829 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:52.060743 13840 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:52.069011 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.070684 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.055748 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.080060 13207 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:20:52.080053 13204 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:52.080313 13205 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:52.058203 13249 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:52.084394 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:52.086261 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:52.089821 13210 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:52.029920 18138 consensus_queue.cc:1059] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:20:52.027750 18057 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.096655 13209 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:52.098927 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.099742 13209 raft_consensus.cc:2410] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:20:52.052893 18093 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.047277 18065 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:52.104642 13203 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:52.030192 18133 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.116906 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:52.129956 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.130781 13209 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:52.097472 18151 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.082110 17989 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.133821 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.095443 18053 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:52.135566 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.094280 18156 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:52.133221 17891 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:52.143956 17891 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.146139 17891 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:52.146607 18161 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:52.147228 18161 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.147581 18041 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:52.148250 18041 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.149710 18161 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.150481 18041 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.151661 17914 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:52.151995 18159 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:20:52.152103 13136 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:52.152267 17914 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.153373 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.154906 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.155158 17914 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.157752 18057 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:52.158284 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.158344 18075 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:52.159174 13128 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:20:52.160567 18092 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:52.161352 18092 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.161816 18092 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.136567 18018 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:52.164741 17708 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:52.169384 18084 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:52.115921 18122 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:52.169970 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.170596 13277 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:52.114367 18108 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.146917 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.171397 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.177253 13277 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:20:52.177433 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:52.177980 13210 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:52.178766 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.179397 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.175897 13133 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:52.180168 17708 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:52.183777 17708 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.184113 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.184806 13211 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:52.182977 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.185328 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.185842 17708 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:52.185927 13131 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:52.186084 13205 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:52.130124 18013 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:52.187206 13102 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:52.190757 13102 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:52.193468 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.194427 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:52.195232 13128 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:52.196791 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.202523 13285 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:52.200577 17875 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:52.207829 17875 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.208182 17875 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:52.209825 13279 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:20:52.212950 18139 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:52.213378 18139 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.213734 18139 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:52.143332 18151 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.217726 18151 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:52.128924 18065 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.219898 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.221987 18065 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.223232 18101 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.114837 18093 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.173945 18133 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:52.230756 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.232108 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.232409 13205 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:20:52.237260 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.243846 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.243971 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.256745 13210 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:20:52.256879 13204 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:52.247049 13205 pending_rounds.cc:85] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 9
I20260709 12:20:52.257489 13205 pending_rounds.cc:107] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:20:52.257704 13205 raft_consensus.cc:2889] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:52.247387 13277 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:52.248334 13211 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:52.250247 13207 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:52.250548 13129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:52.261557 13129 raft_consensus.cc:606] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:20:52.261853 13129 raft_consensus.cc:614] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:52.262545 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.262964 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.248528 13130 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 8.
I20260709 12:20:52.263908 13281 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:20:52.251089 13177 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:52.249107 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:52.265996 13103 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:52.271245 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.279815 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.172289 18108 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.281162 13212 raft_consensus.cc:2410] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:20:52.286382 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.285331 13177 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:52.289580 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.289119 13211 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:52.255785 17990 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.245505 18093 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:52.279501 18173 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:20:52.269534 18077 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.267956 18013 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.318068 18013 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.268162 18065 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:20:52.320600 18108 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:52.323511 17990 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.323686 17876 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:52.325706 17990 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.326464 18089 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:52.293578 18156 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.327862 18156 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.329896 17996 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.330896 18156 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:52.334053 13102 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:52.282473 18133 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:52.316713 18077 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.302770 17772 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:20:52.282416 18057 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:52.350000 18024 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.339864 17880 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.335319 18119 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.332634 13878 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:52.342216 18053 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:52.269845 18151 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:20:52.287768 18103 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:20:52.369688 18133 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.412448 13284 raft_consensus.cc:2393] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:52.287379 17974 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.280231 17891 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:20:52.345278 17796 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.338641 17875 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.353513 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:52.417420 13207 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:52.356875 13880 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:52.311733 17967 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:52.347616 18150 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.430s	user 0.002s	sys 0.002s
I20260709 12:20:52.365437 13128 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:20:52.370447 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:52.411290 18062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.018s	sys 0.010s
I20260709 12:20:52.382897 18161 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:52.307377 17994 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.435523 13132 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 13: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:20:52.425523 18062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.018s	sys 0.010s
I20260709 12:20:52.394718 18152 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:52.391281 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 299675us
I20260709 12:20:52.392390 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:52.455703 13212 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:52.391934 13885 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:52.321084 18013 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:52.399595 13280 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:52.341646 13286 raft_consensus.cc:2393] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:20:52.406071 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 271967us
I20260709 12:20:52.371390 18054 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:52.411309 13137 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:52.358963 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 73751.1us
I20260709 12:20:52.463728 13283 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:20:52.464078 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 198173us
I20260709 12:20:52.420053 13886 raft_consensus.cc:1240] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:20:52.387671 18057 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:52.423249 17796 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.415611 18133 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:52.392802 17975 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:52.482532 13103 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:52.484218 13207 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:52.490754 13252 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:52.494316 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.494673 13131 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:52.495573 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.496466 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:52.514668 18181 log.cc:927] Time spent T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:20:52.514832 18184 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:20:52.562470 13136 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
W20260709 12:20:52.563275 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 72638.8us
W20260709 12:20:52.564069 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 89981.4us
I20260709 12:20:52.463092 18054 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.463243 18127 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:52.570755 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.571419 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:52.572096 13252 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:52.572924 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.497933 18014 raft_consensus.cc:3055] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:52.497982 18057 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:52.573805 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.578179 13252 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:52.516312 18099 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.571321 13103 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:52.602093 13103 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:52.519251 17975 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.594808 13129 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:52.595058 13252 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:52.597088 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:52.560418 18105 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.599139 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:52.606478 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:52.615113 13285 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:52.609331 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:52.584124 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:52.616170 13278 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:52.616074 13879 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:52.615310 13882 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:20:52.578356 18014 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:52.574203 18013 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:52.628260 13285 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:52.622560 13252 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:52.627147 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:52.570261 18194 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:52.619274 13885 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:20:52.630115 13840 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:52.596508 18021 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:52.631315 13277 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:52.632565 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:52.574945 18054 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:52.582386 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:52.682276 13883 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:20:52.620220 17975 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:52.641181 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.687922 13129 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:52.619448 18108 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:52.697348 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:52.566764 18103 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:52.623586 18121 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:52.628455 18013 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.595211 18127 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.633944 18024 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:52.592139 18199 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:20:52.629792 18049 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:52.705142 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:52.639710 18119 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.684012 18088 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:20:52.709779 18191 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:52.711612 18103 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:52.712292 18192 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:20:52.711630 18127 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:52.713389 18187 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 12:20:52.714596 18190 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:20:52.703627 18121 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:52.698408 17914 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.640091 18021 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.734129 13278 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:52.639649 17976 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:52.754676 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:52.705219 13252 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:52.755712 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 179477us
I20260709 12:20:52.769529 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.698289 18087 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:52.826689 18087 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.827099 18087 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:52.697276 18108 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.618382 18099 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.781682 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.707523 18013 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:52.845934 18121 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.848129 18013 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.848487 18087 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.849565 18099 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:52.704058 18183 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:52.850493 18087 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:52.850955 18183 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.851332 18087 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:52.851631 18183 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:52.852059 18087 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:52.853201 18087 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:52.824401 18193 log.cc:927] Time spent T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:20:52.858088 18108 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:52.630800 18105 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.742152 17875 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.804401 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.815847 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:52.765131 18049 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.823550 17914 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.824352 18021 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:52.824991 17976 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:52.887578 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 72240.6us
I20260709 12:20:52.888633 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:52.825830 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:52.891219 13883 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:52.850396 18013 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:52.873132 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.893985 13135 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
W20260709 12:20:52.886283 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 256250us
I20260709 12:20:52.897006 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:52.896942 13840 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:52.900449 13840 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:52.830411 18065 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:52.910332 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:52.742550 18014 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.881137 18049 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:52.892244 17976 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:52.919279 18190 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:52.887171 18077 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:52.946358 18201 log.cc:927] Time spent T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:20:52.952813 18103 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:52.953374 18103 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.953868 18103 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.955009 18105 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:52.955593 18105 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:52.956054 18105 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.910347 18152 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:52.895869 18207 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:52.935228 18192 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:52.923568 17988 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:20:52.964042 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 258888us
I20260709 12:20:52.944366 18053 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:52.932739 18065 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:52.947773 18014 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:53.018997 13175 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:52.922533 18099 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 12:20:52.964649 18189 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:20:52.971324 18211 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:52.972318 18121 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:52.973088 18176 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:52.975864 18103 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:52.982060 18105 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:52.982998 18054 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.986651 13878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 1240) took 1139 ms. Trace:
I20260709 12:20:52.989645 17975 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:52.966455 18205 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:52.999250 13285 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:53.057350 13878 rpcz_store.cc:276] 0709 12:20:51.846911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.848785 (+  1874us) service_pool.cc:224] Handling call
0709 12:20:52.986426 (+1137641us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54005cd5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:52.986584 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110094080}
I20260709 12:20:53.025242 17988 raft_consensus.cc:697] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:53.060127 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:53.017722 18057 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:53.020366 18053 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:53.019543 18108 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:53.093205 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 69666.9us
W20260709 12:20:53.095983 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 386963us
I20260709 12:20:53.057464 18205 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.096312 13175 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:53.065203 18105 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:53.099985 17914 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:53.103873 17988 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:53.095351 18121 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:20:53.116930 18099 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:53.122316 17880 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:53.092164 18189 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:20:53.025965 18133 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:53.109794 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49916.9us
I20260709 12:20:53.083662 18176 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:53.113503 13175 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:53.142086 13175 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:53.116142 13285 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:20:53.116992 13278 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:53.117446 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:53.057034 18152 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:20:53.028195 18183 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:53.106592 18057 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:53.124274 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 929) took 1244 ms. Trace:
I20260709 12:20:53.157083 13137 rpcz_store.cc:276] 0709 12:20:51.880089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.880690 (+   601us) service_pool.cc:224] Handling call
0709 12:20:51.881065 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.463170 (+582105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.124010 (+660840us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b5400136fd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:53.124209 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218967424}
I20260709 12:20:53.124900 18053 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:53.030241 18211 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:53.112201 18085 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:53.135591 13277 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:53.144270 18213 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:53.148042 18176 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:53.150213 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 1917) took 1440 ms. Trace:
W20260709 12:20:53.145023 18139 consensus_meta.cc:287] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.931s	user 0.014s	sys 0.000s
I20260709 12:20:53.151139 18108 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:53.151964 17975 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:53.168483 13208 rpcz_store.cc:276] 0709 12:20:51.709647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.709820 (+   173us) service_pool.cc:224] Handling call
0709 12:20:51.739329 (+ 29509us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:20:51.811248 (+ 71919us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:52.017705 (+206457us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.407487 (+389782us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:20:52.414414 (+  6927us) log.cc:844] Serialized 78 byte log entry
0709 12:20:52.414612 (+   198us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:52.414649 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.414723 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:53.149979 (+735256us) raft_consensus.cc:1685] finished
0709 12:20:53.150002 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.150154 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":270675,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":347,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":8263,"thread_start_us":552461,"threads_started":2,"wal-append.queue_time_us":425484}
I20260709 12:20:53.172281 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:53.173354 13212 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:53.114849 18205 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:53.160643 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:53.175105 13207 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:53.162468 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:53.166409 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:53.177943 13203 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:53.178462 18220 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:53.185339 18220 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:53.185750 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:53.186471 13208 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:53.188266 17967 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:53.189144 18133 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:53.167881 18085 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.185725 18220 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:53.189977 18085 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:53.191527 13135 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:53.174654 18213 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:53.174815 18139 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:53.195627 13131 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:53.197108 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.197751 13878 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:53.197973 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.198715 13884 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:53.199201 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.200091 18065 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:53.200413 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.201086 13878 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:53.201498 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.201889 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:53.202108 18211 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:53.202477 13878 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:53.202695 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:53.203321 13884 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:53.168754 18013 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.204095 18013 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:53.205137 18204 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:53.210598 13884 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:20:53.211063 13203 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:53.219180 13878 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:53.221246 13208 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:20:53.132107 18049 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:53.218667 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:53.228824 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.165184 18087 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.230754 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.209260 18220 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:53.244253 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:53.245242 13277 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:53.244853 18220 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:53.259310 13252 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:53.278484 13282 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:20:53.279903 13252 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:53.353530 13277 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:53.312285 18218 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:53.394201 18218 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:53.394897 18212 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:53.284499 13207 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:53.258020 18053 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:53.403729 18053 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:53.406975 18084 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.000s	sys 0.021s
W20260709 12:20:53.407819 18084 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.000s	sys 0.021s
I20260709 12:20:53.410763 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.324126 18108 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:53.419365 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3193) took 1169 ms. Trace:
I20260709 12:20:53.423265 13205 rpcz_store.cc:276] 0709 12:20:52.250454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.258436 (+  7982us) service_pool.cc:224] Handling call
0709 12:20:52.258709 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:52.259029 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.259063 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:52.286108 (+ 27045us) log.cc:844] Serialized 26 byte log entry
0709 12:20:52.452563 (+166455us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:52.500801 (+ 48238us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.564705 (+ 63904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.564786 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:53.250441 (+685655us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b18004863a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:53.414292 (+163851us) raft_consensus.cc:1685] finished
0709 12:20:53.419139 (+  4847us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.419287 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13204,"prepare.queue_time_us":30480,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":5172,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":14101,"spinlock_wait_cycles":31193216,"thread_start_us":116231,"threads_started":1,"wal-append.queue_time_us":254616}
I20260709 12:20:53.388187 18220 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.354202 17988 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:53.324905 18009 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:53.439167 18198 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.719s	user 0.000s	sys 0.002s
W20260709 12:20:53.439839 18223 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:20:53.419027 18213 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:53.441537 18213 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:53.442127 18213 raft_consensus.cc:697] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:53.442554 17796 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:53.409032 18054 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:53.448154 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.450904 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1247) took 1388 ms. Trace:
I20260709 12:20:53.445160 18220 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:53.471614 13887 rpcz_store.cc:276] 0709 12:20:52.062184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.062328 (+   144us) service_pool.cc:224] Handling call
0709 12:20:52.094529 (+ 32201us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:52.256734 (+162205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.256773 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:52.274069 (+ 17296us) log.cc:844] Serialized 52 byte log entry
0709 12:20:52.600205 (+326136us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:52.624984 (+ 24779us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.769785 (+144801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.769870 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:53.438508 (+668638us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:53.443967 (+  5459us) raft_consensus.cc:1685] finished
0709 12:20:53.450659 (+  6692us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.450833 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50629,"prepare.queue_time_us":29721,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":163994,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":9245,"spinlock_wait_cycles":81152768,"thread_start_us":521499,"threads_started":3,"wal-append.queue_time_us":387741}
I20260709 12:20:53.473984 18220 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:53.443030 18213 consensus_queue.cc:237] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:53.476229 18092 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:53.483024 18053 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:53.372553 18021 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:53.485255 18021 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:53.443626 18139 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:53.256017 18087 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:53.487629 18087 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:53.416519 18218 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:53.452832 18183 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:53.501151 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.447364 18009 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:53.467270 18049 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:53.504014 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.505242 13887 raft_consensus.cc:2410] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:20:53.507822 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 228055us
I20260709 12:20:53.446487 17988 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:53.521023 13284 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 3123) took 1597 ms (client timeout 1595 ms). Trace:
W20260709 12:20:53.521536 13284 rpcz_store.cc:269] 0709 12:20:51.923966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.048999 (+125033us) service_pool.cc:224] Handling call
0709 12:20:53.520785 (+1471786us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54002314d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:53.520943 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762975104}
I20260709 12:20:53.535859 17757 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:53.536942 17757 raft_consensus.cc:3055] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:53.537271 17757 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:53.538137 17757 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:53.543660 13130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1686) took 1366 ms (client timeout 1739 ms). Trace:
W20260709 12:20:53.544082 13130 rpcz_store.cc:269] 0709 12:20:52.177510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.179106 (+  1596us) service_pool.cc:224] Handling call
0709 12:20:53.543492 (+1364386us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b54001379d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:53.543605 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157108096}
I20260709 12:20:53.550762 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2213) took 1059 ms. Trace:
W20260709 12:20:53.550876 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 918301us
I20260709 12:20:53.553007 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2342) took 1694 ms. Trace:
I20260709 12:20:53.553437 13283 rpcz_store.cc:276] 0709 12:20:51.858802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.919498 (+ 60696us) service_pool.cc:224] Handling call
0709 12:20:53.552803 (+1633305us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400332054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:53.552938 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242224896}
I20260709 12:20:53.554996 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:53.556084 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:53.556231 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:53.556643 13281 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:53.559521 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:53.551214 13128 rpcz_store.cc:276] 0709 12:20:52.491930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.492134 (+   204us) service_pool.cc:224] Handling call
0709 12:20:52.492561 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.492946 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:52.493387 (+   441us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.638188 (+144801us) log.cc:844] Serialized 14 byte log entry
0709 12:20:53.252367 (+614179us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b1800410bc0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d6e2a6 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1
0709 12:20:53.278976 (+ 26609us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b1800410bc0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:53.550265 (+271289us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b1800410bc0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d1ac0a 00007f70fb45a219 00007f70f1da2a40 00007f70f1d9d4e4 00007f70f1d9d455 00007f70f4e85060 00007f70f4e97716 00007f70f4ea8287 00007f70f4ea8208
0709 12:20:53.550418 (+   153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:53.550466 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:53.550517 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.550590 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.550703 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19628,"prepare.queue_time_us":4853,"prepare.run_cpu_time_us":1689,"prepare.run_wall_time_us":1701,"raft.queue_time_us":19922,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":13958,"spinlock_wait_cycles":208485248,"thread_start_us":127186,"threads_started":1,"wal-append.queue_time_us":297762}
I20260709 12:20:53.568135 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:53.568823 18138 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:53.569720 18138 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.570297 18138 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:53.571410 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.572145 13885 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:53.568861 13207 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:53.699486 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:53.626243 13252 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:53.593434 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1689) took 1363 ms. Trace:
I20260709 12:20:53.705060 13279 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:53.705296 13135 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:53.698740 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:53.705323 13132 rpcz_store.cc:276] 0709 12:20:52.230504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.231818 (+  1314us) service_pool.cc:224] Handling call
0709 12:20:53.593181 (+1361363us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540011d854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:53.593353 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430554496}
I20260709 12:20:53.573866 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:53.606585 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 942) took 1696 ms. Trace:
I20260709 12:20:53.707559 13203 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:53.707861 13886 rpcz_store.cc:276] 0709 12:20:51.910136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.910317 (+   181us) service_pool.cc:224] Handling call
0709 12:20:51.910732 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:52.482259 (+571527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.606268 (+1124009us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b5400691ed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:53.606514 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170502912}
I20260709 12:20:53.572443 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:53.602979 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2345) took 1736 ms. Trace:
I20260709 12:20:53.709228 13280 rpcz_store.cc:276] 0709 12:20:51.866167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.178539 (+312372us) service_pool.cc:224] Handling call
0709 12:20:53.602758 (+1424219us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540023bc54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:53.602892 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506396416}
W20260709 12:20:53.704033 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.605875 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2347) took 1389 ms. Trace:
W20260709 12:20:53.698261 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 49833.2us
W20260709 12:20:53.698916 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 146955us
I20260709 12:20:53.711050 13286 rpcz_store.cc:276] 0709 12:20:52.216930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.230435 (+ 13505us) service_pool.cc:224] Handling call
0709 12:20:53.605596 (+1375161us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b54002652d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:53.605794 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217728256}
I20260709 12:20:53.648274 13205 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:20:53.712955 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:53.706905 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.714363 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:53.715278 13205 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:53.579919 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:53.763073 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.726035 13281 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:53.818308 13284 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:20:53.725399 13103 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:53.816931 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 190810us
I20260709 12:20:53.819687 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:53.821262 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:53.821774 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 107031us
I20260709 12:20:53.822497 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:53.720961 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:53.823653 13283 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:53.823807 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:53.823760 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:53.825593 13130 raft_consensus.cc:2410] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:20:53.826009 13207 raft_consensus.cc:2468] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:53.826884 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:53.820003 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:53.832571 13131 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:20:53.833709 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:53.834440 13285 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:53.834542 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:53.834786 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:53.835620 13208 raft_consensus.cc:3060] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:53.841357 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:53.848366 13203 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:53.849681 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:53.850801 13128 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:53.852685 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:53.853451 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 128153us
I20260709 12:20:53.853505 13212 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:53.854282 13103 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:53.854842 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3175) took 1791 ms. Trace:
I20260709 12:20:53.860199 13136 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:53.866909 13208 raft_consensus.cc:2468] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:53.585093 17996 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:53.720171 18213 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:53.869398 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:53.609671 18196 log.cc:927] Time spent T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.894s	user 0.003s	sys 0.000s
I20260709 12:20:53.870774 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:53.871206 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:53.722259 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:53.855273 13206 rpcz_store.cc:276] 0709 12:20:52.062994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.063195 (+   201us) service_pool.cc:224] Handling call
0709 12:20:52.063532 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.141992 (+ 78460us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:52.190238 (+ 48246us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.629071 (+438833us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.739686 (+110615us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.739748 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:52.739800 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.263479 (+523679us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4800002dd8. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f9db6aa1 00007f70f9dadb37 00007f70f9dad9ca 00007f70f9ea526f 00007f70f9ea4f37 00007f70f9eb955c 00007f70f9eb9508 00007f70f9eb9488 00007f70f9eb9443 00007f70f9eb86ec 00007f70f8de2a96
0709 12:20:53.854574 (+591095us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b540002c454. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:53.854641 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.854784 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19369,"prepare.queue_time_us":141117,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":107,"raft.queue_time_us":114066,"raft.run_cpu_time_us":3953,"raft.run_wall_time_us":795117,"spinlock_wait_cycles":219085952,"thread_start_us":527214,"threads_started":3,"wal-append.queue_time_us":264971}
W20260709 12:20:53.875298 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 162404us
I20260709 12:20:53.815593 17757 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:53.878006 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:53.982597 13210 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:20:53.594066 17976 consensus_meta.cc:287] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.004s
I20260709 12:20:53.879487 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:53.975193 13128 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:53.881121 13207 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:20:53.720937 18161 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:53.992751 13130 raft_consensus.cc:2393] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:54.000499 13205 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:54.003670 13285 raft_consensus.cc:1275] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:53.988947 18149 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:54.006639 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 152411us
I20260709 12:20:54.009292 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:54.013586 13282 raft_consensus.cc:2410] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:20:54.011164 13128 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
W20260709 12:20:54.023088 13250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.026s	sys 0.028s
W20260709 12:20:54.064069 13250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.027s	sys 0.033s
I20260709 12:20:53.581182 17891 consensus_queue.cc:1059] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.424s
I20260709 12:20:54.041429 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:53.575870 18085 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:54.074174 13880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.023s	sys 0.016s
W20260709 12:20:54.093629 13880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.024s	sys 0.016s
W20260709 12:20:54.016111 18108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.063s	sys 0.091s
I20260709 12:20:54.090665 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:54.095839 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 62396.5us
I20260709 12:20:53.974769 18215 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:20:54.091779 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 69852.8us
I20260709 12:20:53.995379 17975 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:54.094161 13131 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:54.123724 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:54.101500 13175 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:53.880975 18182 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.188s
W20260709 12:20:54.073980 18151 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.002s	sys 0.036s
W20260709 12:20:54.118345 18108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.069s	sys 0.107s
I20260709 12:20:54.012223 18138 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.006016 17772 consensus_queue.cc:1059] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 12:20:54.023033 18031 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:53.991225 18014 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 12:20:54.125404 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:54.125519 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:54.077769 18149 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:20:53.599103 18013 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:53.816252 18084 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:53.583976 18183 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:54.034394 17976 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:54.078831 18185 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.026s	sys 0.014s
I20260709 12:20:54.132277 13282 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:53.584197 18139 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:53.857940 18075 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:53.721057 18194 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:53.832582 18089 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:54.134699 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:54.122639 17988 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:53.991698 18213 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.137415 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:53.881078 18057 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:53.874269 18053 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:54.134126 18151 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.002s	sys 0.037s
I20260709 12:20:54.076553 17875 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:20:54.121431 18215 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.619086 18205 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.015733 18161 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.133842 18065 raft_consensus.cc:2764] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:20:53.897631 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:54.234596 13285 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:20:54.157429 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:54.159003 13279 raft_consensus.cc:2368] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 12. Current term is 13.
I20260709 12:20:54.136475 17876 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.137145 18009 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.136626 18108 raft_consensus.cc:697] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:54.137317 18176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.021s	sys 0.033s
I20260709 12:20:54.131279 18144 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:20:54.159651 17891 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:54.211263 13286 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:54.230959 18215 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:54.161972 18062 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:54.186172 18185 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.026s	sys 0.014s
I20260709 12:20:54.210767 18139 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.219107 18194 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:54.220844 18229 log.cc:927] Time spent T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:20:54.181877 18084 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:54.164435 17880 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:20:54.222568 18085 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:54.186990 18183 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:54.257201 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 48057.6us
I20260709 12:20:54.230005 18053 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.235383 18156 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:54.246407 18176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.021s	sys 0.035s
I20260709 12:20:54.265057 18065 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:54.226511 18057 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:54.242354 17876 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:54.273465 13280 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:54.210618 13284 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:54.278673 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:54.280014 18231 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:20:54.280719 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 864) took 1713 ms. Trace:
I20260709 12:20:54.282387 18084 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:54.286558 18183 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.214522 18089 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.254493 18075 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:54.306528 13880 rpcz_store.cc:276] 0709 12:20:52.567162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.567343 (+   181us) service_pool.cc:224] Handling call
0709 12:20:52.567689 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:52.613458 (+ 45769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.613504 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:53.546337 (+932833us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b2c00033c98. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:20:53.546757 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:20:54.094040 (+547283us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:54.094081 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.094148 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:54.280414 (+186266us) raft_consensus.cc:1685] finished
0709 12:20:54.280431 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.280660 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51705,"raft.queue_time_us":50318,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5326,"spinlock_wait_cycles":22056192,"thread_start_us":546910,"threads_started":1,"wal-append.queue_time_us":731867}
I20260709 12:20:54.269797 18062 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.316895 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.317631 13137 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:20:54.308125 17796 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:20:54.300031 17891 consensus_queue.cc:1059] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:20:54.321818 18009 raft_consensus.cc:3055] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:54.322216 18009 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:54.323474 18205 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.322235 18213 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.325192 18139 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.295524 18156 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:54.325870 17974 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:54.327576 18156 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:54.328672 18089 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.329493 18057 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:54.323102 18009 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:54.337644 13286 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
W20260709 12:20:54.356333 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:54.307871 18018 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.036s	sys 0.039s
I20260709 12:20:54.325558 13034 catalog_manager.cc:5697] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:54.357760 18018 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.036s	sys 0.039s
I20260709 12:20:54.364024 13177 leader_election.cc:400] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 12. Current term is 13.
I20260709 12:20:54.364967 13177 leader_election.cc:403] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:20:54.375304 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:54.378643 13177 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:54.377126 17891 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:54.380561 18194 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.361277 18205 consensus_queue.cc:1059] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:20:54.384060 17708 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:54.384243 17967 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:54.384728 17708 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:54.384959 17967 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.387465 18009 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:54.362720 17974 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:54.388200 17974 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.376008 17976 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.389866 17708 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:54.312361 17996 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:20:54.400179 18240 log.cc:927] Time spent T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:20:54.402245 18053 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.403172 18205 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:54.404016 18205 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:54.405196 18205 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:54.407455 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.408430 17996 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:54.409179 17996 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.410313 18177 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:54.410874 18177 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.375085 18158 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:54.305527 18108 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.412492 17996 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:54.414160 17967 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:54.443892 17974 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:54.446146 18161 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.447654 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:54.451658 17967 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:54.452455 13249 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.1:35201 timed out after 1.739s (SENT) [suppressed 55 similar messages]
I20260709 12:20:54.452327 17967 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.455005 18101 raft_consensus.cc:3055] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:54.455559 18101 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:54.456777 18235 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 12:20:54.456547 18101 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:54.458298 18101 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:54.470474 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 348858us
I20260709 12:20:54.429489 18177 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:54.468461 17876 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:54.490422 13034 catalog_manager.cc:5697] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 6 to 10, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 10 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:54.483850 17796 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.495160 17796 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:54.432737 18158 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.520226 18062 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:54.521284 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:54.432492 18075 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:54.546901 13203 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:20:54.547780 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:54.549572 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:54.550319 13208 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:54.555675 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:54.556499 13211 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:54.558959 13206 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:20:54.567662 13209 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:20:54.514863 18215 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.577527 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:54.578722 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:54.601511 13206 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:54.580219 13203 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:20:54.612039 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:54.612888 13208 raft_consensus.cc:2393] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:54.616953 18014 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.617552 18014 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:54.620349 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:54.624770 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:54.633886 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:54.634552 13203 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:54.639642 13211 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:54.645884 13205 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:20:54.646276 13100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.033s
I20260709 12:20:54.599629 18009 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:54.649288 13100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.003s	sys 0.033s
W20260709 12:20:54.649689 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 528027us
I20260709 12:20:54.630535 17975 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:54.709626 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:54.665493 13034 catalog_manager.cc:5697] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 7 to 10, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 10 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.675557 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:54.714571 13280 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:54.717191 13034 catalog_manager.cc:5697] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 4 to 7, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 7 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:54.708922 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 551566us
I20260709 12:20:54.719595 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:54.719727 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 55680.9us
I20260709 12:20:54.743892 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:54.748433 13278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.016s	sys 0.028s
W20260709 12:20:54.749008 13278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.016s	sys 0.028s
W20260709 12:20:54.713110 18182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.010s	sys 0.025s
I20260709 12:20:54.674587 18014 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:54.706871 18065 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:54.683881 18062 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.661568 17876 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:20:54.707789 18158 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:54.674044 18215 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:54.769228 13880 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 14. Current term is 15. Ops: []
W20260709 12:20:54.770596 13032 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42064 (request call id 322) took 33708 ms (client timeout 15000 ms). Trace:
I20260709 12:20:54.662937 18009 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.760797 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:54.808120 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.809048 13129 raft_consensus.cc:2393] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:54.810324 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.811323 13135 raft_consensus.cc:2410] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:20:54.789919 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.811403 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:54.668859 17772 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
W20260709 12:20:54.762846 18182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.010s	sys 0.026s
W20260709 12:20:54.784878 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.813400 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.814232 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.815316 13136 pending_rounds.cc:85] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 8
I20260709 12:20:54.820580 13136 pending_rounds.cc:107] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:20:54.820922 13136 raft_consensus.cc:2889] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:54.817523 13886 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:20:54.816798 13034 catalog_manager.cc:5697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.818492 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:54.777994 13032 rpcz_store.cc:269] 0709 12:20:21.062461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.087473 (+ 25012us) service_pool.cc:224] Handling call
0709 12:20:54.770487 (+33683014us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:47.939136 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:47.939970 (+   834us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:47.940057 (+    87us) write_op.cc:435] Acquired schema lock
0709 12:20:47.940080 (+    23us) tablet.cc:662] Decoding operations
0709 12:20:48.042025 (+101945us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:48.042162 (+   137us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:48.042200 (+    38us) tablet.cc:685] Acquiring locks for 30 operations
0709 12:20:48.111222 (+ 69022us) tablet.cc:701] Row locks acquired
0709 12:20:48.111278 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:20:48.111480 (+   202us) write_op.cc:270] Start()
0709 12:20:48.111645 (+   165us) write_op.cc:276] Timestamp: P: 1783599648111389 usec, L: 0
0709 12:20:48.111687 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:20:48.194948 (+ 83261us) log.cc:844] Serialized 11687 byte log entry
0709 12:20:48.970312 (+775364us) op_driver.cc:464] REPLICATION: finished
0709 12:20:49.381205 (+410893us) write_op.cc:301] APPLY: starting
0709 12:20:49.388827 (+  7622us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:49.655331 (+266504us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:49.655471 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:50.358467 (+702996us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:50.358970 (+   503us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=0,mrs_lookups=0
0709 12:20:50.359023 (+    53us) write_op.cc:312] APPLY: finished
0709 12:20:50.414963 (+ 55940us) log.cc:844] Serialized 260 byte log entry
0709 12:20:50.638981 (+224018us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:50.693568 (+ 54587us) write_op.cc:454] Released schema lock
0709 12:20:50.721655 (+ 28087us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:50.830067 (+108412us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:50.830098 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2939897,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":336611,"apply.run_cpu_time_us":89022,"apply.run_wall_time_us":1486582,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129707,"num_ops":30,"prepare.queue_time_us":37972,"prepare.run_cpu_time_us":22233,"prepare.run_wall_time_us":598782,"raft.queue_time_us":411970,"raft.run_cpu_time_us":12291,"raft.run_wall_time_us":243757,"replication_time_us":858456,"thread_start_us":1048938,"threads_started":5,"wal-append.queue_time_us":583148,"wal-append.run_cpu_time_us":37485,"wal-append.run_wall_time_us":2615529}]]}
I20260709 12:20:54.712445 17708 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.832877 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:54.834836 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:54.836679 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:54.836987 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:54.838038 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:54.838680 13841 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:54.839922 17974 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:54.840948 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:54.842097 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.842168 13841 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:54.842846 13130 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
W20260709 12:20:54.849897 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 89031.6us
I20260709 12:20:54.840379 17974 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.858527 17974 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:54.858736 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:54.805156 18031 raft_consensus.cc:3055] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:54.860921 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:54.859748 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:54.857868 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:54.868064 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:54.865970 18031 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:54.872994 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:54.880246 13135 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 13: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:54.854116 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:54.866633 18245 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:54.861007 13034 catalog_manager.cc:5697] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:54.887698 13280 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:54.897818 13132 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:20:54.897953 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:54.898906 13203 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:54.899852 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:54.901539 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:54.902320 13203 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:54.904626 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:54.906107 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:54.909409 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.909963 13034 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 6 to 11, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 11 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.914124 13211 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:20:54.916132 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:54.848279 17891 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 12. Current term is 13.
I20260709 12:20:54.860390 18158 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:54.776916 18065 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:54.877560 18177 raft_consensus.cc:2804] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:54.890822 18185 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:54.943120 13204 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:54.950776 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.941213 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:54.806389 18062 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.953214 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:54.954252 13130 raft_consensus.cc:2393] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:54.841364 18041 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:20:54.955993 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.958153 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.961354 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.964020 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:54.965333 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 334762us
I20260709 12:20:54.866655 18176 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:20:54.963402 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.912426 18251 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:54.928184 18215 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:54.981030 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:54.983898 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:54.973079 13880 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:54.978369 13034 catalog_manager.cc:5697] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.992938 13887 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:54.998329 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.998497 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:54.999109 13249 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.035s	sys 0.029s
W20260709 12:20:54.999462 13249 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.035s	sys 0.029s
W20260709 12:20:54.999812 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 547335us
I20260709 12:20:54.954332 18185 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:55.001377 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:54.913014 18245 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.025684 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:55.057649 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 56377.2us
I20260709 12:20:55.060479 13249 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:54.984953 17796 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:54.985693 18215 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:55.063228 13034 catalog_manager.cc:5697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 5 to 7, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 7 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.988631 18247 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.069911 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 108911us
I20260709 12:20:55.070596 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:55.081526 13135 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:55.087090 13034 catalog_manager.cc:5697] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 5 to 8, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 8 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:55.037813 18185 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:54.985131 18258 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 12:20:55.111166 13131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:20:55.100663 17757 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:55.113049 17757 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:54.972611 18031 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:55.071633 18215 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:55.069882 18018 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:55.123245 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:55.116832 13034 catalog_manager.cc:5697] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 6 to 9, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 9 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:55.024791 18075 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:20:55.130314 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:55.136426 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:55.090852 18158 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:55.143352 13034 catalog_manager.cc:5697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:55.082792 17876 consensus_queue.cc:1059] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:20:55.127138 17891 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:55.126787 18269 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:55.099265 18014 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:20:55.090382 18247 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:55.186786 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 332749us
I20260709 12:20:55.153204 17988 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.154992 18049 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:55.190780 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:55.167824 18031 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:55.231815 13034 catalog_manager.cc:5697] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:55.195722 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:55.181484 17967 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:55.157662 18158 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.183722 18269 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:55.270061 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 74436.3us
I20260709 12:20:55.213419 17996 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:55.191777 18176 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:55.213586 18065 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:55.291704 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:55.195289 18009 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:55.178040 18182 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.100s
W20260709 12:20:55.273108 18248 log.cc:927] Time spent T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
W20260709 12:20:55.280481 18256 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 12:20:55.250684 17708 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:55.240780 18275 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:55.254766 18049 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:55.313393 18049 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:55.314548 13887 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:20:55.280881 17996 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:55.273463 17796 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:55.184365 17891 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.214190 17988 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.303704 13034 catalog_manager.cc:5697] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 3 to 8, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 8 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:55.285363 18176 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:55.273757 18269 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:55.317252 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 257098us
I20260709 12:20:55.326916 13034 catalog_manager.cc:5697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 5 to 7, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 7 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:55.299770 18267 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:55.338562 13034 catalog_manager.cc:5697] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:20:55.321121 17996 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:55.342245 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 50643.9us
I20260709 12:20:55.345221 13175 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:55.346163 13249 connection.cc:256] RPC call timeout handler was delayed by -1.531264518999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 12:20:55.346659 13249 connection.cc:256] RPC call timeout handler was delayed by -1.4927502739999454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:20:55.346987 13249 connection.cc:256] RPC call timeout handler was delayed by -1.4871512589998019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 12:20:55.353267 18244 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.398s	user 0.002s	sys 0.000s
I20260709 12:20:55.354738 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:55.355363 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 994) took 1200 ms. Trace:
I20260709 12:20:55.355506 13211 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:20:55.355825 13281 rpcz_store.cc:276] 0709 12:20:54.155230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.173842 (+ 18612us) service_pool.cc:224] Handling call
0709 12:20:54.174285 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:54.174728 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.174768 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:54.175380 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 12:20:54.568397 (+393017us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:54.568452 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.568548 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:55.355158 (+786610us) raft_consensus.cc:1685] finished
0709 12:20:55.355178 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.355296 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24125,"raft.queue_time_us":915,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":12864,"thread_start_us":354480,"threads_started":1,"wal-append.queue_time_us":605296}
I20260709 12:20:55.332388 18176 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:55.366480 13277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2355) took 1663 ms. Trace:
I20260709 12:20:55.374485 13277 rpcz_store.cc:276] 0709 12:20:53.703148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.703255 (+   107us) service_pool.cc:224] Handling call
0709 12:20:53.703548 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:53.816443 (+112895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.816472 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:53.833483 (+ 17011us) log.cc:844] Serialized 26 byte log entry
0709 12:20:54.422224 (+588741us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:54.423219 (+   995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.423325 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:55.352651 (+929326us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:55.354765 (+  2114us) raft_consensus.cc:1685] finished
0709 12:20:55.354783 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.366397 (+ 11614us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119087,"raft.queue_time_us":113011,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":37273,"spinlock_wait_cycles":44239232,"thread_start_us":413493,"threads_started":1,"wal-append.queue_time_us":977302}
I20260709 12:20:55.361315 18283 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:55.384207 18283 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:20:55.384975 18260 log.cc:927] Time spent T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 12:20:55.384801 18283 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:55.388365 18247 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:55.344367 18205 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.335860 18246 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:55.392232 13136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.016s	sys 0.019s
W20260709 12:20:55.393139 13136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.017s	sys 0.020s
I20260709 12:20:55.315749 18018 raft_consensus.cc:697] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:55.397773 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 261422us
W20260709 12:20:55.399032 13249 connection.cc:256] RPC call timeout handler was delayed by -1.0792429149998952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
I20260709 12:20:55.405777 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:55.360883 17708 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:55.366614 18049 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:55.393546 18262 log.cc:927] Time spent T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 12:20:55.413067 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 53199.3us
I20260709 12:20:55.414821 13252 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:55.421223 13249 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:55.428236 17974 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.002s
I20260709 12:20:55.428968 18018 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.428920 17974 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.372640 18285 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:55.431802 18285 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.433975 13102 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:55.434579 18285 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:55.407094 18108 consensus_queue.cc:1059] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:20:55.435894 18093 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:55.436467 18093 raft_consensus.cc:697] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:55.437467 18093 consensus_queue.cc:237] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:55.400836 18205 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:55.441849 18205 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:55.443729 17772 raft_consensus.cc:3055] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:55.444213 17772 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:55.445084 17772 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.449034 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2372) took 1035 ms. Trace:
I20260709 12:20:55.449460 13286 rpcz_store.cc:276] 0709 12:20:54.414153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.414528 (+   375us) service_pool.cc:224] Handling call
0709 12:20:54.414987 (+   459us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:54.421006 (+  6019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.421055 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:54.424383 (+  3328us) log.cc:844] Serialized 52 byte log entry
0709 12:20:54.806451 (+382068us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:54.806492 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.806557 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:55.447308 (+640751us) raft_consensus.cc:1685] finished
0709 12:20:55.447332 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.448963 (+  1631us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":167,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":354297,"threads_started":1,"wal-append.queue_time_us":557764}
W20260709 12:20:55.455982 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 51347.1us
I20260709 12:20:55.456811 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:55.463418 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:55.463739 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:55.464282 13133 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:55.464493 13137 raft_consensus.cc:2410] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:20:55.465485 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:55.466065 13135 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:55.468761 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:55.470794 13137 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:55.472965 18062 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:55.405570 18245 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:55.473516 17988 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:55.479739 18289 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:55.480044 18287 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:20:55.480604 18289 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:55.395967 18149 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:55.482851 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 68157us
I20260709 12:20:55.483718 13252 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:55.496726 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:55.514232 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 375043us
I20260709 12:20:55.518055 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:55.518397 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:55.519209 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:55.517010 13103 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:55.521231 18007 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:55.523752 13252 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:55.524278 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:55.525027 13203 raft_consensus.cc:2393] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 16: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:55.525797 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:55.513916 18062 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:55.528301 13882 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:20:55.529677 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:55.530315 13881 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:55.532002 17708 consensus_queue.cc:1048] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:55.542155 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 998) took 1350 ms. Trace:
I20260709 12:20:55.448594 18284 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:55.544353 17974 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:55.405864 18246 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:55.547004 18246 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:55.547245 18014 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:55.547554 18246 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:55.547727 18014 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:55.548137 18246 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:55.548563 18014 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:55.549602 18014 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:55.550321 18246 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:55.551482 18254 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.551968 13838 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:55.552194 18254 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.553745 18268 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.555289 18289 raft_consensus.cc:2804] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:55.555895 18289 raft_consensus.cc:697] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:55.556829 18289 consensus_queue.cc:237] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:55.551204 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:55.522231 18285 raft_consensus.cc:3055] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:55.561344 18267 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:55.542580 13283 rpcz_store.cc:276] 0709 12:20:54.191536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.191816 (+   280us) service_pool.cc:224] Handling call
0709 12:20:54.292342 (+100526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.292541 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:54.777093 (+484552us) log.cc:844] Serialized 14 byte log entry
0709 12:20:54.945945 (+168852us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:54.946013 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:54.946088 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.946317 (+   229us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.540192 (+593875us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b18003ed4c0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d6e2a6 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4
0709 12:20:55.541961 (+  1769us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x7b54004088d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:55.542093 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11308,"prepare.queue_time_us":958249,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":37,"raft.queue_time_us":104,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9176,"spinlock_wait_cycles":255130752,"thread_start_us":642790,"threads_started":2,"wal-append.queue_time_us":330884}
I20260709 12:20:55.562103 13132 raft_consensus.cc:2410] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:20:55.554385 18254 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:55.564354 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:55.565059 13285 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:55.565115 18215 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.567453 17967 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:55.567584 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:55.561918 18267 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:55.570731 18199 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:55.568532 17974 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.577883 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.554266 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:55.568813 17967 raft_consensus.cc:697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:55.583868 17967 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:55.586475 18278 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:20:55.592549 17757 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:55.596319 18261 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:20:55.510695 18075 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:55.600080 13203 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:20:55.522168 18101 consensus_meta.cc:287] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 1.054s	user 0.013s	sys 0.000s
I20260709 12:20:55.569078 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 3196) took 1023 ms. Trace:
W20260709 12:20:55.633814 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 212665us
I20260709 12:20:55.633535 13204 rpcz_store.cc:276] 0709 12:20:54.545873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.547531 (+  1658us) service_pool.cc:224] Handling call
0709 12:20:55.568873 (+1021342us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54000b7554. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:55.568994 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907552640}
I20260709 12:20:55.635259 13249 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:55.635692 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:55.524603 13252 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:55.606783 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:55.637418 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 112882us
I20260709 12:20:55.609869 13103 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:55.641402 13103 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:55.642675 18255 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:55.642983 13103 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:55.636512 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:55.643492 18255 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:55.648555 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 94359.4us
W20260709 12:20:55.650310 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 43892us
I20260709 12:20:55.609952 13100 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:55.568562 13210 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:55.649430 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:55.712173 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:55.712795 13203 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:20:55.714195 13203 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:55.651108 13175 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:55.573418 17974 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.595078 18215 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:55.522333 18205 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:55.598881 18158 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:55.707257 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.602139 18285 raft_consensus.cc:740] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:55.708657 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:55.454813 18049 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.179s
W20260709 12:20:55.716683 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 65681.2us
I20260709 12:20:55.786540 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:55.718840 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 108953us
W20260709 12:20:55.804368 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.719762 13208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.008s	sys 0.024s
W20260709 12:20:55.806428 13208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.008s	sys 0.024s
I20260709 12:20:55.722455 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3209) took 1121 ms. Trace:
I20260709 12:20:55.807029 13841 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:55.807262 13212 rpcz_store.cc:276] 0709 12:20:54.600737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.601995 (+  1258us) service_pool.cc:224] Handling call
0709 12:20:54.628664 (+ 26669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:54.983733 (+355069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.983771 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:54.984267 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:20:55.296563 (+312296us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:55.296603 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.296674 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:55.722159 (+425485us) raft_consensus.cc:1685] finished
0709 12:20:55.722193 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.722368 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77338,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58,"thread_start_us":666157,"threads_started":2,"wal-append.queue_time_us":435787}
I20260709 12:20:55.514005 17796 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:55.571201 18199 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:55.554236 18268 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.770637 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:55.771008 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 60915us
I20260709 12:20:55.824872 13286 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:55.825979 13175 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:55.826558 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:55.683022 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2356) took 1979 ms. Trace:
W20260709 12:20:55.658138 18290 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:20:55.510004 18258 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.196s
I20260709 12:20:55.682649 13209 raft_consensus.cc:2410] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:20:55.683595 18264 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.358s	user 0.002s	sys 0.000s
I20260709 12:20:55.775786 13203 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:55.780543 13130 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:20:55.715922 18259 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 12:20:55.656106 18077 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:20:55.718293 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 75400.9us
I20260709 12:20:55.514155 18149 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.658767 18251 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:55.827500 18065 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:55.832628 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:55.827690 13278 rpcz_store.cc:276] 0709 12:20:53.704027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.704152 (+   125us) service_pool.cc:224] Handling call
0709 12:20:53.704432 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:53.817197 (+112765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.817228 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:53.817640 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:20:54.749546 (+931906us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:54.749605 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.749698 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:55.682776 (+933078us) raft_consensus.cc:1685] finished
0709 12:20:55.682800 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.682955 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124611,"raft.queue_time_us":116250,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":34306,"thread_start_us":759395,"threads_started":1,"wal-append.queue_time_us":1811556}
I20260709 12:20:55.833536 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:55.835860 13204 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:55.726333 18009 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:55.770126 18247 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:55.554781 18108 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:20:55.659125 18273 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.409s	user 0.000s	sys 0.002s
I20260709 12:20:55.776304 18075 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:55.774425 18138 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:55.831373 13883 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.018s	sys 0.033s
W20260709 12:20:55.886682 13883 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.018s	sys 0.033s
I20260709 12:20:55.846722 13103 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:55.838238 17708 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:20:55.890731 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 44131.3us
I20260709 12:20:55.782846 18205 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.544376 18284 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:55.682922 18176 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.833226 18158 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:55.865418 13286 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:55.521911 18007 consensus_queue.cc:1059] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.326s
I20260709 12:20:55.870990 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:55.943904 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 72998.5us
I20260709 12:20:55.874023 13131 raft_consensus.cc:606] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:20:55.947301 13131 raft_consensus.cc:614] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:55.837771 17875 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.649663 18041 consensus_queue.cc:1059] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.209s
W20260709 12:20:55.847931 18177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.009s	sys 0.025s
I20260709 12:20:55.844988 17880 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.885684 13212 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:55.848871 18275 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:55.849462 17891 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:55.598281 18269 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:55.780964 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 142926us
I20260709 12:20:55.892628 13103 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:55.893831 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:55.895853 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:55.899504 17974 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:55.885388 18185 consensus_meta.cc:287] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.000s
I20260709 12:20:55.901837 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 1005) took 1567 ms. Trace:
I20260709 12:20:55.903522 17976 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:55.890839 18199 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.902874 18267 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:55.907181 18279 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.546s	user 0.000s	sys 0.002s
I20260709 12:20:55.911335 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:55.912005 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:55.913285 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3212) took 1286 ms. Trace:
I20260709 12:20:55.833513 17796 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:55.876029 18247 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.931268 13280 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:55.890180 18285 consensus_queue.cc:260] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.879746 18302 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:55.894162 18138 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:55.940382 13886 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:55.941756 18176 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:55.881601 17988 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:55.962785 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:55.959388 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:56.119232 13878 raft_consensus.cc:2393] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 15: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:55.960410 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:56.088542 18075 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:55.971309 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:55.983264 13286 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:56.004015 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:56.004154 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:56.125022 13881 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:56.125433 13887 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:55.861006 18283 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.031349 13285 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:56.009474 13278 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:55.932004 18158 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:55.947904 18139 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:20:55.967123 18272 log.cc:927] Time spent T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.773s	user 0.002s	sys 0.000s
I20260709 12:20:56.031150 13282 rpcz_store.cc:276] 0709 12:20:54.334079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.334229 (+   150us) service_pool.cc:224] Handling call
0709 12:20:54.363659 (+ 29430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:54.364675 (+  1016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.364706 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:54.365221 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:20:54.790015 (+424794us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:54.790090 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.790191 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:55.901620 (+1111429us) raft_consensus.cc:1685] finished
0709 12:20:55.901640 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.901779 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":615,"raft.queue_time_us":730,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":401592,"threads_started":1,"wal-append.queue_time_us":930597}
W20260709 12:20:56.007068 18303 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:20:56.008665 18212 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.006s	sys 0.021s
W20260709 12:20:55.971614 18270 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.696s	user 0.002s	sys 0.000s
I20260709 12:20:55.957363 18049 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:56.122097 18138 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:55.968199 17967 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:56.003509 18177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.009s	sys 0.025s
I20260709 12:20:55.967236 18254 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:56.045058 18247 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:56.087791 18031 raft_consensus.cc:3055] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:56.047783 18302 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.008625 17880 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.971529 17875 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:55.963373 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:56.120889 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:55.894667 18108 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:56.091817 18199 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:56.092167 18289 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.038247 18185 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.101083 18246 raft_consensus.cc:3055] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:56.116643 17976 raft_consensus.cc:697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:56.153230 18158 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:56.211134 17967 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:56.162075 18212 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.007s	sys 0.025s
I20260709 12:20:56.218092 18205 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.220014 18108 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.229192 17772 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:56.229744 18065 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:56.230333 18065 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:56.176824 17996 consensus_meta.cc:287] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.003s
I20260709 12:20:55.957223 18312 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:56.152891 18139 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.163515 18268 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.178417 18269 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:56.164861 18294 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:20:56.165568 17796 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.235186 18185 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:56.168171 18311 log.cc:927] Time spent T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:20:56.229660 18267 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.136452 18075 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.242400 18075 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.183056 18284 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:56.169191 18049 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.244426 17880 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.246094 18049 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.246156 18158 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.207228 18031 raft_consensus.cc:740] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:56.207221 18246 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:56.208676 18177 raft_consensus.cc:697] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:56.243268 18149 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.255473 18031 consensus_queue.cc:260] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.256093 17967 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.238579 17996 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.256747 18031 raft_consensus.cc:3060] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:56.219226 18138 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.260339 17996 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:56.259932 18246 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.260668 18139 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.224022 18302 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:56.227643 18289 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.260937 18158 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.254109 18283 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.261432 18246 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:56.276618 18285 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:56.280179 18289 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:56.315441 13034 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.026s	sys 0.020s
W20260709 12:20:56.316540 13034 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.026s	sys 0.021s
I20260709 12:20:56.317982 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1697) took 1495 ms. Trace:
I20260709 12:20:56.318746 13129 rpcz_store.cc:276] 0709 12:20:54.822221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.822513 (+   292us) service_pool.cc:224] Handling call
0709 12:20:54.822890 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:54.880097 (+ 57207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.880141 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:54.887867 (+  7726us) log.cc:844] Serialized 26 byte log entry
0709 12:20:55.570274 (+682407us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b18003d8ac0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1 00007f70f4e48a0f
0709 12:20:55.873830 (+303556us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:55.873890 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.877919 (+  4029us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:56.316844 (+438925us) raft_consensus.cc:1685] finished
0709 12:20:56.316943 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.317662 (+   719us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107266,"raft.queue_time_us":66623,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":19236,"spinlock_wait_cycles":4216704,"thread_start_us":303316,"threads_started":1,"wal-append.queue_time_us":1180006}
I20260709 12:20:56.322937 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:20:56.323076 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 430333us
I20260709 12:20:56.325228 13132 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:20:56.325932 13132 pending_rounds.cc:85] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 7
I20260709 12:20:56.326265 13132 pending_rounds.cc:107] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:20:56.326692 13132 raft_consensus.cc:2889] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:56.034271 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.328907 13134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1691) took 1521 ms. Trace:
I20260709 12:20:56.329782 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.331308 13133 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:56.329376 13134 rpcz_store.cc:276] 0709 12:20:54.806967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.809384 (+  2417us) service_pool.cc:224] Handling call
0709 12:20:54.809705 (+   321us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:20:54.876866 (+ 67161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.876907 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:20:54.919605 (+ 42698us) log.cc:844] Serialized 78 byte log entry
0709 12:20:55.271531 (+351926us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:55.651625 (+380094us) log.cc:844] Serialized 14 byte log entry
0709 12:20:55.652040 (+   415us) log.cc:844] Serialized 14 byte log entry
0709 12:20:55.652245 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.652333 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:56.274960 (+622627us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b1800297400. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:56.328278 (+ 53318us) raft_consensus.cc:1685] finished
0709 12:20:56.328334 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.328678 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":167209,"prepare.queue_time_us":878996,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":4188,"raft.queue_time_us":65274,"raft.run_cpu_time_us":518,"raft.run_wall_time_us":141114,"spinlock_wait_cycles":14582144,"thread_start_us":666752,"threads_started":2,"wal-append.queue_time_us":1050460}
I20260709 12:20:56.332494 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:56.332613 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.333552 13134 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:20:56.334072 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:55.947172 13135 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:56.335309 13134 pending_rounds.cc:85] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 7
I20260709 12:20:56.337184 13134 pending_rounds.cc:107] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:20:56.337433 13134 raft_consensus.cc:2889] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:56.325021 13103 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:55.951571 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.343057 13207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3214) took 1711 ms. Trace:
I20260709 12:20:56.344695 13211 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:56.343734 13207 rpcz_store.cc:276] 0709 12:20:54.631366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.632816 (+  1450us) service_pool.cc:224] Handling call
0709 12:20:54.633113 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:54.878012 (+244899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.878041 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:54.910234 (+ 32193us) log.cc:844] Serialized 26 byte log entry
0709 12:20:55.153952 (+243718us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:55.154008 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.154113 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:55.855167 (+701054us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:56.342266 (+487099us) raft_consensus.cc:1685] finished
0709 12:20:56.342319 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.342749 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73189,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":58,"spinlock_wait_cycles":11872128,"thread_start_us":434128,"threads_started":2,"wal-append.queue_time_us":366819}
I20260709 12:20:56.346412 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3211) took 1722 ms. Trace:
I20260709 12:20:55.949921 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:56.348634 13137 raft_consensus.cc:2393] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:56.346951 13206 rpcz_store.cc:276] 0709 12:20:54.623641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.623917 (+   276us) service_pool.cc:224] Handling call
0709 12:20:54.624218 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:54.626286 (+  2068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.626335 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:54.647679 (+ 21344us) log.cc:844] Serialized 26 byte log entry
0709 12:20:54.966350 (+318671us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:54.966414 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.966486 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:55.770869 (+804383us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:56.345750 (+574881us) raft_consensus.cc:1685] finished
0709 12:20:56.345808 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.346235 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1685,"raft.queue_time_us":81606,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":28789632,"thread_start_us":270292,"threads_started":1,"wal-append.queue_time_us":490269}
W20260709 12:20:56.008908 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 175507us
I20260709 12:20:56.039003 13208 rpcz_store.cc:276] 0709 12:20:54.627331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.635925 (+  8594us) service_pool.cc:224] Handling call
0709 12:20:54.644999 (+  9074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:55.007464 (+362465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:55.007533 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:55.060422 (+ 52889us) log.cc:844] Serialized 26 byte log entry
0709 12:20:55.806862 (+746440us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:55.806907 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.806985 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:55.913056 (+106071us) raft_consensus.cc:1685] finished
0709 12:20:55.913079 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.913224 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30489,"raft.queue_time_us":162407,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":12925,"thread_start_us":1025971,"threads_started":2,"wal-append.queue_time_us":766388}
W20260709 12:20:56.116142 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 479654us
I20260709 12:20:56.045331 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:56.342975 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:56.368342 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:56.371187 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 500194us
W20260709 12:20:56.371309 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 46684.3us
I20260709 12:20:56.363003 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50024 (request call id 37) took 1252 ms. Trace:
I20260709 12:20:56.122931 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:56.393299 17875 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.355273 13175 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:20:56.389793 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 55313.4us
I20260709 12:20:56.391714 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:56.393553 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:56.157256 13881 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:20:56.402863 17967 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.404124 17967 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.405316 13840 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:56.407559 13880 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:56.409467 18215 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.410352 18215 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.411834 13879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1269) took 1288 ms. Trace:
I20260709 12:20:56.412142 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:56.412401 13879 rpcz_store.cc:276] 0709 12:20:55.122843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.122988 (+   145us) service_pool.cc:224] Handling call
0709 12:20:55.149638 (+ 26650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:55.149988 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:55.150016 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:55.173273 (+ 23257us) log.cc:844] Serialized 26 byte log entry
0709 12:20:55.698237 (+524964us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:55.698278 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.698346 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:56.380425 (+682079us) raft_consensus.cc:1685] finished
0709 12:20:56.387809 (+  7384us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.411628 (+ 23819us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103124,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":28577,"thread_start_us":454866,"threads_started":1,"wal-append.queue_time_us":701385}
I20260709 12:20:56.416379 18149 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:56.416971 18149 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.417431 18149 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:56.377679 13131 rpcz_store.cc:276] 0709 12:20:55.110773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.111031 (+   258us) service_pool.cc:224] Handling call
0709 12:20:56.362552 (+1251521us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54001f45d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e87853 00007f70f9e5560a 00007f70f33db7d4 00007f70f33db762 00007f70f33db691 00007f70f33db60c 00007f70f33da8c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:56.362746 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1752658688}
I20260709 12:20:56.430907 18077 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:56.431771 18077 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:56.432016 18138 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.432385 18077 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:56.399866 18139 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:56.447678 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.469800 13884 raft_consensus.cc:2410] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:20:56.472790 18139 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.473512 17976 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:56.475739 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:56.476828 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.477035 18177 consensus_queue.cc:237] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.479631 18093 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:56.480250 18093 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.480701 18093 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:56.483968 17967 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:56.484046 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 72199.7us
I20260709 12:20:56.485419 13838 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:56.488049 18307 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:56.491683 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.497601 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:56.497876 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:56.498631 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 76461.7us
I20260709 12:20:56.500173 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:56.498104 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2246) took 1037 ms. Trace:
I20260709 12:20:56.411895 18288 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:56.487254 13838 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:56.501760 13130 rpcz_store.cc:276] 0709 12:20:55.460939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.461442 (+   503us) service_pool.cc:224] Handling call
0709 12:20:55.461780 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:55.837962 (+376182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.497503 (+659541us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b5400137ed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:56.497877 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732220800}
I20260709 12:20:56.524232 18149 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.526562 18149 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.527307 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:56.527659 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 172823us
I20260709 12:20:56.528439 13283 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:56.531957 18065 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.532735 18277 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:56.533002 18215 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.533195 18277 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:56.533679 18277 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:56.534372 18065 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:56.527676 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:56.536345 13206 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:56.537725 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:56.539822 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 180699us
I20260709 12:20:56.540680 18251 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:56.541792 13249 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:56.542851 18288 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:56.544459 18251 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:56.548818 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:56.551656 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:56.552841 18215 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:56.553603 18215 raft_consensus.cc:697] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:56.556593 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 1950) took 1038 ms. Trace:
I20260709 12:20:56.557053 13211 rpcz_store.cc:276] 0709 12:20:55.518723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.519005 (+   282us) service_pool.cc:224] Handling call
0709 12:20:56.556333 (+1037328us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b54002157d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:56.556507 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1893902080}
I20260709 12:20:56.549621 18268 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:20:56.559293 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 72293.9us
I20260709 12:20:56.555049 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.560401 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:56.561168 13130 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 9.
I20260709 12:20:56.564074 18293 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:56.564656 18293 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.565106 18293 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:56.567477 18268 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.568171 18268 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.568651 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:56.569464 13205 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:56.570425 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:56.570667 18268 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:56.570887 18330 log.cc:927] Time spent T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.082s	user 0.003s	sys 0.000s
I20260709 12:20:56.571193 13277 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:20:56.571846 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:56.572649 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1273) took 1052 ms. Trace:
I20260709 12:20:56.573478 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:56.574337 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1270) took 1058 ms. Trace:
I20260709 12:20:56.576642 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:56.572817 13284 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:56.550860 18277 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.581768 18149 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.582769 13131 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:56.574764 13880 rpcz_store.cc:276] 0709 12:20:55.516135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.516265 (+   130us) service_pool.cc:224] Handling call
0709 12:20:55.516561 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:56.408172 (+891611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.574062 (+165890us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b540045ae54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:56.574272 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987835648}
I20260709 12:20:56.575445 18215 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.587729 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:56.588088 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.588491 13207 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:56.588663 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:56.573526 18253 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:56.573086 13886 rpcz_store.cc:276] 0709 12:20:55.520154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.520251 (+    97us) service_pool.cc:224] Handling call
0709 12:20:55.520495 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:56.116511 (+596016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.572164 (+455653us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54006194d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:56.572458 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965174528}
W20260709 12:20:56.591812 13209 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 3205) took 2014 ms (client timeout 2091 ms). Trace:
I20260709 12:20:56.509847 17967 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:56.592370 13209 rpcz_store.cc:269] 0709 12:20:54.577046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.577199 (+   153us) service_pool.cc:224] Handling call
0709 12:20:56.591136 (+2013937us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540041d2d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:56.591572 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2431131904}
I20260709 12:20:56.605297 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:56.605537 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:56.613396 18288 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:56.616796 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:56.618785 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:56.620366 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 57103.5us
I20260709 12:20:56.620590 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:56.621780 13132 raft_consensus.cc:2393] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:56.621589 18176 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:20:56.625144 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.627282 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:56.638795 13211 raft_consensus.cc:2368] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 14. Current term is 15.
I20260709 12:20:56.636994 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:56.640846 13131 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:56.641825 18139 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.650848 13881 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:56.643603 18007 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:20:56.672706 13102 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.021s	sys 0.033s
W20260709 12:20:56.674466 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 151240us
I20260709 12:20:56.626873 18149 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:56.683758 13102 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.021s	sys 0.033s
I20260709 12:20:56.683877 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:56.697789 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:56.701175 13137 raft_consensus.cc:2393] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 13: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:56.703075 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:56.674431 18139 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:56.708989 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:56.709277 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.716214 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.717118 13135 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
W20260709 12:20:56.717159 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 231970us
I20260709 12:20:56.717985 13878 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:56.718153 18247 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:56.718868 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 44969.4us
I20260709 12:20:56.706640 18007 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.719602 18315 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:56.719920 13249 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:56.720630 18247 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.720419 18315 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:56.721571 18007 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.723033 18315 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:56.728189 13278 consensus_meta.cc:287] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.004s
I20260709 12:20:56.728641 13278 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:20:56.729766 18277 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.730757 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:56.721598 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:56.733299 18139 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.734396 18302 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.735937 18077 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:56.736342 13885 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45944 (request call id 1257) took 1923 ms (client timeout 2518 ms). Trace:
W20260709 12:20:56.707930 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 827093us
W20260709 12:20:56.737262 13885 rpcz_store.cc:269] 0709 12:20:54.812569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.812732 (+   163us) service_pool.cc:224] Handling call
0709 12:20:56.735974 (+1923242us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54005cd5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:56.736146 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4211113856}
I20260709 12:20:56.743094 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:56.748581 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:56.755038 18334 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.266s	user 0.000s	sys 0.003s
I20260709 12:20:56.755365 18149 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.756052 13884 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:56.757287 13203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 1030) took 1212 ms. Trace:
I20260709 12:20:56.765540 13135 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:56.766819 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.757670 13203 rpcz_store.cc:276] 0709 12:20:55.545168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.838115 (+292947us) service_pool.cc:224] Handling call
0709 12:20:55.862081 (+ 23966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:55.862399 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:55.862429 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:55.862919 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:20:56.377022 (+514103us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b180027b2c0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1 00007f70f4e48a0f
0709 12:20:56.489469 (+112447us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:56.489901 (+   432us) log.cc:844] Serialized 14 byte log entry
0709 12:20:56.513506 (+ 23605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.536819 (+ 23313us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:56.747996 (+211177us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:56.756874 (+  8878us) raft_consensus.cc:1685] finished
0709 12:20:56.756893 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.757095 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11881,"prepare.queue_time_us":366,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":68718,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":10596,"spinlock_wait_cycles":34288896,"thread_start_us":17589,"threads_started":1,"wal-append.queue_time_us":613054}
I20260709 12:20:56.769038 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.770210 18324 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:56.773092 18315 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.773813 18315 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.776021 13281 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:56.780305 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.780623 18302 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:56.781311 13133 raft_consensus.cc:2393] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:56.781637 13211 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:20:56.782037 13211 pending_rounds.cc:85] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 8
I20260709 12:20:56.782197 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:56.782426 18093 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:56.783856 13136 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:56.787492 18139 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.792999 18315 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.795781 18018 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:56.796056 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 74613.3us
W20260709 12:20:56.796778 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49035.5us
I20260709 12:20:56.799342 18077 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.801255 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:56.802470 13212 raft_consensus.cc:2393] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:56.806864 18049 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:56.810566 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:56.810947 17967 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:56.782286 13211 pending_rounds.cc:107] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:20:56.816670 13211 raft_consensus.cc:2889] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:56.820638 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:56.828434 13881 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:56.833461 13205 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:20:56.838773 13131 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:20:56.841955 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:56.828092 18093 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:56.855643 13175 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:56.856840 18315 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:56.857970 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:56.859090 18315 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:20:56.859586 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49237.3us
I20260709 12:20:56.861089 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:56.861526 13103 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:56.861974 17967 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:56.864672 18031 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:56.865289 18031 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:56.865788 18031 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:56.870981 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 44018.9us
I20260709 12:20:56.862414 13841 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:56.876256 18338 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:20:56.842784 18253 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:56.878414 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:56.892091 18302 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:56.874571 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 76652.2us
I20260709 12:20:56.905579 18158 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:20:56.910315 13841 leader_election.cc:400] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 14. Current term is 15.
I20260709 12:20:56.910784 13841 leader_election.cc:403] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:20:56.877547 17967 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:56.913703 17967 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.907663 18254 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.175s
I20260709 12:20:56.922775 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 1029) took 1377 ms. Trace:
I20260709 12:20:56.920612 17967 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:56.924402 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 61284.2us
I20260709 12:20:56.913870 18177 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:56.927182 13177 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:56.935956 18158 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:56.946717 18268 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:56.947108 18268 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:56.947523 18268 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:56.946154 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:20:56.946280 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 400751us
W20260709 12:20:56.950985 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 110860us
I20260709 12:20:56.959295 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:56.923241 13210 rpcz_store.cc:276] 0709 12:20:55.544861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.717551 (+172690us) service_pool.cc:224] Handling call
0709 12:20:55.717873 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:55.719382 (+  1509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:55.719413 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:55.771537 (+ 52124us) log.cc:844] Serialized 26 byte log entry
0709 12:20:56.501175 (+729638us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b1800448120. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1 00007f70f4e48a0f
0709 12:20:56.711265 (+210090us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:56.711300 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.711459 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:56.922273 (+210814us) raft_consensus.cc:1685] finished
0709 12:20:56.922294 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.922544 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1153,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":76479,"spinlock_wait_cycles":2466048,"thread_start_us":186860,"threads_started":1,"wal-append.queue_time_us":990898}
W20260709 12:20:56.972545 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 94602.4us
W20260709 12:20:56.973683 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 58022us
I20260709 12:20:56.977075 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:56.960824 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:56.987257 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:56.992672 13881 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:56.986277 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:56.983866 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:56.997326 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.000589 13886 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:56.998695 13841 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:57.004360 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:57.006249 13209 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:56.996042 17772 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.679s	user 0.000s	sys 0.020s
I20260709 12:20:57.020713 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.012797 18138 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:57.026775 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.028865 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:57.029747 13128 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:20:57.022635 18277 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:57.037938 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.038728 13205 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
W20260709 12:20:57.039171 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.042286 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:57.043699 13128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2250) took 1574 ms (client timeout 1708 ms). Trace:
I20260709 12:20:57.025503 18007 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:57.031602 18254 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:57.053704 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 73485.8us
I20260709 12:20:57.031245 18277 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:57.053153 18007 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:57.063525 17880 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:20:57.064563 18277 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:57.064875 18007 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:57.046170 13128 rpcz_store.cc:269] 0709 12:20:55.463360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.496424 (+ 33064us) service_pool.cc:224] Handling call
0709 12:20:57.031335 (+1534911us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54000c35d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:57.038145 (+  6810us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3499607296}
I20260709 12:20:57.068112 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:57.068025 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.068761 13131 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:57.069350 13177 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:57.067963 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:20:57.078176 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:57.080240 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:57.082537 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 112614us
I20260709 12:20:57.086438 18176 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:57.086905 18176 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:57.087949 13205 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:20:57.088663 18347 log.cc:927] Time spent T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.253s	user 0.001s	sys 0.001s
I20260709 12:20:57.093708 13886 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:20:57.095661 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:57.097635 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 59347.2us
I20260709 12:20:57.040688 17967 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:57.102787 18293 consensus_meta.cc:287] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.003s
I20260709 12:20:57.106739 13209 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:57.103621 18253 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:57.069443 18254 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:20:57.107712 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.114162 13206 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:57.111702 18293 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.101593 18277 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:57.121384 18293 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:57.123834 13885 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:57.125275 18254 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.127601 18277 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:57.128090 18277 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:57.113775 18255 consensus_queue.cc:1059] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:20:57.132511 18176 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.133857 18176 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:57.143826 18255 raft_consensus.cc:3055] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:57.144326 18255 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:57.145397 18255 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.152575 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.154803 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:57.156428 13249 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:57.158844 13249 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:57.163316 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.164346 13209 raft_consensus.cc:2393] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 17: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:57.165711 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.166652 13207 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:57.171598 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.172614 13204 raft_consensus.cc:2393] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 16: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:57.173234 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:57.174196 13131 raft_consensus.cc:2410] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:20:57.175756 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.175951 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:57.177500 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:57.178107 13128 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:57.185217 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:57.187873 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:57.188894 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.189774 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:57.190490 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:57.190639 18293 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:57.191052 18293 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:57.191887 18293 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:57.195035 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.188205 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:57.198920 13209 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:57.200392 13207 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: []
W20260709 12:20:57.165772 18246 consensus_meta.cc:287] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.893s	user 0.002s	sys 0.010s
I20260709 12:20:57.202054 13129 raft_consensus.cc:2410] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 12:20:57.203099 13129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 954) took 1252 ms (client timeout 1625 ms). Trace:
W20260709 12:20:57.203454 13129 rpcz_store.cc:269] 0709 12:20:55.950673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.322202 (+371529us) service_pool.cc:224] Handling call
0709 12:20:57.202908 (+880706us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b540011c954. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:57.203037 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018408832}
I20260709 12:20:57.203913 18293 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.206812 18293 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:57.204876 13281 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:57.207842 13278 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:57.208374 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:57.198092 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:57.214809 13128 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 17.
I20260709 12:20:57.217844 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:57.095329 18031 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:57.221563 13206 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:57.227527 13175 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:57.237619 13280 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:57.243837 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:20:57.244490 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.242229 18302 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:57.242393 18049 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:57.250355 18049 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:57.250761 18049 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:57.238641 13203 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:57.263576 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:57.235680 18315 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:20:57.265776 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 107012us
I20260709 12:20:57.274123 13838 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:57.275890 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:57.276544 13129 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:57.237916 18158 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 14. Current term is 15.
I20260709 12:20:57.267127 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:57.279624 13131 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:20:57.276546 13100 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:57.288858 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 101104us
I20260709 12:20:57.310103 13249 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:57.315541 13206 raft_consensus.cc:1275] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:20:57.316999 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 53281us
I20260709 12:20:57.317203 18018 consensus_queue.cc:1059] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:57.318806 13884 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:57.319031 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:57.320003 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:57.320235 13177 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:57.320578 18212 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:57.321556 17796 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:57.322146 17796 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.322618 17796 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:57.267005 18093 consensus_queue.cc:1059] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:20:57.333570 13129 raft_consensus.cc:2468] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:20:57.334880 13280 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:57.301753 17976 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:57.336328 13882 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:20:57.336416 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:57.341758 13281 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:57.336596 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 60145.6us
I20260709 12:20:57.337366 13103 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:57.282719 18247 consensus_queue.cc:1059] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:20:57.299019 18315 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:57.344781 13838 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:57.318931 18138 consensus_queue.cc:1059] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:20:57.300161 18302 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:20:57.370885 18307 raft_consensus.cc:2804] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:57.416301 18307 raft_consensus.cc:697] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:57.417351 18307 consensus_queue.cc:237] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.339908 17976 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:57.453429 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 103890us
W20260709 12:20:57.452147 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 128696us
W20260709 12:20:57.459267 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 165853us
I20260709 12:20:57.369632 18149 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:57.337984 18158 consensus_queue.cc:1048] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 12:20:57.476253 13252 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:57.345963 18007 consensus_queue.cc:1059] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:20:57.369530 17772 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:57.458992 17976 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:57.350127 18077 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.118s
W20260709 12:20:57.516081 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 165237us
I20260709 12:20:57.451390 18288 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:20:57.515273 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 207740us
W20260709 12:20:57.518918 18268 consensus_meta.cc:287] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.005s
I20260709 12:20:57.517416 18285 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:57.550114 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 322668us
I20260709 12:20:57.521108 18212 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:57.527552 17772 raft_consensus.cc:697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:20:57.571596 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 64374.5us
I20260709 12:20:57.533667 18215 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:57.580540 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 232319us
I20260709 12:20:57.585578 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.590550 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:57.540503 18268 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:57.574051 18275 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:57.605436 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 151207us
I20260709 12:20:57.580353 18215 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:57.593494 17880 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:20:57.616695 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.617914 13204 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:57.629369 13283 raft_consensus.cc:1240] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:57.567467 18288 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.594796 18031 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:57.641505 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:57.619451 18215 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:57.632277 17880 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:57.653025 17880 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.654388 17880 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:57.654610 18378 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:20:57.655493 18353 log.cc:927] Time spent T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.343s	user 0.000s	sys 0.002s
I20260709 12:20:57.637116 18363 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.657156 18363 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:57.660789 18288 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:57.660621 17772 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.661450 18288 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:57.655532 18365 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:57.644857 18302 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:57.663928 18302 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.664350 18302 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:57.653038 18355 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:20:57.651885 18352 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:20:57.651770 18351 log.cc:927] Time spent T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:20:57.599818 18212 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.663497 18365 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.642467 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:57.680365 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.681289 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:57.600569 18285 consensus_queue.cc:1059] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:20:57.649842 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.592269 18315 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.709208 18373 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.712834 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.711827 18077 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:57.719977 18077 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.730382 18379 raft_consensus.cc:3055] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:57.730964 18379 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:57.709764 18212 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:57.731978 18379 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:57.739133 13209 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:57.739513 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.733076 18373 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:57.742250 18373 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:57.744288 18357 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.376s	user 0.002s	sys 0.001s
I20260709 12:20:57.748384 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.739622 18379 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:57.755774 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:57.633991 18275 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.768007 13281 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:57.770777 13277 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:57.777055 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 138438us
I20260709 12:20:57.778709 13211 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:20:57.763571 18378 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:57.780169 13103 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:57.784504 18268 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:57.787976 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.791632 18373 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:57.792222 18373 raft_consensus.cc:697] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:57.793144 18373 consensus_queue.cc:237] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:57.794423 13286 raft_consensus.cc:1240] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:20:57.795727 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.796715 18275 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:57.774117 18246 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:20:57.778362 18247 raft_consensus.cc:3055] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:57.798623 18255 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:57.798784 18247 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:57.799589 18378 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.801894 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.784416 18383 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:57.802606 13208 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:57.802820 13286 raft_consensus.cc:2468] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:57.811764 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:57.817302 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.820024 13103 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:57.820793 13284 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:57.821516 18377 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:57.821731 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.822016 18377 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.822517 18377 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:57.822880 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.824465 18215 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.828637 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.829507 13277 raft_consensus.cc:2468] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:57.832018 18378 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:57.833407 18277 consensus_meta.cc:287] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.005s
I20260709 12:20:57.833841 18277 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:57.836453 18093 raft_consensus.cc:3055] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:57.836879 18093 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:57.837718 18093 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.838907 18093 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:57.843483 13284 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
W20260709 12:20:57.822026 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 476299us
I20260709 12:20:57.845965 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:57.845477 13840 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:20:57.849107 13277 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
W20260709 12:20:57.852357 18049 consensus_meta.cc:287] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.009s
I20260709 12:20:57.851449 18275 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:57.868146 13277 raft_consensus.cc:1240] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:20:57.856619 18139 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.857861 18077 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:57.867951 17796 consensus_meta.cc:287] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.545s	user 0.015s	sys 0.000s
W20260709 12:20:57.888078 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.888440 18139 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:57.889012 18363 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:57.889914 13283 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:57.876331 18275 raft_consensus.cc:697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:57.891511 18275 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.892865 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:57.893536 13208 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:57.896422 13103 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:57.897289 18246 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:57.897697 18246 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.898056 18246 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:57.898425 18199 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:57.898842 18199 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:57.846783 18247 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.891144 18139 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:57.880657 18176 consensus_meta.cc:287] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.744s	user 0.024s	sys 0.000s
I20260709 12:20:57.881275 18277 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:57.866248 18049 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:57.929747 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 407642us
I20260709 12:20:57.884550 18149 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:57.877722 18302 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:57.931732 13283 raft_consensus.cc:1217] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:20:57.938351 13283 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:20:57.899755 18199 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:57.884994 17796 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:57.944147 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 133572us
W20260709 12:20:57.957394 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.960242 13282 raft_consensus.cc:2393] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:57.960132 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:57.956957 13100 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:57.938969 18324 raft_consensus.cc:3055] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:57.936235 18215 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:57.965799 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:57.965615 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 324169us
I20260709 12:20:58.000630 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.001645 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:20:58.011715 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 60960.1us
W20260709 12:20:58.027634 18356 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.734s	user 0.004s	sys 0.000s
I20260709 12:20:58.028642 13285 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:58.029886 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.031050 13283 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:57.966972 18324 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:58.007006 18247 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:58.040637 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:58.046988 13207 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:20:58.047572 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 258110us
W20260709 12:20:58.050316 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48778.3us
I20260709 12:20:58.053066 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:58.032467 18369 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:58.035000 18215 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:58.059254 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.052100 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.062795 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:58.068216 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.065683 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:58.074014 18389 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:58.073920 18358 consensus_queue.cc:1059] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:58.075145 18387 consensus_queue.cc:1059] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:20:58.075881 18358 raft_consensus.cc:3055] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:58.076370 18358 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:58.076659 18387 raft_consensus.cc:3055] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:58.077191 18387 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:58.077371 18358 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.078809 18358 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:58.078389 18387 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:58.080260 18378 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:58.080358 18380 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:58.080389 18384 log.cc:927] Time spent T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:20:58.052284 17967 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:58.085462 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:58.085974 13277 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:58.091589 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:58.093792 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 161128us
I20260709 12:20:58.104568 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:58.108088 13177 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:58.110715 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:58.110711 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 58703us
W20260709 12:20:58.113641 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:58.114291 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.116099 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:58.049291 18149 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:58.119735 17796 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:58.121281 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:58.091054 18077 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
W20260709 12:20:58.126276 18354 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.856s	user 0.001s	sys 0.003s
I20260709 12:20:58.128396 18383 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:58.129151 18398 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:58.129592 18302 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:58.130605 18199 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:58.131695 13882 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:58.119797 13131 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:58.123376 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:58.142814 13129 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:20:58.144584 13175 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:58.156060 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.107615 18377 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:58.172575 18377 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:58.173758 13283 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
W20260709 12:20:58.177892 18393 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:20:58.105209 18380 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:58.175174 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.181769 18380 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:58.186643 13175 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:58.111729 18378 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.191171 13175 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:58.188493 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2264) took 1018 ms. Trace:
W20260709 12:20:58.189049 17976 consensus_meta.cc:287] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.663s	user 0.003s	sys 0.011s
I20260709 12:20:58.194034 17976 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:58.196412 17976 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:58.109321 18324 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.187989 18277 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:58.191619 18378 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:58.192063 18383 raft_consensus.cc:697] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:58.148890 18387 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:58.196619 17796 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:58.188153 18395 log.cc:927] Time spent T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:20:58.132946 18275 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:58.206751 13175 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:58.193846 13130 rpcz_store.cc:276] 0709 12:20:57.169687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.169842 (+   155us) service_pool.cc:224] Handling call
0709 12:20:57.170251 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:57.170709 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:57.170989 (+   280us) log.cc:844] Serialized 14 byte log entry
0709 12:20:57.271354 (+100365us) log.cc:844] Serialized 14 byte log entry
0709 12:20:57.271573 (+   219us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:57.288814 (+ 17241us) log.cc:844] Serialized 52 byte log entry
0709 12:20:57.288968 (+   154us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:57.289001 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.289064 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.840079 (+551015us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b180008ef60. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da0522 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:20:58.007204 (+167125us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:20:58.188278 (+181074us) raft_consensus.cc:1685] finished
0709 12:20:58.188299 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:58.188435 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2129,"prepare.queue_time_us":1258,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":2500,"raft.queue_time_us":22831,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":4857,"spinlock_wait_cycles":34173184,"thread_start_us":97805,"threads_started":1,"wal-append.queue_time_us":98167}
I20260709 12:20:58.154227 18398 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:58.219594 18365 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:58.221102 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.223261 13281 raft_consensus.cc:2410] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:20:58.231573 18388 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.239599 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.213061 18293 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.216041 18324 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:58.250767 18277 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:20:58.267994 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 151419us
W20260709 12:20:58.260030 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 152002us
I20260709 12:20:58.241156 18398 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:58.254475 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.248056 18358 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:58.240242 18215 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:58.247650 18275 raft_consensus.cc:697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:58.245770 18367 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.290745 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.266461 18277 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:58.288414 18397 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:20:58.295256 17880 consensus_meta.cc:287] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.640s	user 0.014s	sys 0.000s
I20260709 12:20:58.269891 18293 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.340922 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.300804 18277 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:58.342605 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:58.344604 18394 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260709 12:20:58.346704 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.347920 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:58.328158 18400 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:20:58.301165 18367 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:58.253156 18388 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.303233 18215 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.330413 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:58.333760 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.295043 18358 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:58.349097 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 94774.7us
W20260709 12:20:58.371798 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.361372 13284 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:58.352246 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.370373 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.291985 18246 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:58.374981 13283 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:20:58.376842 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.376682 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:58.298983 18383 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.384013 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.385810 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.383111 13282 raft_consensus.cc:2393] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:58.381494 13279 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:20:58.389001 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.393692 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:58.394799 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.397748 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:58.402014 18293 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:58.404198 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.405722 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.407616 18360 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:58.408805 18399 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:58.409401 18397 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:58.411384 18398 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:58.414269 18403 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.221s	user 0.000s	sys 0.002s
I20260709 12:20:58.418201 18246 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:58.421119 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.407814 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:20:58.422479 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 153525us
I20260709 12:20:58.423324 13206 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:20:58.423683 13278 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:58.426113 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.426851 13282 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:58.428774 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:58.429898 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:58.430056 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.430502 13882 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:20:58.431195 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:58.432253 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:58.432653 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.433482 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.437285 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.437686 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:58.441325 13175 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.442924 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.445961 18315 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:58.447016 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:58.447819 13279 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:58.451402 13886 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:58.452090 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.452900 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:58.448874 13252 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:58.449947 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:58.447304 13884 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:58.394049 18358 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:58.447543 13880 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:58.454420 13131 raft_consensus.cc:2410] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:20:58.457537 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:58.455090 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:58.458873 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:58.464035 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:58.457137 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:58.430876 18397 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:58.468952 13279 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:58.468199 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:58.470551 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:20:58.484962 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 60562.9us
W20260709 12:20:58.450681 13249 connection.cc:256] RPC call timeout handler was delayed by -1.2678621279999334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 12:20:58.489512 13249 connection.cc:256] RPC call timeout handler was delayed by -1.2075621280000632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
I20260709 12:20:58.435635 17796 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:58.387202 18275 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.540169 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:58.491149 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:58.491041 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:58.545480 13282 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:20:58.532613 13278 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:58.551705 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 118384us
I20260709 12:20:58.531641 13286 raft_consensus.cc:3055] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:58.537530 13283 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:58.554517 13130 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:58.532601 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.552825 13286 raft_consensus.cc:740] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:58.491991 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:58.447752 18363 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:58.532189 18315 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:58.624989 18315 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:58.625742 13102 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.492650 18302 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:58.628154 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:58.629649 13205 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:58.630537 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:20:58.632194 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 113463us
I20260709 12:20:58.633246 13249 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.633517 13887 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:58.634399 18389 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:58.637001 18392 log.cc:927] Time spent T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Append to log took a long time: real 0.467s	user 0.000s	sys 0.002s
I20260709 12:20:58.624174 13286 consensus_queue.cc:260] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.639635 13286 raft_consensus.cc:3060] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:58.635339 18389 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:58.643874 18315 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:58.650034 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.565721 13878 raft_consensus.cc:2393] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:20:58.660989 18367 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:58.662501 18398 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:58.667778 18397 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:20:58.669045 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 77105.4us
I20260709 12:20:58.669837 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:58.645836 18363 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:58.701431 13130 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
W20260709 12:20:58.703024 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.543481 18049 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:20:58.739341 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 113662us
I20260709 12:20:58.740710 13102 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:58.756469 13286 raft_consensus.cc:1275] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:20:58.757050 13286 pending_rounds.cc:85] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 10
I20260709 12:20:58.757320 13286 pending_rounds.cc:107] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:20:58.757614 13286 raft_consensus.cc:2889] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:58.707674 18176 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.523553 18410 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:58.737522 18246 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:58.786404 13278 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:58.565866 13204 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:58.568094 13203 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:58.801043 18388 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:20:58.814219 18408 log.cc:927] Time spent T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.269s	user 0.000s	sys 0.000s
I20260709 12:20:58.816529 18397 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.825608 18375 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:20:58.826301 18375 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.780611 18176 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.828361 18375 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:58.829823 18176 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:58.830020 13130 raft_consensus.cc:1275] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:20:58.830446 13130 pending_rounds.cc:85] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 6
I20260709 12:20:58.830695 13130 pending_rounds.cc:107] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:20:58.830930 13130 raft_consensus.cc:2889] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:58.783679 18411 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:58.831580 18411 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:58.831974 18411 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:58.833278 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:58.833664 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:58.835291 18049 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:58.835526 18394 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:20:58.835852 18049 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:58.836077 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:58.837597 18324 consensus_meta.cc:287] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.003s
I20260709 12:20:58.837991 13131 raft_consensus.cc:1240] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:58.838141 18049 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:58.811194 18409 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.839057 18409 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.839763 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:58.840584 13131 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:20:58.847616 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 107032us
I20260709 12:20:58.848482 13102 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.852327 13205 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:58.852639 13134 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:20:58.853124 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:58.853688 13203 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:58.854349 13130 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:58.841759 18409 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:58.845590 18367 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:58.872263 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:58.872906 13205 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:58.871728 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:58.877490 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:58.859021 18388 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:58.885752 13203 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:58.887277 13130 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:58.810366 18410 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.957938 18410 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:58.930981 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:58.932652 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:58.934916 18401 log.cc:927] Time spent T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.668s	user 0.003s	sys 0.009s
I20260709 12:20:58.923652 18413 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.959789 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:58.960489 13212 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:58.960271 18413 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.963058 18413 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:58.888049 18375 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:58.927798 18387 consensus_meta.cc:287] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.712s	user 0.013s	sys 0.000s
I20260709 12:20:58.926790 18177 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.971366 18177 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:58.973551 18177 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:58.975888 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2399) took 1306 ms. Trace:
I20260709 12:20:58.876596 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:58.980530 13204 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:58.927042 18176 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.981729 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:58.982364 13129 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
W20260709 12:20:58.969919 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 111610us
I20260709 12:20:58.976270 13285 rpcz_store.cc:276] 0709 12:20:57.693541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.707268 (+ 13727us) service_pool.cc:224] Handling call
0709 12:20:57.707713 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.029251 (+321538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.975678 (+946427us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b540023c154. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:58.975814 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535416192}
W20260709 12:20:58.982805 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 353738us
I20260709 12:20:58.977872 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:58.955614 18277 consensus_meta.cc:287] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.000s
I20260709 12:20:58.980461 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 3153) took 1150 ms. Trace:
I20260709 12:20:58.982375 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:58.990181 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:58.990129 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:58.969174 13205 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
W20260709 12:20:58.966004 18417 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.401s	user 0.002s	sys 0.000s
I20260709 12:20:58.985262 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:58.989564 13279 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:20:58.990280 13281 rpcz_store.cc:276] 0709 12:20:57.816860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.817071 (+   211us) service_pool.cc:224] Handling call
0709 12:20:58.967131 (+1150060us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54002297d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:20:58.967244 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930688384}
I20260709 12:20:58.991045 13887 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
W20260709 12:20:58.996021 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 362843us
I20260709 12:20:59.000558 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:59.016275 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:59.017232 13129 raft_consensus.cc:2410] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:20:59.017375 13210 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17. Ops: []
W20260709 12:20:59.017612 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 346655us
I20260709 12:20:59.023391 13840 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:20:59.052109 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.989503 13175 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:58.988874 18176 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:59.061515 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 72107.6us
I20260709 12:20:59.066031 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:59.066731 13286 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:59.067986 13278 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:58.994059 18246 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:20:59.069272 13249 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:20:58.993539 18277 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:59.076797 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 93194.2us
I20260709 12:20:59.084582 13249 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:59.083958 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:59.082231 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.086899 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:59.084443 13285 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:59.093554 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.094172 13211 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:20:59.084118 18049 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:59.094801 18049 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:59.095273 18049 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:59.100003 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:59.100232 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:59.100684 13129 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:20:59.102161 13881 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:59.093891 13285 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:59.061076 18177 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:59.112987 13207 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:59.011720 18315 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:20:59.077311 18358 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:59.115438 13175 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:59.115237 13283 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:59.125447 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.125674 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.126557 13249 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:59.140497 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.079998 18413 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:20:59.084796 18379 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:20:59.150061 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:59.118595 18380 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:59.153501 13129 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 15: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:59.155830 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:59.159452 13210 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
W20260709 12:20:59.165341 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 47963us
I20260709 12:20:59.160429 18382 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:59.170044 13134 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:20:59.171386 18426 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:20:59.177810 13841 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:59.179746 18428 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:59.180182 18428 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.180519 18428 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:59.185711 18399 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:59.186280 18399 raft_consensus.cc:697] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:59.189172 18428 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.191370 18428 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:59.191759 13177 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:59.193113 18360 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:59.193603 18360 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:20:59.194043 18360 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:59.199611 18176 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:59.187142 18399 consensus_queue.cc:237] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:59.147684 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:59.145246 18404 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.006s	sys 0.006s
I20260709 12:20:59.205082 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:20:59.221201 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:59.210726 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 63114.6us
I20260709 12:20:59.234691 18379 raft_consensus.cc:3055] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:59.234774 18246 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:59.235267 18379 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:59.235530 18246 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:59.236304 18379 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.236457 18246 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:59.237661 18379 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:59.237900 13285 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:59.242043 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 62766.6us
I20260709 12:20:59.243842 18405 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:59.244573 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:20:59.246030 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 91643.2us
I20260709 12:20:59.239212 13285 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:59.275180 18139 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.274925 18382 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:59.275763 18139 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.276683 18423 consensus_queue.cc:1059] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:59.147037 18415 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.130s
I20260709 12:20:59.278050 18139 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:59.152822 18427 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:59.141245 18367 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:20:59.292179 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:20:59.280529 13103 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:20:59.286850 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 53355.9us
I20260709 12:20:59.301553 13209 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:59.309774 13211 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:20:59.313633 13133 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:20:59.314874 13841 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:59.222168 18404 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.007s	sys 0.006s
I20260709 12:20:59.316828 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.248363 18176 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:59.320809 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.377142 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:59.336591 13208 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15. Ops: []
W20260709 12:20:59.425653 13838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.006s	sys 0.013s
I20260709 12:20:59.417115 13207 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:59.362232 13212 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:20:59.476284 13838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.007s	sys 0.017s
I20260709 12:20:59.323252 13210 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:20:59.391482 13175 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:20:59.290110 18375 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:59.412047 13204 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
W20260709 12:20:59.360013 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 44452.5us
I20260709 12:20:59.478551 13878 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:20:59.337409 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:59.486572 13209 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:59.487119 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 95728.6us
I20260709 12:20:59.487717 13130 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:20:59.301546 18139 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:20:59.316666 18388 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:20:59.425446 18383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.010s	sys 0.013s
W20260709 12:20:59.394912 18411 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.003s
I20260709 12:20:59.511142 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:59.503504 18405 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:59.514732 13284 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:59.355978 18429 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:59.359939 18418 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:59.517756 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 161502us
I20260709 12:20:59.396068 18380 raft_consensus.cc:3055] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:59.322876 18176 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:59.506120 18307 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.007s	sys 0.018s
I20260709 12:20:59.321452 18435 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:59.502372 18375 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.584131 13130 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:59.376677 18268 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:59.519604 13133 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:59.504315 18387 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:59.548501 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 218742us
I20260709 12:20:59.540427 18412 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:59.605969 13252 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:20:59.549141 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 467590us
I20260709 12:20:59.506105 18423 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:59.561079 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:59.387084 18382 consensus_queue.cc:1059] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.133s
W20260709 12:20:59.540969 18383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.015s	sys 0.022s
I20260709 12:20:59.565666 13135 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:59.356520 18378 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.182s
I20260709 12:20:59.361855 18367 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.180s
I20260709 12:20:59.356671 18324 consensus_queue.cc:1059] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.188s
W20260709 12:20:59.544075 18302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.025s	sys 0.099s
I20260709 12:20:59.537685 18428 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.388007 18398 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.174s
I20260709 12:20:59.537863 18277 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:59.517326 18177 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:20:59.560189 18418 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:59.580174 18434 log.cc:927] Time spent T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
W20260709 12:20:59.641916 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:59.642844 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.643465 18418 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:59.644538 18433 log.cc:927] Time spent T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:20:59.645294 18049 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.001s
I20260709 12:20:59.645951 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 1044) took 1510 ms. Trace:
I20260709 12:20:59.645725 18049 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:59.648192 18448 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 12:20:59.648555 18428 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:59.649562 18458 log.cc:927] Time spent T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:20:59.650940 18428 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:59.651669 18324 consensus_queue.cc:1243] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:20:59.652443 18454 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:20:59.577114 18307 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.009s	sys 0.021s
I20260709 12:20:59.654137 13208 raft_consensus.cc:1240] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:59.646327 13280 rpcz_store.cc:276] 0709 12:20:58.135238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.151563 (+ 16325us) service_pool.cc:224] Handling call
0709 12:20:58.152079 (+   516us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:58.208303 (+ 56224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.208358 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:58.227934 (+ 19576us) log.cc:844] Serialized 52 byte log entry
0709 12:20:58.525267 (+297333us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b18003ed760. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1 00007f70f4e48a0f
0709 12:20:58.997721 (+472454us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:58.997758 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.190966 (+193208us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b5400336b54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:59.191016 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:59.645733 (+454717us) raft_consensus.cc:1685] finished
0709 12:20:59.645755 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.645893 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":418,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5108,"spinlock_wait_cycles":124760576,"thread_start_us":472280,"threads_started":1,"wal-append.queue_time_us":1190256}
I20260709 12:20:59.656822 18382 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:59.657256 18382 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:59.658160 18382 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:59.574288 18176 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:59.619297 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.565234 18380 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:59.537667 18139 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:59.605180 18375 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:59.609580 18420 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:59.633983 18302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.025s	sys 0.099s
I20260709 12:20:59.562672 18411 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.634167 18457 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:59.616035 18268 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:20:59.698946 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 192094us
I20260709 12:20:59.614354 18435 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.620704 18387 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.669011 18382 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:59.624493 18412 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.677505 18018 raft_consensus.cc:3055] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:59.689677 18457 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.624193 18423 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:59.680884 18302 raft_consensus.cc:697] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:59.733870 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 197123us
I20260709 12:20:59.734408 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:59.749522 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:59.750905 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:59.751504 13278 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:59.750378 13103 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:20:59.739293 18379 consensus_meta.cc:287] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.501s	user 0.013s	sys 0.000s
I20260709 12:20:59.741181 18018 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:20:59.753875 18277 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 12:20:59.762912 13285 consensus_meta.cc:287] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.002s
W20260709 12:20:59.763906 18437 log.cc:927] Time spent T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:20:59.764916 18445 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:20:59.784603 18018 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.786099 18018 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:59.787273 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:59.787595 17880 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:59.787916 13286 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:20:59.766844 18411 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:20:59.768074 18444 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:20:59.792889 13285 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:59.754024 18049 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:59.688460 18420 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.797711 18380 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:20:59.799053 18360 consensus_meta.cc:287] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 12:20:59.799396 18380 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:59.754319 18324 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.800346 18324 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.803073 18324 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:59.803720 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:59.804363 13284 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:20:59.805522 18456 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:59.806018 18456 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:20:59.806495 13162 heartbeater.cc:646] Failed to heartbeat to 127.11.163.62:33937 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.11.163.62:33937 timed out after 15.000s (SENT)
I20260709 12:20:59.807868 18315 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:59.808406 18315 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:59.767995 18302 consensus_queue.cc:237] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:59.809391 18315 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:59.810678 18315 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:59.812294 18360 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:59.770613 18412 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:59.773182 18423 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:20:59.773358 18370 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:59.806977 18456 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:59.775177 18387 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:59.776548 18139 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:20:59.777249 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:59.814626 18456 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:59.816804 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 62014.2us
I20260709 12:20:59.779181 18268 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:59.746615 18457 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:59.828229 13282 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:59.813808 18370 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:59.774224 13209 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
I20260709 12:20:59.825071 13283 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:59.823448 18420 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:20:59.778005 13278 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:20:59.835891 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:59.836524 17880 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:20:59.846745 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.840700 13278 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:20:59.848183 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:20:59.849094 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.837736 18370 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:59.849061 13204 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
W20260709 12:20:59.849587 13131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.015s	sys 0.015s
I20260709 12:20:59.851547 13286 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:20:59.851284 13131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.015s	sys 0.015s
W20260709 12:20:59.851743 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:59.860841 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.860224 13841 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:20:59.854790 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 356235us
I20260709 12:20:59.851337 13209 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:59.865626 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:59.866616 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.862823 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:20:59.874136 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.874763 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:59.876711 13135 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:59.877172 13204 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:59.877408 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.871737 13212 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:20:59.877431 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:59.883697 13208 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:59.884152 13177 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:20:59.890322 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:59.891142 13134 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 9.
I20260709 12:20:59.896422 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:20:59.886016 13102 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.856s (SENT) [suppressed 20 similar messages]
W20260709 12:20:59.915491 13102 leader_election.cc:336] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 2.025s (SENT)
I20260709 12:20:59.880915 18370 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:59.916046 13102 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:20:59.917199 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.872382 18324 consensus_queue.cc:1048] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:20:59.841209 17880 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:20:59.919130 13130 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:20:59.897648 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:20:59.842746 18473 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.873291 18212 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:59.858582 18378 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:20:59.925485 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1726) took 1078 ms. Trace:
W20260709 12:20:59.932209 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48789.2us
I20260709 12:20:59.876174 18387 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.932693 13131 rpcz_store.cc:276] 0709 12:20:58.846620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.855107 (+  8487us) service_pool.cc:224] Handling call
0709 12:20:58.855376 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.926526 (+ 71150us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:59.133233 (+206707us) log.cc:844] Serialized 14 byte log entry
0709 12:20:59.857971 (+724738us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:59.858019 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:59.858069 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.925263 (+ 67194us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b54001f45d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:20:59.925306 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.925426 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":348524,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":5052,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":24236,"spinlock_wait_cycles":158831488,"thread_start_us":853929,"threads_started":2,"wal-append.queue_time_us":697968}
I20260709 12:20:59.927089 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:20:59.928522 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 44484.5us
I20260709 12:20:59.931726 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.941660 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:59.942135 13208 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:20:59.933465 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:59.942756 13134 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:59.854645 18405 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:20:59.938593 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:59.943646 13278 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:20:59.946182 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 80636us
I20260709 12:20:59.924302 18367 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:59.958323 13878 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:59.952113 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:20:59.959456 13206 raft_consensus.cc:2410] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:20:59.948876 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:20:59.960175 13210 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:59.956017 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:20:59.964969 18077 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:59.965453 18077 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.965811 18077 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:59.965893 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:59.839385 18463 consensus_queue.cc:1059] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:20:59.967195 13880 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:59.838711 18455 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:20:59.934389 18324 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:59.977880 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:59.979103 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:20:59.935055 18469 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.973333 13137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1725) took 1133 ms. Trace:
I20260709 12:20:59.938328 18275 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.984984 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:20:59.990679 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:20:59.947479 18212 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:20:59.937608 18215 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:21:00.005327 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:20:59.995783 13132 raft_consensus.cc:2393] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 15: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:20:59.958773 18367 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.944139 18378 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:00.011508 13880 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:00.014533 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:20:59.986831 18199 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:59.980437 13137 rpcz_store.cc:276] 0709 12:20:58.839443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.841166 (+  1723us) service_pool.cc:224] Handling call
0709 12:20:58.841459 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.841647 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:59.145645 (+303998us) log.cc:844] Serialized 14 byte log entry
0709 12:20:59.972909 (+827264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:59.972967 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:59.973028 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.973110 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.973262 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100,"prepare.queue_time_us":303832,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":41231,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":1117429,"threads_started":3,"wal-append.queue_time_us":680433}
I20260709 12:21:00.022855 13840 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:00.018570 13838 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:20:59.947872 18387 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.969660 18428 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:21:00.037973 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:00.027199 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 100232us
I20260709 12:20:59.939875 18473 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.999003 18454 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:00.042745 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:20:59.986339 18302 consensus_queue.cc:1059] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:21:00.034826 13277 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:00.040910 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:00.043995 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:00.023485 18367 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:00.051299 13249 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:00.060271 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 144810us
I20260709 12:21:00.061039 13249 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:00.063282 13133 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:21:00.030547 18455 raft_consensus.cc:3055] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:00.064982 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:00.009140 18275 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:00.068460 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 49979.3us
I20260709 12:21:00.075944 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:00.050196 18379 raft_consensus.cc:3055] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:00.078522 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:00.048661 18454 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.996485 18453 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:21:00.048897 18324 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:00.072078 18455 raft_consensus.cc:740] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:00.098562 13130 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:59.994458 18469 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.104116 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:00.065644 18302 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:00.099601 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:00.102367 13882 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:00.064317 18215 raft_consensus.cc:2764] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:21:00.035943 18412 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:21:00.091030 18404 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:00.074736 18049 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:00.067358 18423 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:00.144294 13132 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:00.079669 18465 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:00.169605 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 121622us
I20260709 12:21:00.097230 18443 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:00.097693 18410 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:00.097944 18454 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:00.077878 18379 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:00.047664 18176 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:20:59.986316 18388 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:21:00.178926 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 100480us
I20260709 12:21:00.182170 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:00.214116 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 138245us
I20260709 12:21:00.131318 18435 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:00.095853 18399 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:21:00.179468 18382 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:00.241901 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:00.177639 18358 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:00.486368 13134 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.002s
I20260709 12:21:00.128075 18212 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.140101 18375 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.101322 18467 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.119s
I20260709 12:21:00.061419 18405 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:00.340200 18482 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 12:21:00.447705 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 316041us
I20260709 12:21:00.488128 13280 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
W20260709 12:21:00.339620 18471 log.cc:927] Time spent T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:21:00.182313 18428 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:00.293439 18483 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:00.386417 18477 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:21:00.392393 18479 log.cc:927] Time spent T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.289s	user 0.000s	sys 0.000s
W20260709 12:21:00.243005 18461 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.198s	user 0.001s	sys 0.001s
W20260709 12:21:00.529168 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 287346us
I20260709 12:21:00.518240 17796 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.530243 17796 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:00.522360 18215 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.531631 18493 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:00.528604 18483 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.531874 18215 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.532284 18493 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:00.484231 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.477079 18363 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:00.491407 18435 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:00.493837 18473 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:00.495352 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.533941 18483 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:00.216073 18420 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:00.497640 18379 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:00.537137 18412 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:00.544979 18412 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:00.545609 18412 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:00.546686 18387 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:00.499607 18018 consensus_meta.cc:287] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.713s	user 0.020s	sys 0.003s
I20260709 12:21:00.501664 18404 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:00.547889 18404 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:00.549160 18475 consensus_queue.cc:1048] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:00.543642 18435 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.501847 18275 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:00.504987 18380 consensus_meta.cc:287] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.705s	user 0.017s	sys 0.011s
I20260709 12:21:00.506089 18469 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:00.509511 13134 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
W20260709 12:21:00.573691 18315 consensus_meta.cc:287] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.763s	user 0.015s	sys 0.004s
I20260709 12:21:00.504294 18367 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:00.510113 18415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.004s	sys 0.007s
W20260709 12:21:00.521118 13252 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:00.510149 18418 consensus_meta.cc:287] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.866s	user 0.012s	sys 0.008s
I20260709 12:21:00.506093 18176 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:00.507962 18382 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:00.601765 18382 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:00.538196 18378 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:00.499023 18388 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:00.496692 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 312476us
I20260709 12:21:00.541476 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1298) took 1183 ms. Trace:
I20260709 12:21:00.542058 18420 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.513466 18358 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:00.508232 18454 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:00.576225 18478 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.434s	user 0.002s	sys 0.007s
I20260709 12:21:00.576946 18423 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:21:00.552217 18370 consensus_meta.cc:287] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.008s
W20260709 12:21:00.597849 18457 consensus_meta.cc:287] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.769s	user 0.013s	sys 0.004s
W20260709 12:21:00.598414 18077 consensus_meta.cc:287] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.632s	user 0.015s	sys 0.000s
I20260709 12:21:00.600449 18418 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:00.626415 18456 consensus_meta.cc:287] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.811s	user 0.008s	sys 0.010s
I20260709 12:21:00.628235 18418 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:00.489387 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 246971us
I20260709 12:21:00.628816 18375 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:00.629842 18367 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:00.630640 18457 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:00.579772 18215 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:00.631393 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.633157 13281 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
W20260709 12:21:00.615633 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 66251.8us
I20260709 12:21:00.616004 13881 rpcz_store.cc:276] 0709 12:20:59.358225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.358412 (+   187us) service_pool.cc:224] Handling call
0709 12:20:59.358877 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:59.384729 (+ 25852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:59.384779 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:59.420519 (+ 35740us) log.cc:844] Serialized 26 byte log entry
0709 12:20:59.739630 (+319111us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:59.739675 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.739744 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:00.541254 (+801510us) raft_consensus.cc:1685] finished
0709 12:21:00.541279 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.541414 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15285,"raft.queue_time_us":19104,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":11272,"thread_start_us":212610,"threads_started":1,"wal-append.queue_time_us":470374}
I20260709 12:21:00.649014 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:00.619026 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2283) took 1296 ms. Trace:
I20260709 12:21:00.620280 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:00.621548 13128 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
W20260709 12:21:00.603940 18415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.004s	sys 0.008s
I20260709 12:21:00.624032 18378 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:00.625723 18493 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:00.614176 18380 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:00.666430 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 140807us
I20260709 12:21:00.642246 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:00.667578 13206 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
W20260709 12:21:00.644934 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.642956 13286 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:00.653600 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:00.667189 13177 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:00.669173 13209 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:00.654789 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:00.670651 13211 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:00.602999 18412 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.651695 13129 rpcz_store.cc:276] 0709 12:20:59.322495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.322670 (+   175us) service_pool.cc:224] Handling call
0709 12:20:59.323054 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:59.699599 (+376545us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:59.707452 (+  7853us) log.cc:844] Serialized 14 byte log entry
0709 12:20:59.803726 (+ 96274us) spinlock_profiling.cc:243] Waited 8.53 ms on lock 0x7b18000707e0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d23a 00007f70f4e97a2a
0709 12:21:00.031134 (+227408us) log.cc:844] Serialized 14 byte log entry
0709 12:21:00.031269 (+   135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:00.031311 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:00.031359 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.618790 (+587431us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b540011ce54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:00.618842 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.618968 (+   126us) inbound_call.cc:177] Queueing success response
0709 12:21:00.621258 (+  2290us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b18000707e0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
Metrics: {"mutex_wait_us":85685,"prepare.queue_time_us":6271,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":92056,"raft.run_cpu_time_us":2076,"raft.run_wall_time_us":42621,"spinlock_wait_cycles":911647488,"thread_start_us":223753,"threads_started":1,"wal-append.queue_time_us":474353}
I20260709 12:21:00.655944 13135 raft_consensus.cc:2368] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14.
I20260709 12:21:00.615408 18379 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:00.658272 13207 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:00.651072 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:00.624567 18423 consensus_queue.cc:1243] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer af3f42f0797349058724e0cb2e637d24 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:21:00.632982 18457 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:00.668991 18378 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.687222 18324 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:00.679649 18493 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:00.689215 13887 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:00.690320 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:00.691756 18410 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.691722 13209 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:21:00.692441 18465 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:00.737004 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:00.738075 13277 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:00.666604 18475 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:00.694660 18455 consensus_queue.cc:260] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:00.740728 18455 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:00.744302 18412 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:00.739732 18493 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:21:00.737344 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 47093.9us
I20260709 12:21:00.751768 13211 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:21:00.754649 13249 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:00.756680 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:00.760869 13282 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:00.643051 18077 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.769806 13277 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:21:00.758510 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:00.782033 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:00.673444 18380 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.701555 18324 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:00.758761 18429 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:00.761657 18049 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.819216 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:00.782156 18456 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:00.817966 13880 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:21:00.783142 18315 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.794195 18176 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:00.753625 18410 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.818475 18429 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:00.823801 18177 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:00.758536 18465 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.833703 18176 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.854784 18454 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:00.861497 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:00.865302 18435 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:00.872411 18077 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:00.873989 13034 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51922 (request call id 208) took 34926 ms (client timeout 15000 ms). Trace:
I20260709 12:21:00.874434 18465 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:00.874818 18466 raft_consensus.cc:3055] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:00.901785 18466 raft_consensus.cc:740] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:00.843952 18493 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:00.841744 18429 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:00.906085 18404 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.831518 18315 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.875350 13028 catalog_manager.cc:5697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 11 to 14, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 14 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:00.908624 13028 catalog_manager.cc:5697] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 7 to 13, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 13 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:00.910215 13028 catalog_manager.cc:5697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:00.877506 18378 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:00.879094 18176 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:00.911921 18378 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.912392 18378 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:00.883623 18324 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:00.914583 18324 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:00.921218 18500 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:21:00.924256 13028 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 9 to 14, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 14 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:00.926057 13028 catalog_manager.cc:5697] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 10 to 12, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 12 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:00.886209 18360 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:00.889128 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3199) took 1132 ms. Trace:
I20260709 12:21:00.900976 18368 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.907370 13204 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:00.884557 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:00.928910 18410 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:00.933350 18380 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:00.934621 18420 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:00.829308 18049 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:00.861318 18177 raft_consensus.cc:697] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:00.936517 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:00.944343 18499 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:21:00.949924 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 850351us
I20260709 12:21:00.950588 17880 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:01.013423 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:00.952951 18486 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:00.954633 13137 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:21:01.013852 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:00.956135 13129 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:01.014611 13209 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:21:00.956705 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.015312 13134 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
W20260709 12:21:00.950938 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 809927us
I20260709 12:21:00.959849 18476 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:00.962644 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 992) took 1041 ms. Trace:
I20260709 12:21:01.025924 13130 rpcz_store.cc:276] 0709 12:20:59.921628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.925644 (+  4016us) service_pool.cc:224] Handling call
0709 12:20:59.925978 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.103011 (+177033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.962394 (+859383us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54000c30d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:00.962589 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353441664}
I20260709 12:21:01.027197 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:00.891546 13034 rpcz_store.cc:269] 0709 12:20:25.947287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.947502 (+   215us) service_pool.cc:224] Handling call
0709 12:21:00.873826 (+34926324us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:56.220373 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:56.220975 (+   602us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:56.221019 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:20:56.221035 (+    16us) tablet.cc:662] Decoding operations
0709 12:20:56.222387 (+  1352us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:56.222470 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:56.222499 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:20:56.269247 (+ 46748us) tablet.cc:701] Row locks acquired
0709 12:20:56.269266 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:20:56.269408 (+   142us) write_op.cc:270] Start()
0709 12:20:56.274155 (+  4747us) write_op.cc:276] Timestamp: P: 1783599656269360 usec, L: 0
0709 12:20:56.274179 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:20:56.277159 (+  2980us) log.cc:844] Serialized 6292 byte log entry
0709 12:20:56.583473 (+306314us) op_driver.cc:464] REPLICATION: finished
0709 12:20:56.800970 (+217497us) write_op.cc:301] APPLY: starting
0709 12:20:56.801100 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:57.122100 (+321000us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:57.159575 (+ 37475us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:57.743126 (+583551us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:57.743513 (+   387us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 12:20:57.743558 (+    45us) write_op.cc:312] APPLY: finished
0709 12:20:57.744114 (+   556us) log.cc:844] Serialized 148 byte log entry
0709 12:20:57.943162 (+199048us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:58.027739 (+ 84577us) write_op.cc:454] Released schema lock
0709 12:20:58.027842 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:58.031880 (+  4038us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:58.031930 (+    50us) write_op.cc:454] Released schema lock
0709 12:20:58.636220 (+604290us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
Metrics: {"dns_us":222,"mutex_wait_us":2194753,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":217010,"apply.run_cpu_time_us":51907,"apply.run_wall_time_us":1230845,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71103,"num_ops":16,"prepare.queue_time_us":473302,"prepare.run_cpu_time_us":11134,"prepare.run_wall_time_us":267349,"raft.queue_time_us":138133,"raft.run_cpu_time_us":29376,"raft.run_wall_time_us":164957,"replication_time_us":308634,"spinlock_wait_cycles":63479680,"thread_start_us":1154918,"threads_started":5,"wal-append.queue_time_us":553849,"wal-append.run_cpu_time_us":14118,"wal-append.run_wall_time_us":2540625}]]}
I20260709 12:21:00.964166 18382 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.031138 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:00.969396 13208 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:21:00.974606 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:01.032333 13277 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:01.032825 13205 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:21:00.975505 13282 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:21:01.033375 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:00.976023 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:01.028262 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:01.034371 13212 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:21:00.983791 13281 rpcz_store.cc:276] 0709 12:20:59.778519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.778769 (+   250us) service_pool.cc:224] Handling call
0709 12:20:59.779067 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.648234 (+869167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.888886 (+240652us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54002319d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:00.889056 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963758976}
I20260709 12:21:00.992172 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:01.035641 13203 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:01.036859 13840 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:00.997097 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:00.915208 18378 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:01.004941 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.007527 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:01.030881 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:01.009725 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 906) took 1060 ms. Trace:
I20260709 12:21:01.044320 13886 rpcz_store.cc:276] 0709 12:20:59.949789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.950270 (+   481us) service_pool.cc:224] Handling call
0709 12:21:01.009522 (+1059252us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54004b8054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:01.009670 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978382080}
I20260709 12:21:00.975111 18474 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:01.071208 18474 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.071767 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 987) took 1184 ms. Trace:
I20260709 12:21:01.072305 13133 rpcz_store.cc:276] 0709 12:20:59.887306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.887461 (+   155us) service_pool.cc:224] Handling call
0709 12:21:01.071590 (+1184129us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540010d1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:01.071702 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258484096}
I20260709 12:21:01.073639 18474 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.073814 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:01.074572 13133 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:01.074780 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:01.075541 13886 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:01.016302 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.080804 13134 raft_consensus.cc:2393] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 14: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:01.081655 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.082320 13134 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:01.083014 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:21:01.083650 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 76217.9us
I20260709 12:21:01.084793 17880 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:01.084921 13102 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:00.959147 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.086774 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:01.086867 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.020147 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.029153 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.038131 13211 raft_consensus.cc:2410] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:21:01.038602 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.098531 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2291) took 1123 ms. Trace:
I20260709 12:21:01.148833 13130 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:21:01.150255 13886 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:01.148898 13136 raft_consensus.cc:2410] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:21:01.111672 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:01.153426 13283 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:01.039804 13209 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:01.047685 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.047909 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:01.048357 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:01.155061 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:01.155319 13285 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:01.030822 18486 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.043684 18499 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.104389 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:01.050251 18429 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.051681 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:01.051777 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.055648 18418 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:01.056897 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.057299 18049 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.058369 18177 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.181247 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:00.999055 18368 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.059660 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:01.043820 18360 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:21:00.976847 18427 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:21:00.997776 18435 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:21:01.092314 18370 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:01.002612 18397 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.169770 18468 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:01.063508 18176 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:01.065007 18508 log.cc:927] Time spent T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 12:21:01.215277 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 128614us
I20260709 12:21:01.218139 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2428) took 1269 ms. Trace:
W20260709 12:21:01.092034 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 60768.9us
I20260709 12:21:01.161912 13133 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:21:01.134959 13203 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:01.104882 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:01.071239 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1739) took 1230 ms. Trace:
I20260709 12:21:01.113708 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:01.219782 13282 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:01.219643 13128 rpcz_store.cc:276] 0709 12:20:59.840470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.859067 (+ 18597us) service_pool.cc:224] Handling call
0709 12:21:01.071017 (+1211950us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54003ab1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:01.071165 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715684224}
I20260709 12:21:01.148803 13135 rpcz_store.cc:276] 0709 12:20:59.975550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.990243 (+ 14693us) service_pool.cc:224] Handling call
0709 12:21:01.098349 (+1108106us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54003ac5d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:01.098469 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1378060160}
I20260709 12:21:01.148664 13884 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:21:01.179358 13881 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:21:01.045508 18443 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.152s
I20260709 12:21:01.058975 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:01.226739 13204 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:21:01.104629 18382 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.093747 17796 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:01.100319 18404 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.060654 13028 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:01.198176 13885 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:01.199892 13280 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2422) took 1466 ms (client timeout 1530 ms). Trace:
W20260709 12:21:01.257748 13280 rpcz_store.cc:269] 0709 12:20:59.733299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.734161 (+   862us) service_pool.cc:224] Handling call
0709 12:21:01.199743 (+1465582us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54003b65d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:01.199836 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900889984}
I20260709 12:21:01.259066 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:01.201254 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:01.202342 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:01.090272 18399 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:01.263243 13280 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:01.209275 13285 raft_consensus.cc:2468] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:21:01.045266 18476 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:01.186249 18506 log.cc:927] Time spent T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.295s	user 0.005s	sys 0.000s
I20260709 12:21:01.179898 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.178850 18454 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:01.222409 13283 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:21:01.271823 13283 pending_rounds.cc:85] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 6
I20260709 12:21:01.272111 13283 pending_rounds.cc:107] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:21:01.272341 13283 raft_consensus.cc:2889] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:01.218541 13286 rpcz_store.cc:276] 0709 12:20:59.948517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.962712 (+ 14195us) service_pool.cc:224] Handling call
0709 12:20:59.962962 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.668731 (+705769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.217928 (+549197us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400336654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:01.218082 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562893696}
I20260709 12:21:01.224148 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:01.224357 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:01.227839 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:01.231729 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 118145us
W20260709 12:21:01.275987 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 51710.8us
I20260709 12:21:01.276503 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.240376 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:01.243844 13103 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:01.263856 13878 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:01.102303 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.088594 18456 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:01.269243 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 51099.1us
W20260709 12:21:01.284114 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 58529.6us
I20260709 12:21:01.279794 13137 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:01.215878 18363 consensus_queue.cc:1059] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:21:01.255568 18415 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:01.286240 13249 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:01.264134 18399 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.252111 18418 raft_consensus.cc:697] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:01.229740 18397 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.300334 18456 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:01.416079 18505 log.cc:927] Time spent T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.528s	user 0.002s	sys 0.002s
I20260709 12:21:01.288228 18324 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:01.369299 18508 log.cc:927] Time spent T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:21:01.333154 18474 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:01.381688 18507 log.cc:927] Time spent T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.302s	user 0.000s	sys 0.003s
I20260709 12:21:01.293336 18399 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:01.288457 13840 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:21:01.497357 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 208949us
I20260709 12:21:01.472685 18423 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:01.456972 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 171067us
W20260709 12:21:01.523698 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 395323us
I20260709 12:21:01.258833 18492 consensus_queue.cc:1059] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:21:01.458128 13129 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:01.458817 18454 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:01.459450 18516 log.cc:927] Time spent T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 12:21:01.459298 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 173154us
I20260709 12:21:01.382748 18315 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.459997 18382 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:01.287401 13177 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:01.485531 13028 catalog_manager.cc:5697] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:01.228549 18468 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.511102 18379 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.516525 18380 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:21:01.518746 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 233539us
I20260709 12:21:01.532647 13102 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:01.490078 18405 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:01.521106 13285 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:01.496645 18474 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.523931 13103 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:21:01.526978 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 239626us
I20260709 12:21:01.527211 13885 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:01.506742 18307 raft_consensus.cc:2804] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:01.538954 13129 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:01.539896 13130 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:01.540843 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.537144 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.548874 13252 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:01.561606 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.565173 13885 raft_consensus.cc:2393] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:01.567190 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.567785 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.568028 13886 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:01.568423 13881 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:01.568564 13132 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:01.569590 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:01.573025 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:01.527711 18382 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:01.574277 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.573216 18368 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:01.529235 17796 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:01.507817 18423 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.576551 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.587297 13130 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
W20260709 12:21:01.579860 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 47264.7us
I20260709 12:21:01.588913 13102 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:01.584570 18404 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:01.578382 18378 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:01.601999 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.604882 13881 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:21:01.563073 18474 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:01.549855 18429 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:01.610013 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.613849 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:01.614034 18499 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.613857 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.616675 13885 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:01.563259 18315 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:01.574591 18472 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.587451 18139 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:01.654927 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.668577 13886 raft_consensus.cc:2393] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:01.587620 18382 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:01.586356 18465 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:21:01.664793 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 91719.8us
I20260709 12:21:01.665519 13175 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:01.586825 17796 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:01.668678 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 93398.3us
I20260709 12:21:01.560595 18405 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.593250 18307 raft_consensus.cc:697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:21:01.695619 18521 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:21:01.696209 18307 consensus_queue.cc:237] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.699626 18476 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.559962 18380 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.666738 18481 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:01.700578 13883 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:01.635628 18368 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:01.701836 18380 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.591253 18486 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.701752 18368 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.582140 18176 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:01.548914 18379 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.703903 18368 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:01.669601 18499 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:01.704238 18379 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:01.691064 13885 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:01.705093 18456 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.706662 18407 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:01.677243 13206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:21:01.708967 13206 raft_consensus.cc:606] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:01.708009 13028 catalog_manager.cc:5697] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 5 to 14. New cstate: current_term: 14 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:01.713145 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 47725.7us
I20260709 12:21:01.714449 13175 leader_election.cc:400] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14.
I20260709 12:21:01.714828 13175 leader_election.cc:403] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:01.715642 18533 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:01.604683 18519 consensus_queue.cc:1059] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 12:21:01.717268 18533 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14.
I20260709 12:21:01.683212 18315 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.721031 18315 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.684760 18429 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:21:01.722710 18176 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:01.723078 18176 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:01.724007 18176 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.725255 18176 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:01.573858 18418 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.734684 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.738441 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:01.739727 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.745494 18397 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.749855 18519 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:01.747361 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 52473.6us
I20260709 12:21:01.690346 17796 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:01.692111 18388 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:01.764609 13252 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:01.669386 18472 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.772841 18472 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:01.774174 18527 log.cc:927] Time spent T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:21:01.777346 18405 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:01.778172 13878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:21:01.778779 13878 raft_consensus.cc:606] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:01.808300 13880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1302) took 1733 ms. Trace:
I20260709 12:21:01.808768 13880 rpcz_store.cc:276] 0709 12:21:00.075043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.075216 (+   173us) service_pool.cc:224] Handling call
0709 12:21:00.101569 (+ 26353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:00.826920 (+725351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.787080 (+960160us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54004f1854. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:01.808231 (+ 21151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642743552}
I20260709 12:21:01.813130 18499 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:21:01.813310 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48843.8us
I20260709 12:21:01.710809 13028 catalog_manager.cc:5697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:01.815900 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 77585.1us
I20260709 12:21:01.820935 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:01.814291 13252 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:01.693390 18465 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.779296 18388 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.832777 18499 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:01.835028 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:01.835793 13205 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
W20260709 12:21:01.835963 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 247071us
I20260709 12:21:01.836853 13102 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:01.837925 18538 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:01.838585 13028 catalog_manager.cc:5697] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 9, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 9 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:01.840413 13028 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:01.842221 13028 catalog_manager.cc:5697] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 7 to 10, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 10 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:01.846560 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.846786 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.847321 13133 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
W20260709 12:21:01.854148 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 330279us
I20260709 12:21:01.854972 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:01.857360 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:01.845351 18542 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:01.834278 18388 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:01.870386 13103 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:01.871105 13249 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:01.864476 13028 catalog_manager.cc:5697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:01.877990 18324 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:01.875072 13028 catalog_manager.cc:5697] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:01.880873 18530 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.881397 18530 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.881141 13028 catalog_manager.cc:5697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 7 to 8, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 8 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:01.882648 18399 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.859658 18423 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:01.884025 18324 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:01.884754 18324 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:01.885349 18324 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:01.884711 18536 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:01.892460 18536 raft_consensus.cc:697] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:01.892756 18465 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:01.871964 18379 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:01.893815 18379 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.884157 18538 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:01.895717 18538 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:01.895639 13028 catalog_manager.cc:5697] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:01.896958 18538 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.869792 18380 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:01.898974 18380 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.901244 18380 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:01.872749 18455 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:21:01.905405 17796 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.909837 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:01.910451 13134 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:01.912071 18528 log.cc:927] Time spent T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:21:01.911994 17796 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:01.912289 18382 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.893497 18536 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:01.919394 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.898191 13028 catalog_manager.cc:5697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 6 to 11, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 11 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:01.895884 18379 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:01.919570 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:01.932746 13102 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:01.934543 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.917218 18455 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:21:01.936394 18382 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:01.936681 18519 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:01.918195 18324 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.920686 18474 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:01.938565 18498 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 1.387s	user 0.006s	sys 0.007s
I20260709 12:21:01.939281 18474 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.940083 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2289) took 1995 ms. Trace:
I20260709 12:21:01.940183 18139 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:01.940419 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.940678 18139 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:01.917152 18378 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:01.918808 18530 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:01.942001 13134 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:01.941854 13131 rpcz_store.cc:276] 0709 12:20:59.944317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.944464 (+   147us) service_pool.cc:224] Handling call
0709 12:20:59.944751 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:00.100471 (+155720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.100505 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:00.140357 (+ 39852us) log.cc:844] Serialized 52 byte log entry
0709 12:21:00.527854 (+387497us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:00.527897 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.527974 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:01.928234 (+1400260us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:21:01.939782 (+ 11548us) raft_consensus.cc:1685] finished
0709 12:21:01.939811 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.940017 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54233,"raft.queue_time_us":79236,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":15357,"spinlock_wait_cycles":7141632,"thread_start_us":434248,"threads_started":2,"wal-append.queue_time_us":368951}
I20260709 12:21:01.941126 13133 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:21:01.939155 18324 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.945546 18139 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:01.946158 18454 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:01.956419 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:01.959064 13102 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:01.946491 18542 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.946360 18382 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:01.963323 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 92281.8us
I20260709 12:21:01.964246 13249 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:01.965241 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:01.965689 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.966058 13887 raft_consensus.cc:2410] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:21:01.957708 18455 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:21:01.967701 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:01.971783 18382 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:01.974557 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:01.974911 18454 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:01.962513 18486 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:01.983600 18324 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:01.987268 18139 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.989464 18139 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:01.992208 18520 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.460s	user 0.000s	sys 0.002s
I20260709 12:21:01.994758 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:01.995534 18399 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:01.996003 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:01.996721 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:01.997598 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:01.997834 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:02.007933 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:02.008635 13252 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:02.009316 13212 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:02.011516 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:02.013864 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:02.015416 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:02.019167 13131 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:02.017349 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:02.008723 13207 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:21:01.998466 18443 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:02.031239 13252 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:02.031165 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:02.023679 18456 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:02.032315 13133 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:02.031250 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:02.035571 18378 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:02.036031 18378 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:02.036427 18378 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:02.041471 13249 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:02.043148 18443 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:02.043628 18443 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:02.044088 18443 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:01.966747 18542 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:01.992252 13028 catalog_manager.cc:5697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 4 to 12, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 12 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:02.049954 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:02.052496 13132 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:02.048807 18382 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:02.054539 18530 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:02.056387 13249 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:02.058039 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 99088.4us
I20260709 12:21:02.059475 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:02.033679 18456 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.061600 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:02.062091 18537 consensus_queue.cc:1059] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:02.062906 18466 consensus_queue.cc:260] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:02.063928 18541 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:21:02.064178 18456 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:02.125989 18443 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.069597 18542 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.069818 18358 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:02.070084 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 997) took 1045 ms. Trace:
I20260709 12:21:02.130373 13135 rpcz_store.cc:276] 0709 12:21:01.024391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.290834 (+266443us) service_pool.cc:224] Handling call
0709 12:21:01.453312 (+162478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.480843 (+ 27531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.480892 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.972063 (+491171us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b2c00000c88. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3786a11 00007f70f3796372 00007f70f4ec8a01 00007f70f4e8d43a 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2
0709 12:21:01.972489 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:21:02.029298 (+ 56809us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:02.042453 (+ 13155us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.042727 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.042856 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.069806 (+ 26950us) raft_consensus.cc:1685] finished
0709 12:21:02.069898 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.070026 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16272,"prepare.queue_time_us":12852,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":24161,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":18596,"spinlock_wait_cycles":3559808,"thread_start_us":56396,"threads_started":1,"wal-append.queue_time_us":83974}
I20260709 12:21:02.132834 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:02.133961 18268 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:02.134356 18268 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:02.073385 18388 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.136750 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:02.137406 18388 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.076424 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.079972 13131 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:02.082409 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:02.087143 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.139035 13132 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:02.139218 13880 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:02.086570 13249 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:02.139951 18382 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:02.139999 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 53527.5us
I20260709 12:21:02.140612 18382 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:02.141497 18382 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:02.141985 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:02.143280 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:02.143507 18379 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.144073 13281 raft_consensus.cc:2393] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:02.144129 18379 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:02.144219 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.157080 13284 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 17.
I20260709 12:21:02.085462 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:02.158380 13883 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:21:02.158604 18542 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:02.159119 18542 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.120271 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:02.163872 18378 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:02.167274 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:02.123840 18466 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:02.167884 13207 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:02.169988 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.171949 18383 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:02.172564 18383 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.175420 18383 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.176710 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:02.055163 13028 catalog_manager.cc:5697] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:02.127600 18139 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:02.127836 18454 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:02.056416 18530 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:02.201690 18542 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.201877 18454 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:02.178673 13028 catalog_manager.cc:5697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:02.201768 18139 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.148666 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:02.149662 18540 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.184s	user 0.000s	sys 0.003s
I20260709 12:21:02.150632 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:02.226195 13205 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:21:02.226378 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.118950 18049 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:02.152347 18379 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:02.155468 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:02.061347 18546 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:02.204763 18454 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:02.147882 13285 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:21:02.135252 18268 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.220981 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.247908 13284 raft_consensus.cc:2410] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 12:21:02.248183 18504 log.cc:927] Time spent T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 1.384s	user 0.009s	sys 0.010s
I20260709 12:21:02.250176 18443 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.250433 13135 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:21:02.251906 18139 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.206929 18378 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:02.261472 13281 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:21:02.261499 13282 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:02.263504 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:02.277289 13284 raft_consensus.cc:1240] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:21:02.285985 13881 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:02.231294 13207 raft_consensus.cc:2468] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:02.241763 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.242748 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.243122 18049 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.293305 18049 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:02.293597 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:02.294000 18443 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:02.294628 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.294536 18443 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.295465 13285 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:02.290966 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:02.296283 13286 raft_consensus.cc:2393] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:02.305753 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:02.306707 13881 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:02.308791 13883 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
W20260709 12:21:02.324862 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.326959 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.337600 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:02.347265 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.350121 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.354514 13102 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:02.354727 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:02.355530 13207 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:02.356499 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:02.358383 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:02.359685 13205 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:02.361452 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:02.357127 13137 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:21:02.365677 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:21:02.365885 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 512173us
I20260709 12:21:02.390650 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.391536 13102 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:02.392704 13102 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:02.413239 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.204249 13028 catalog_manager.cc:5697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 7 to 10, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 10 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:21:02.420910 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 71980.9us
I20260709 12:21:02.422571 13838 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:02.424168 18443 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.396021 18379 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.425439 13102 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:02.425834 18379 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:02.337335 18324 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.422677 18455 raft_consensus.cc:2764] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:21:02.419018 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:02.433465 18367 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:02.449179 18454 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:02.438464 13212 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:02.450160 18454 consensus_queue.cc:1059] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:02.430183 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:02.454228 13279 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:02.434042 13881 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:21:02.384665 18545 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:02.365686 18466 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:02.415597 13028 catalog_manager.cc:5697] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 2 to 8, term changed from 6 to 12, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to <none>, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:02.462630 13838 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:02.425478 18468 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.461580 18425 raft_consensus.cc:2764] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:21:02.398088 18486 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:02.461850 18176 raft_consensus.cc:2764] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:21:02.461709 18388 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:02.452976 18307 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:21:02.453262 18324 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:02.517855 18510 log.cc:927] Time spent T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 1.410s	user 0.000s	sys 0.024s
I20260709 12:21:02.520256 18488 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:02.487504 18466 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:02.526125 18522 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.891s	user 0.008s	sys 0.003s
I20260709 12:21:02.540468 18529 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.529306 18379 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:02.541193 18529 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:02.542312 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 1078) took 1878 ms. Trace:
I20260709 12:21:02.542738 13278 rpcz_store.cc:276] 0709 12:21:00.663980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.665402 (+  1422us) service_pool.cc:224] Handling call
0709 12:21:00.665757 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:00.830188 (+164431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.830217 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:00.830652 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:21:01.070287 (+239635us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b180040b160. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d0d1 00007f70f4e48a0f
0709 12:21:01.452214 (+381927us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:21:01.489499 (+ 37285us) log.cc:844] Serialized 14 byte log entry
0709 12:21:01.489718 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.920309 (+430591us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54002305d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:01.920365 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.064069 (+143704us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b180040b160. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:21:02.525535 (+461466us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:21:02.542096 (+ 16561us) raft_consensus.cc:1685] finished
0709 12:21:02.542117 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.542253 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1776,"prepare.queue_time_us":39368,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":2164,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":19223,"spinlock_wait_cycles":455827200,"thread_start_us":381654,"threads_started":1,"wal-append.queue_time_us":688250}
I20260709 12:21:02.484064 18275 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:02.467303 18545 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.562873 13881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:21:02.563764 13881 raft_consensus.cc:606] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:21:02.531567 18388 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.565044 18542 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.556180 18456 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:02.583464 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 93915us
W20260709 12:21:02.587649 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 162336us
I20260709 12:21:02.592374 13279 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:02.592698 18486 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:21:02.595865 18486 consensus_queue.cc:1243] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:02.604804 13285 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:02.624022 18488 raft_consensus.cc:993] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:02.624687 18488 raft_consensus.cc:1081] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:02.627799 13209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:21:02.628098 18275 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:02.628612 13209 raft_consensus.cc:606] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:02.635411 18493 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.636237 18493 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.639601 18379 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.640184 18379 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.655259 13209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:21:02.687260 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:02.599989 18529 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:02.642796 18379 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.587860 18542 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:02.680387 13209 raft_consensus.cc:606] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:02.691560 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:21:02.694564 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 102321us
I20260709 12:21:02.621018 18466 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:02.689898 18555 log.cc:927] Time spent T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:21:02.706059 13204 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:02.713380 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.714334 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:02.714457 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:02.715855 13102 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:02.716416 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:02.717433 13102 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:02.719668 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.700174 18411 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.721781 13212 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:21:02.720278 13884 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:02.722875 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.723548 18548 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:02.733035 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:02.733851 13878 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:02.734611 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.723671 18481 consensus_queue.cc:1059] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:21:02.731774 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.739319 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:02.741272 13887 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:02.743139 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:02.731877 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:02.745566 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.723623 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.755995 13209 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:02.756606 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.740725 18139 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:02.742130 18557 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.760591 13212 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:02.750849 18493 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.715503 18560 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:21:02.771116 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:02.718137 18486 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 12:21:02.723157 13019 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b5031b82872c430cbd03772ba96480ff with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:21:02.774087 13019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 79261.4us
I20260709 12:21:02.748301 18411 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.762600 18324 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.767342 18545 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:02.753913 18049 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:02.786391 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:02.790635 13207 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:02.772696 18560 consensus_queue.cc:1243] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:21:02.802791 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:02.785537 18562 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:21:02.814839 18049 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:02.805461 18545 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:02.807997 18548 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:02.808399 18275 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:02.795712 18453 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:02.809525 18176 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:02.810839 18465 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:02.811990 18564 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:02.765875 18557 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.801371 18388 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.828107 18453 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:02.845189 18561 raft_consensus.cc:3055] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:02.845659 18561 raft_consensus.cc:740] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:02.846997 13205 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:02.846587 18561 consensus_queue.cc:260] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.848119 18542 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:02.820848 18456 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:02.850136 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.825721 18411 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:02.849421 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:02.859417 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:02.860267 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.861109 13884 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:02.858650 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:02.858860 13133 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:02.870599 13205 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:21:02.861403 13252 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:02.908449 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:02.909488 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48163.6us
I20260709 12:21:02.865729 13880 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:02.915450 13175 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:02.913980 18443 raft_consensus.cc:2804] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:02.861528 18453 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:02.859728 18542 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:21:02.932678 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 124709us
I20260709 12:21:02.920463 18443 raft_consensus.cc:697] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:02.917568 18360 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:02.924340 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:02.915271 18456 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:02.914620 18519 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:02.917600 17796 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:21:02.967778 18440 raft_consensus.cc:3055] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:02.968348 18440 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:02.923491 18215 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:02.969156 18440 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:02.969575 18542 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:02.970220 18440 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:02.971969 18542 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:02.972481 18566 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:02.972987 18566 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:02.973407 18566 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:02.950714 13175 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:02.922035 18561 raft_consensus.cc:3060] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:02.985651 13175 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:21:02.988072 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.995307 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.996582 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.009840 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.010939 13277 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:02.991336 18363 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:21:03.004878 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.011757 13281 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:02.976385 18456 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.013056 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:03.013365 13282 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:21:03.003319 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 292949us
W20260709 12:21:03.016606 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.016793 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:03.015551 18456 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:03.018898 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:02.984781 18542 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:03.019690 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:03.023532 13278 raft_consensus.cc:2376] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15. Re-sending same reply.
I20260709 12:21:03.023959 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:03.022856 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:03.025200 13204 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:03.026551 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:03.018003 13210 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:21:03.021528 13280 raft_consensus.cc:1240] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:03.031991 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:03.003973 18453 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:03.033725 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:03.036940 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:03.035998 13203 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:21:03.037796 13283 raft_consensus.cc:3060] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:03.011930 18382 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:03.022830 18542 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.030833 18399 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:03.068415 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.069205 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:03.074358 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:03.084841 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:03.071262 18542 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:03.089221 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 90680.3us
I20260709 12:21:03.093608 13252 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:03.101783 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:03.102072 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.102629 13281 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:03.103237 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.103384 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:03.104012 13278 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:03.104570 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.105242 13277 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:03.113619 18399 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.114243 18399 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:03.117272 18529 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:03.117750 18529 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.118317 18529 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:03.082568 18465 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:03.120373 18465 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.122726 18465 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:03.125370 18575 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:03.125952 18575 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.078948 18246 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:03.127843 18246 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.128409 18575 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.068243 18443 consensus_queue.cc:237] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.130262 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.103390 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.132185 13281 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:03.117668 13249 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:03.137437 13283 raft_consensus.cc:2468] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:03.140236 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.066000 18453 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.146118 13883 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:21:03.155938 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.074957 18382 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.221403 18382 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:03.223650 18514 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 1.750s	user 0.012s	sys 0.021s
I20260709 12:21:03.224987 13177 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:03.227205 13177 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.177692 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:03.193439 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 51223.9us
I20260709 12:21:03.141903 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:03.228861 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:03.229092 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 87288us
I20260709 12:21:03.203838 18324 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.204792 18405 raft_consensus.cc:993] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:03.206501 18453 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:03.208429 18566 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.140795 18379 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:03.141449 18049 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:21:03.213346 18542 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.195148 18407 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:03.194633 13131 raft_consensus.cc:1275] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:21:03.249694 13131 pending_rounds.cc:85] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 11
I20260709 12:21:03.250015 13131 pending_rounds.cc:107] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:21:03.250263 13131 raft_consensus.cc:2889] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:03.236368 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.236603 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:03.237142 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.251632 13882 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:03.238000 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:03.252416 13883 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:03.237739 18453 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:03.239879 18519 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:03.235836 18579 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:03.240134 18405 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:03.242764 13133 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:03.238454 18215 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:03.259334 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:03.236593 18534 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.241153 18427 raft_consensus.cc:1081] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:03.236909 18382 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:03.244295 13177 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:03.287060 13177 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.274712 13207 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:03.266324 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:03.280906 13883 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:03.290999 13100 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.292321 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:03.293890 18536 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:03.296566 13100 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.260895 18246 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:03.299952 13177 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.272812 17796 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.275846 18360 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:03.302856 13128 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:03.272953 18379 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:03.241375 18324 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.302567 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:21:03.306411 13129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 1000) took 2150 ms (client timeout 2247 ms). Trace:
I20260709 12:21:03.262961 18363 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 12:21:03.309762 13129 rpcz_store.cc:269] 0709 12:21:01.151274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.202117 (+ 50843us) service_pool.cc:224] Handling call
0709 12:21:03.301716 (+2099599us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b540027d654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:03.301870 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169482624}
I20260709 12:21:03.282390 18440 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.318420 18440 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:03.321944 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.323141 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:03.301688 18466 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:03.273550 18453 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.326880 18440 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:03.302251 18420 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:03.308027 18360 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.304405 18536 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:03.309093 18493 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:03.345453 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 44908.2us
I20260709 12:21:03.308799 17796 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.353646 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:03.309381 18519 consensus_queue.cc:1059] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:21:03.329077 18466 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.331885 18427 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:03.302080 18382 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.285122 18534 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.347769 18360 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:03.363284 13281 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:21:03.366334 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 63848.2us
I20260709 12:21:03.372232 13279 pending_rounds.cc:85] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 8
I20260709 12:21:03.372556 13279 pending_rounds.cc:107] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:21:03.372807 13279 raft_consensus.cc:2889] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:03.315865 18379 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.374629 13100 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.343398 18149 raft_consensus.cc:3055] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:03.364729 18466 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:03.399698 13100 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.401612 13100 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:03.403385 13278 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:03.403858 13280 pending_rounds.cc:85] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 5
I20260709 12:21:03.404130 13280 pending_rounds.cc:107] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:21:03.404369 13280 raft_consensus.cc:2889] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:03.412587 17796 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.413287 17796 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:03.415571 18536 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:03.369446 18537 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:03.375617 13281 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:21:03.416487 18542 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.417336 18590 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:03.426294 18405 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:03.428776 18405 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.429366 18379 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.429955 18379 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:03.430419 18379 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.431396 18405 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.432152 18590 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.432852 18453 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.434258 18590 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.435108 18534 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:03.381245 18149 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:03.436676 18566 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.422834 18246 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:03.440100 18246 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:21:03.363657 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 63781.6us
I20260709 12:21:03.443553 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:03.444758 13177 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:03.436872 18149 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.446211 18149 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:03.446224 18542 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:03.446902 18542 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:03.447309 18542 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:03.447562 18382 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.448817 18324 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.448787 18379 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.446075 18246 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.397174 18455 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:03.410650 18427 raft_consensus.cc:3055] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:03.462172 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.370834 18529 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.403066 13100 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:03.454764 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.459499 18405 raft_consensus.cc:2804] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:03.473208 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:03.474257 13281 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:03.451947 18537 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:03.462349 18427 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:03.486330 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:03.479315 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 76325.8us
I20260709 12:21:03.488938 13100 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.491405 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:03.492498 13249 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:03.493762 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.496518 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.471753 13285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:21:03.492275 13286 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:03.499558 13285 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:03.499975 13285 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:03.451025 18456 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.501358 13100 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:03.505533 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 921) took 1918 ms. Trace:
I20260709 12:21:03.505934 13886 rpcz_store.cc:276] 0709 12:21:01.586822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.688769 (+101947us) service_pool.cc:224] Handling call
0709 12:21:01.690513 (+  1744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.855307 (+164794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.855365 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.855419 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:01.855483 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.505291 (+1649808us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54004560d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:03.505336 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.505463 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378429440}
I20260709 12:21:03.483454 18370 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:03.508591 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.519220 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.501986 18379 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:03.521425 18410 consensus_queue.cc:1048] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:03.522567 18564 raft_consensus.cc:993] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: : Instructing follower af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:21:03.523494 18474 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:03.502389 18593 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:03.569378 13249 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.510471 18454 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:03.529628 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:03.486171 18405 raft_consensus.cc:697] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:03.537423 13886 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:21:03.544687 13284 raft_consensus.cc:2393] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:03.545574 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:03.503973 18139 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:03.602911 13285 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.606046 13249 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.609746 18564 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:03.546396 18370 raft_consensus.cc:697] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:03.502240 18049 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:21:03.614670 13249 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:03.559615 18324 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:03.562894 18579 raft_consensus.cc:1081] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Signalling peer af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:21:03.645912 13285 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:03.531502 18465 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
W20260709 12:21:03.651850 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.594274 18215 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:03.616506 18455 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 12:21:03.663199 18588 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.295s	user 0.000s	sys 0.010s
I20260709 12:21:03.664448 18456 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:03.664208 18215 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.617193 18454 raft_consensus.cc:697] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:03.615947 18379 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:03.637995 18440 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:03.666832 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:03.622474 18382 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:03.679481 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 325971us
I20260709 12:21:03.680552 13175 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:21:03.687953 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 73399.2us
I20260709 12:21:03.688827 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:03.691138 13281 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:03.561697 18427 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.705696 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.612763 18537 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.688088 18564 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:03.707584 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:03.693466 18379 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:03.717921 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.697242 17796 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:03.704898 18382 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:03.723599 18382 raft_consensus.cc:697] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:03.725435 18358 raft_consensus.cc:993] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:03.724840 18382 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.726099 18358 raft_consensus.cc:1081] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:03.712720 18139 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:03.728067 18598 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:03.707240 18246 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:21:03.707683 18405 consensus_queue.cc:237] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.732913 18360 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.699632 18370 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.718825 18379 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.737475 18379 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:03.703145 18597 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:03.721436 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:03.748374 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:03.623490 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 93924.7us
I20260709 12:21:03.681433 18440 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.759128 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:03.706981 18606 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:03.713553 18564 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.712672 18529 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:03.716675 18427 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:03.718695 18474 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:03.805418 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:03.809544 13129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:60854
I20260709 12:21:03.810236 13129 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:03.811975 13129 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:03.814934 13278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38658
I20260709 12:21:03.802646 18246 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:03.817854 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:03.818311 18246 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.769098 18583 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:03.821125 18246 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.715492 18536 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:21:03.825821 13883 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:21:03.827533 18474 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.828112 18474 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:03.828972 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.747037 18603 consensus_queue.cc:1059] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 12:21:03.832569 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.771749 18564 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:03.835981 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:03.838280 18551 log.cc:927] Time spent T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.644s	user 0.004s	sys 0.000s
W20260709 12:21:03.839310 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.839305 18601 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.840937 18601 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.817085 18557 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:03.845140 18601 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:03.845568 18268 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:03.804853 18605 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:21:03.832809 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:03.851665 13278 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:03.852262 13278 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:03.855752 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.761591 18420 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:03.869144 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.760656 18596 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:03.874150 13283 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:03.878998 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.879877 18360 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:03.872996 18596 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:03.886925 18596 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:03.893245 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.899745 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:03.901350 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 234606us
I20260709 12:21:03.863793 18246 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:03.722362 18454 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.889381 18277 raft_consensus.cc:3055] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:03.923585 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:03.765995 18606 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:03.948715 13019 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b5031b82872c430cbd03772ba96480ff with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:21:03.938541 18399 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.824s	user 0.014s	sys 0.000s
I20260709 12:21:03.957294 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:03.957957 13135 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:03.961659 18466 consensus_meta.cc:287] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
I20260709 12:21:03.962119 18466 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.759558 18597 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.956936 13278 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.939091 18443 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.983942 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:03.986738 13209 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:21:03.971128 13129 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:03.946169 18277 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:03.988770 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.017949 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:04.023916 18499 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:04.024533 18499 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.029771 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:03.949380 18606 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:04.030412 13210 raft_consensus.cc:3055] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:04.035109 13210 raft_consensus.cc:740] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:04.043820 13278 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:04.044687 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.045539 13129 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.048060 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:04.036067 13210 consensus_queue.cc:260] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.947165 18246 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:04.056260 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.067757 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:04.068674 13207 raft_consensus.cc:3055] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:04.069015 13207 raft_consensus.cc:740] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:04.076683 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:04.069692 13207 consensus_queue.cc:260] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:03.980070 18399 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.089015 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.085376 13252 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:04.015784 18443 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.106276 13135 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:04.106925 18443 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.090988 18277 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.108678 18529 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:04.096560 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.108799 18277 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:04.120227 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.121045 13282 raft_consensus.cc:2393] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 17: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:04.121117 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1746) took 2888 ms. Trace:
I20260709 12:21:04.121598 13128 rpcz_store.cc:276] 0709 12:21:01.225294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.456840 (+231546us) service_pool.cc:224] Handling call
0709 12:21:03.302618 (+1845778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.305748 (+  3130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.113902 (+808154us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b540027d650. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8c8ad 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:04.114039 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4243870592}
I20260709 12:21:04.125677 13278 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:04.084869 18474 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:04.144074 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 232352us
I20260709 12:21:04.157032 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.158216 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.159008 13278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:42730
I20260709 12:21:04.159593 13278 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:04.160076 13278 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:04.159577 13135 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:04.157330 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.100463 18440 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:04.142338 18542 consensus_meta.cc:287] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.693s	user 0.007s	sys 0.005s
I20260709 12:21:04.165066 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.166826 13128 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:04.162953 13136 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:04.167800 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:04.169902 13129 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:04.088312 18049 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 12:21:04.175694 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 244949us
I20260709 12:21:04.179785 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.180438 13203 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:21:04.180550 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:04.181188 13883 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:04.181478 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:21:04.181751 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.184005 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:04.185396 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:04.187095 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.187573 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:04.190164 13879 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:04.191751 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.194619 13882 raft_consensus.cc:2393] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:04.194350 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.142849 18443 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:04.195889 13249 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:04.101106 18564 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.204089 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.198956 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:04.167615 18468 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:21:04.163137 18536 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.211082 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:04.251150 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 52285.1us
W20260709 12:21:04.253225 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.254026 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:04.257045 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.213953 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:04.259577 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 63764.9us
I20260709 12:21:04.260113 13212 raft_consensus.cc:2410] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:21:04.198956 18367 raft_consensus.cc:3055] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:04.255854 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:04.251962 13879 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:04.265998 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:04.266307 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:04.266736 13135 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:04.268180 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:04.270628 13129 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:04.274223 13278 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.193801 18529 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:21:04.171944 18542 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:04.210299 18324 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:04.285002 13882 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 15: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:04.285745 13175 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:04.242125 18399 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.326079 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:04.326757 13137 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:04.263876 18268 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:04.264822 18462 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.265340 18600 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:04.269371 18601 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:04.344058 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:04.344705 13881 raft_consensus.cc:3055] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:04.262493 18367 raft_consensus.cc:740] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:04.263293 18443 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.314702 18493 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:04.349949 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 64274.8us
I20260709 12:21:04.350435 13135 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:04.345026 13881 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:04.333420 18268 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.317430 18324 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:04.355453 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:04.343577 18597 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:04.355772 13278 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.320899 18405 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:04.359927 13881 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.415210 13128 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:04.354509 18410 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.430584 13840 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:04.420499 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.264614 18536 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:04.411453 18268 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:04.410823 18474 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:04.346899 18462 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.454844 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:04.479393 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.481452 13128 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:04.447538 18246 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:04.469645 18614 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 12:21:04.354003 18382 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:04.533403 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:04.534179 13132 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:04.490875 18588 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:21:04.450275 18410 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.478734 18049 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:21:04.527657 18615 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
W20260709 12:21:04.548607 18636 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:21:04.611133 13132 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
W20260709 12:21:04.552188 18629 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:21:04.552404 18630 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 12:21:04.553552 18635 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:21:04.510291 18382 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:04.555636 18628 log.cc:927] Time spent T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:21:04.540331 18620 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.368s	user 0.000s	sys 0.006s
I20260709 12:21:04.657838 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.534716 18399 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:04.572448 13282 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:04.573307 18624 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
W20260709 12:21:04.573827 18626 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 12:21:04.576500 18536 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:04.580152 18404 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:04.692844 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:04.693332 18404 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:04.693813 18599 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.580471 18607 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:04.538854 18307 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:04.583671 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36412 (request call id 1115) took 1261 ms. Trace:
I20260709 12:21:04.586712 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:04.700408 13203 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:04.588001 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.590437 18643 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.590730 18593 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.591025 13249 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:04.593010 18596 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.000s
I20260709 12:21:04.596025 18462 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.586763 18499 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.598807 13207 raft_consensus.cc:3060] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:04.600426 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3224) took 1239 ms. Trace:
W20260709 12:21:04.601469 18606 consensus_meta.cc:287] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.002s
I20260709 12:21:04.608098 18049 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.610024 18456 raft_consensus.cc:3055] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:04.612269 18443 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.541383 18324 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:04.553747 18633 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:21:04.631099 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.633117 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.559674 18564 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:04.543035 18427 consensus_meta.cc:287] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.004s
I20260709 12:21:04.661742 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:04.750638 13207 raft_consensus.cc:2468] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:04.754176 13129 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:04.754314 13252 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:04.664381 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:21:04.551343 18592 log.cc:927] Time spent T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: Append to log took a long time: real 1.119s	user 0.003s	sys 0.003s
I20260709 12:21:04.689699 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:04.699159 13212 rpcz_store.cc:276] 0709 12:21:03.322532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.322780 (+   248us) service_pool.cc:224] Handling call
0709 12:21:04.583449 (+1260669us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54002d4e54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:04.583606 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2132018944}
I20260709 12:21:04.705260 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.526499 18631 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.160s
I20260709 12:21:04.656327 18382 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:04.687042 18636 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.072s	user 0.004s	sys 0.000s
I20260709 12:21:04.712323 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:04.769109 13204 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:04.715955 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 125020us
I20260709 12:21:04.723066 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.720444 13283 rpcz_store.cc:276] 0709 12:21:03.361416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.361593 (+   177us) service_pool.cc:224] Handling call
0709 12:21:03.375722 (+ 14129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.874723 (+499001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.600183 (+725460us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54004083d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:04.600364 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145544448}
I20260709 12:21:04.770612 13249 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:04.733634 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 303157us
I20260709 12:21:04.771756 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:04.695494 18645 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:04.711041 18600 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:04.741703 13284 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:21:04.739034 18542 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:04.779726 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:04.742106 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:04.742702 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.742630 13279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3227) took 1371 ms. Trace:
I20260709 12:21:04.751328 13133 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:21:04.756175 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.756585 13128 raft_consensus.cc:1240] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:04.784744 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.781541 13279 rpcz_store.cc:276] 0709 12:21:03.371563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.371708 (+   145us) service_pool.cc:224] Handling call
0709 12:21:03.372026 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:03.583181 (+211155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.583230 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:03.584075 (+   845us) log.cc:844] Serialized 52 byte log entry
0709 12:21:03.858249 (+274174us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:03.858289 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.858361 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.739324 (+880963us) raft_consensus.cc:1685] finished
0709 12:21:04.739373 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.742574 (+  3201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59999,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":427210,"threads_started":2,"wal-append.queue_time_us":435749}
I20260709 12:21:04.786105 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:04.786206 18601 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:04.787029 18412 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:04.692456 18399 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.791293 13284 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:04.793742 18399 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.729516 18529 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:04.805536 18049 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.805668 13210 raft_consensus.cc:3060] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:04.806699 18277 consensus_meta.cc:287] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.000s
I20260709 12:21:04.807327 18645 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.808090 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:04.808712 18358 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:04.809144 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.809296 18358 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:04.807356 13284 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:04.748000 18462 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:04.813457 18462 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:04.815811 13207 raft_consensus.cc:2410] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:21:04.816465 18307 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:04.820803 18410 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:04.821036 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:04.821606 18594 log.cc:927] Time spent T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 1.390s	user 0.002s	sys 0.007s
I20260709 12:21:04.822324 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.822944 13284 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:21:04.823299 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1330) took 1157 ms. Trace:
I20260709 12:21:04.823764 13886 rpcz_store.cc:276] 0709 12:21:03.666442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.666924 (+   482us) service_pool.cc:224] Handling call
0709 12:21:03.685291 (+ 18367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:03.698221 (+ 12930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.698507 (+   286us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:03.747325 (+ 48818us) log.cc:844] Serialized 52 byte log entry
0709 12:21:03.994191 (+246866us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:03.994228 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.994288 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.823050 (+828762us) raft_consensus.cc:1685] finished
0709 12:21:04.823073 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.823234 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29600,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8617,"thread_start_us":176766,"threads_started":1,"wal-append.queue_time_us":333918}
I20260709 12:21:04.821625 18493 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:21:04.827316 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:04.828260 18268 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.762897 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 1116) took 1313 ms. Trace:
I20260709 12:21:04.828963 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 1018) took 1572 ms. Trace:
I20260709 12:21:04.829109 13211 rpcz_store.cc:276] 0709 12:21:03.449441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.450627 (+  1186us) service_pool.cc:224] Handling call
0709 12:21:03.460918 (+ 10291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:03.565998 (+105080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.566053 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:03.566707 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 12:21:03.878311 (+311604us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:03.878348 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.878419 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.762703 (+884284us) raft_consensus.cc:1685] finished
0709 12:21:04.762721 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.762839 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64702,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":316999,"threads_started":2,"wal-append.queue_time_us":443669}
I20260709 12:21:04.830389 18268 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.831670 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.834420 13211 raft_consensus.cc:1275] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:04.766258 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.731709 13137 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:04.711408 18607 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:04.701027 18599 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.735973 18456 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:21:04.747001 13280 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.003s	sys 0.010s
I20260709 12:21:04.853303 13284 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:04.718713 18593 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:04.758370 13129 raft_consensus.cc:1275] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:04.785290 18404 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:04.785213 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:21:04.830747 18623 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.658s	user 0.001s	sys 0.000s
I20260709 12:21:04.761003 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2476) took 1074 ms. Trace:
I20260709 12:21:04.863902 13285 rpcz_store.cc:276] 0709 12:21:03.686603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.686968 (+   365us) service_pool.cc:224] Handling call
0709 12:21:03.687345 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:03.687770 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.687797 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:03.692980 (+  5183us) log.cc:844] Serialized 26 byte log entry
0709 12:21:03.947020 (+254040us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:03.947064 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.947139 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.760770 (+813631us) raft_consensus.cc:1685] finished
0709 12:21:04.760789 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.760933 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4280,"raft.queue_time_us":151,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7830,"thread_start_us":227160,"threads_started":1,"wal-append.queue_time_us":385123}
I20260709 12:21:04.790007 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.787588 13279 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:04.809556 18645 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.764501 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:04.839002 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.839015 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.871032 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.871523 13137 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:04.718922 18596 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.719337 18643 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.878646 18643 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:04.881574 18599 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:04.847971 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.829491 13131 rpcz_store.cc:276] 0709 12:21:03.257135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.257287 (+   152us) service_pool.cc:224] Handling call
0709 12:21:03.257663 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:03.258042 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.258074 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:03.258578 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:21:03.333383 (+ 74805us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:03.333440 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.333531 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.820993 (+1487462us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:21:04.828625 (+  7632us) raft_consensus.cc:1685] finished
0709 12:21:04.828651 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.828893 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4781,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3042,"spinlock_wait_cycles":16554752,"thread_start_us":74390,"threads_started":1,"wal-append.queue_time_us":137590}
I20260709 12:21:04.763504 18443 raft_consensus.cc:2804] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:04.853529 18600 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:04.857838 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:04.858213 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:04.894593 13882 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
W20260709 12:21:04.756641 18440 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.009s
I20260709 12:21:04.859398 13203 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:04.547108 18367 consensus_queue.cc:260] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:04.861183 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:04.861651 13280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3226) took 1490 ms. Trace:
I20260709 12:21:04.864740 13204 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:21:04.903154 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.776458 18324 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:04.776819 18499 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:04.781428 18474 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:04.867125 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:04.875732 13212 raft_consensus.cc:2393] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:04.884238 18456 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.810617 18358 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.857522 18049 consensus_queue.cc:1048] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:21:04.923110 13175 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:21:04.886929 18612 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.982s	user 0.002s	sys 0.000s
W20260709 12:21:04.841459 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 252415us
I20260709 12:21:04.891321 13209 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:04.926837 18358 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:04.735105 18606 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:04.927445 18456 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:04.929495 18606 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:04.895115 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.930509 18583 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:04.872283 18462 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:04.790848 18412 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.931708 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:04.932726 18599 consensus_queue.cc:1059] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:04.933108 18412 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:04.933545 18599 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:04.902365 13280 rpcz_store.cc:276] 0709 12:21:03.371241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.371408 (+   167us) service_pool.cc:224] Handling call
0709 12:21:03.403657 (+ 32249us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:03.469137 (+ 65480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.469195 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:03.469897 (+   702us) log.cc:844] Serialized 52 byte log entry
0709 12:21:03.750681 (+280784us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:04.211306 (+460625us) log.cc:844] Serialized 14 byte log entry
0709 12:21:04.853875 (+642569us) log.cc:844] Serialized 14 byte log entry
0709 12:21:04.861110 (+  7235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.861185 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.861417 (+   232us) raft_consensus.cc:1685] finished
0709 12:21:04.861432 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.861594 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26737,"prepare.queue_time_us":136788,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":31707,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":16465,"thread_start_us":1305646,"threads_started":4,"wal-append.queue_time_us":299301}
I20260709 12:21:04.906476 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.934374 18631 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:04.934722 13279 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:04.913295 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:04.934953 18631 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.935818 13884 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:04.911414 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:04.936682 18410 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.937314 18631 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:04.914772 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:04.937265 18410 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.888127 18596 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:04.897285 18440 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.005s	sys 0.009s
I20260709 12:21:04.929236 18643 consensus_queue.cc:1059] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:04.939368 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:04.940280 13282 raft_consensus.cc:2393] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:04.940169 18643 raft_consensus.cc:3055] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:04.940780 18643 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:04.889679 18607 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:04.941773 18643 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.925189 18474 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.943049 18643 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:04.934842 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:04.944502 18474 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.908012 18598 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:04.945075 18600 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:04.945538 18410 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:04.945922 18598 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:04.947937 18598 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:04.940418 13206 raft_consensus.cc:2393] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:04.948501 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.949179 13280 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:21:04.950209 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:04.951486 18367 raft_consensus.cc:3060] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:04.958180 18593 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:04.900848 18443 raft_consensus.cc:697] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:04.959878 18443 consensus_queue.cc:237] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:04.966454 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.967140 13207 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:21:04.969290 13203 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
W20260709 12:21:04.982350 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 47607.2us
I20260709 12:21:04.992581 13841 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:04.975365 13177 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:04.986589 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 63587.9us
I20260709 12:21:04.995106 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:04.997186 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:04.998227 13203 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:05.000604 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:05.002791 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:05.004571 13177 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:04.934835 18599 raft_consensus.cc:3055] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:21:04.977778 18379 consensus_meta.cc:287] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 1.240s	user 0.012s	sys 0.004s
I20260709 12:21:05.007238 13210 raft_consensus.cc:2468] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:05.044176 13210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 2023) took 1054 ms. Trace:
I20260709 12:21:05.002770 13175 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:04.921753 17796 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.978026 18466 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:05.050071 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 47389.7us
I20260709 12:21:05.049065 13210 rpcz_store.cc:276] 0709 12:21:03.989851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.989975 (+   124us) service_pool.cc:224] Handling call
0709 12:21:04.805126 (+815151us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b58006869d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4de90aa 00007f70f4e6b447 00007f70f4e83fe7 00007f70f4e857de 00007f70f4e9127c 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c
0709 12:21:05.044097 (+238971us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284746496}
I20260709 12:21:05.051717 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:05.052892 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.060552 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:05.007464 18606 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:05.008104 18404 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:05.062338 13207 raft_consensus.cc:1240] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:05.062381 13252 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:05.066704 13177 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:05.063969 13210 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:21:05.006385 18598 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:05.006181 18412 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:21:05.049940 18363 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
W20260709 12:21:05.069085 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 76606us
I20260709 12:21:05.007792 18462 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:05.122503 13252 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:04.972790 18382 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.047410 18599 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:21:05.124800 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 58181.8us
I20260709 12:21:05.050498 18277 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:05.009476 18542 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:05.061932 18268 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:05.066524 18435 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:21:05.157760 13840 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 2.286s (SENT) [suppressed 10 similar messages]
I20260709 12:21:05.174727 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:05.183156 13203 raft_consensus.cc:1240] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:05.184463 13212 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:05.185245 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:05.186095 13207 raft_consensus.cc:2410] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:21:05.179488 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 58300.3us
I20260709 12:21:05.065171 18650 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:05.193928 18435 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.194589 18435 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:05.194402 18650 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:05.179926 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.175740 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 122558us
W20260709 12:21:05.192740 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.074200 18474 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.048682 18379 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.198148 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:05.128616 18049 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:05.069839 18598 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:05.074755 18468 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:05.126613 18649 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:05.203209 13879 raft_consensus.cc:3055] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:05.231693 13879 raft_consensus.cc:740] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:05.204623 18139 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:05.205058 18650 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:05.206800 18455 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.202735 18499 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:05.202581 18546 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.209489 18399 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:05.064244 17796 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:05.203462 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:05.216250 13881 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:05.247355 13286 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 15: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:05.221048 13207 raft_consensus.cc:1240] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:05.176515 18593 raft_consensus.cc:2804] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:05.177738 18542 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.222577 18435 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.188166 18410 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:05.241832 13250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.252758 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 480090us
I20260709 12:21:05.188553 18606 consensus_queue.cc:1048] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:21:05.231806 18598 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:05.276326 13133 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:21:05.260023 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:05.297082 13132 raft_consensus.cc:2393] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:05.293381 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:05.295080 13882 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:05.267982 13879 consensus_queue.cc:260] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.300802 13879 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:05.305975 13249 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:05.298424 13884 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.311235 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:05.313122 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:05.236398 18049 raft_consensus.cc:697] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:05.319577 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:05.227248 18474 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:05.291706 18542 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:05.345225 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:05.294335 18593 raft_consensus.cc:697] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:05.316706 18443 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:05.320526 18307 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:05.349752 13881 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:21:05.363395 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 996) took 1019 ms. Trace:
I20260709 12:21:05.363919 13881 rpcz_store.cc:276] 0709 12:21:04.343652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.343817 (+   165us) service_pool.cc:224] Handling call
0709 12:21:05.215886 (+872069us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b58006f26d0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4de90aa 00007f70f4e6b447 00007f70f4e83fe7 00007f70f4e857de 00007f70f4e9127c 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c
0709 12:21:05.363311 (+147425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812301696}
I20260709 12:21:05.246559 18139 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.250463 18455 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:05.315061 18645 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:05.352415 13205 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:05.250358 18499 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:05.353866 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 179230us
I20260709 12:21:05.320883 18652 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:05.269186 18546 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.314581 18410 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.340759 18149 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:05.376770 13205 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:05.374136 13177 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:05.329118 18468 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:21:05.381420 13886 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 16. Current term is 17. Ops: []
W20260709 12:21:05.381256 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 223544us
W20260709 12:21:05.397750 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.360307 18529 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:05.394268 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:05.380019 18443 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:05.412006 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:05.417374 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:05.418246 13881 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:21:05.402068 18462 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:05.429633 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.430364 18139 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:05.433394 18324 consensus_meta.cc:287] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.000s
W20260709 12:21:05.439208 18664 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:21:05.439957 18658 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:21:05.493146 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:05.440289 18382 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:05.522797 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.440653 18593 consensus_queue.cc:237] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:05.402273 18669 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:05.442536 18499 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:05.443171 18379 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:05.517406 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 102290us
I20260709 12:21:05.428362 18564 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:05.397411 18149 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.418977 18597 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:21:05.494534 18456 consensus_meta.cc:287] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.002s
I20260709 12:21:05.552450 13204 raft_consensus.cc:1240] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 14. Current term is 15. Ops: []
W20260709 12:21:05.637284 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 292138us
I20260709 12:21:05.639314 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:05.639984 13280 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:21:05.640146 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:05.566733 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.642761 18358 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.524825 18324 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:21:05.647897 18647 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:21:05.648746 18668 log.cc:927] Time spent T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:21:05.551738 18564 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.807145 18564 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:05.552395 18669 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:05.715804 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.733260 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 314430us
W20260709 12:21:05.778905 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.646405 18382 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:05.815198 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:05.819556 13879 consensus_meta.cc:287] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.006s
I20260709 12:21:05.820037 13879 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
W20260709 12:21:05.798802 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 158714us
I20260709 12:21:05.650430 18671 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:05.803694 13280 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:05.821709 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:05.824007 13177 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:05.824361 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:05.396432 18049 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.804740 18358 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.831753 13249 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:05.844481 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:05.801229 18456 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:05.852736 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:05.853354 13211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.009s	sys 0.011s
W20260709 12:21:05.855974 13211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.009s	sys 0.011s
I20260709 12:21:05.832461 18466 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:05.800927 18412 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:05.866384 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:05.867528 13211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 2030) took 1279 ms. Trace:
I20260709 12:21:05.871642 13211 rpcz_store.cc:276] 0709 12:21:04.588323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.835231 (+246908us) service_pool.cc:224] Handling call
0709 12:21:04.837415 (+  2184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:04.837877 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:05.229107 (+391230us) log.cc:844] Serialized 14 byte log entry
0709 12:21:05.867058 (+637951us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:05.867130 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:05.867198 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:05.867284 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:05.867420 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40717,"prepare.queue_time_us":361710,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":12877,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":7332,"thread_start_us":999630,"threads_started":2}
I20260709 12:21:05.871974 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:05.878039 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:05.881314 13284 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 12:21:05.881723 13284 pending_rounds.cc:85] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 5
I20260709 12:21:05.881621 13132 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:05.882174 13284 pending_rounds.cc:107] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:21:05.882470 13284 raft_consensus.cc:2889] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.838186 18499 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:05.833067 18379 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:05.839869 18645 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:05.813156 18324 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:05.836862 18671 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:21:05.894199 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.901919 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:05.909562 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:05.872885 17796 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:05.916715 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:05.922230 18410 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:05.923352 18542 consensus_meta.cc:287] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.004s
I20260709 12:21:05.887276 18466 raft_consensus.cc:697] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:05.925109 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46536 (request call id 2024) took 1934 ms. Trace:
I20260709 12:21:05.925608 13206 rpcz_store.cc:276] 0709 12:21:03.990239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.990846 (+   607us) service_pool.cc:224] Handling call
0709 12:21:05.924850 (+1934004us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54001c4654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:05.925025 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2119565184}
I20260709 12:21:05.915663 18645 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:05.827622 18382 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.923833 18542 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.904114 18499 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:05.903811 18671 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:05.884824 18412 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.924491 18466 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:05.979933 18669 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:05.981181 18499 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:05.941432 18542 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:05.945230 18677 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.167s	user 0.000s	sys 0.009s
W20260709 12:21:05.948155 18675 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:21:05.942691 18149 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:05.957880 18382 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:06.010792 18679 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:21:05.989331 18324 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:05.958467 18673 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:21:06.033617 18435 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.044381 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.046959 13100 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:06.048367 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.049300 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:06.028878 18598 consensus_meta.cc:287] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.010s
W20260709 12:21:06.067342 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.074422 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.075280 13129 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:06.018767 18645 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.090197 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:06.072085 18358 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.060474 18616 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.067577 18598 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.067523 18149 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:06.096535 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.096988 13884 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:06.094328 18616 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.099803 18583 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:06.101400 18583 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.101747 18583 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:06.102455 13882 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:06.080606 18382 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:06.108229 13880 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:06.111287 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:06.072355 18684 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:21:06.115525 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:06.104946 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.105474 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.116528 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.113426 13209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 1122) took 1541 ms. Trace:
I20260709 12:21:06.117317 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.118134 13887 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:06.117362 13209 rpcz_store.cc:276] 0709 12:21:04.572070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.577909 (+  5839us) service_pool.cc:224] Handling call
0709 12:21:04.578208 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:04.926744 (+348536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.113144 (+1186400us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540032d7d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:06.113325 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713227136}
I20260709 12:21:06.117288 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:06.105077 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.104516 18149 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:06.123196 13135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1777) took 1704 ms. Trace:
I20260709 12:21:06.123785 13135 rpcz_store.cc:276] 0709 12:21:04.418615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.418790 (+   175us) service_pool.cc:224] Handling call
0709 12:21:04.419250 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:05.637596 (+1218346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:05.637652 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:05.637700 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:05.637737 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.122915 (+485178us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400136ad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:06.122959 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.123116 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":645,"raft.queue_time_us":73785,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":21321,"spinlock_wait_cycles":2350936960,"thread_start_us":121790,"threads_started":1}
I20260709 12:21:06.126691 18455 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:06.128949 13249 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:06.130657 18652 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.131120 18652 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.132301 18678 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:06.133054 18678 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:06.133652 13204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3307) took 1541 ms. Trace:
I20260709 12:21:06.134173 18440 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:06.134862 13103 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.396s	user 0.000s	sys 0.035s
I20260709 12:21:06.134689 18440 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:06.135493 13103 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.397s	user 0.000s	sys 0.035s
W20260709 12:21:06.135861 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 1.39725e+06us
I20260709 12:21:06.134008 13204 rpcz_store.cc:276] 0709 12:21:04.592543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.215701 (+623158us) service_pool.cc:224] Handling call
0709 12:21:05.215959 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:05.639349 (+423390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.133404 (+494055us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54000730d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:06.133573 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773441920}
I20260709 12:21:06.141400 18412 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:06.140622 13249 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:06.143810 18049 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:06.143946 18686 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:21:06.148483 13249 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:06.150040 18049 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:06.150568 18049 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:06.151731 18049 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.155342 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 2037) took 1096 ms. Trace:
I20260709 12:21:06.155800 13205 rpcz_store.cc:276] 0709 12:21:05.059016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.413364 (+354348us) service_pool.cc:224] Handling call
0709 12:21:05.413694 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:05.456855 (+ 43161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:05.456904 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:05.525213 (+ 68309us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.029203 (+503990us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:06.029265 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.029363 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.155084 (+125721us) raft_consensus.cc:1685] finished
0709 12:21:06.155114 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.155278 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51018,"raft.queue_time_us":42861,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":31062,"thread_start_us":226609,"threads_started":1,"wal-append.queue_time_us":573428}
I20260709 12:21:06.158170 18598 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:06.158454 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.164547 13205 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:06.165477 18215 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.166015 18215 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.166564 18542 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.110036 18382 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.167235 18542 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.168035 18215 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:06.169126 18382 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:06.169489 18542 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.172333 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.173134 13209 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:21:06.170818 18600 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:06.174968 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.175333 18600 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.177376 18616 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:06.178409 18370 raft_consensus.cc:2955] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Committing config change with OpId 10.8: config changed from index 2 to 8, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:06.179064 18600 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.206923 18652 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:06.215330 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 72908.6us
W20260709 12:21:06.226907 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.230938 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.232374 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.233505 13128 raft_consensus.cc:2410] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:21:06.234625 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:06.234834 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.235458 13129 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:21:06.238090 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.226105 18440 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:06.235478 13133 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:21:06.223544 18564 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.246212 13879 raft_consensus.cc:2368] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14.
I20260709 12:21:06.248371 18652 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:06.248761 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.248966 18652 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.252282 18382 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:06.252844 18382 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.256351 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:06.225950 18149 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.272460 13879 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:06.285954 13284 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:06.240000 18685 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:06.300096 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.242439 18049 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.301282 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:06.308658 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.314824 18678 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:21:06.318989 18682 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.514s	user 0.001s	sys 0.001s
I20260709 12:21:06.319185 18678 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.305459 18499 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:21:06.336841 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.339291 18246 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:06.340916 18601 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:06.341588 18601 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.342418 18246 consensus_queue.cc:1059] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:06.343998 18455 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:06.344403 18601 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:06.344478 18455 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:06.345723 18455 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.313220 18407 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:06.312588 18645 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:06.300385 18536 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:21:06.313565 18454 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:06.312609 18688 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:06.356456 18678 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.321857 18382 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.361126 18652 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.364176 18688 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.365309 18683 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:06.371397 18683 consensus_queue.cc:1059] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:06.372447 18669 raft_consensus.cc:3055] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:06.372833 18669 raft_consensus.cc:740] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:06.373644 18669 consensus_queue.cc:260] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.374424 18474 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:06.375124 18669 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:06.349488 18671 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.304620 18685 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.381563 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.381742 18466 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.382236 18466 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.383366 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.354346 18645 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.384222 18466 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.332320 18564 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:06.384444 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:06.349821 18499 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.385416 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:06.385821 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.386439 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.386929 18499 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.388518 18600 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:06.389067 18600 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.391039 18600 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.353482 18367 consensus_queue.cc:1059] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:21:06.391768 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.389549 13103 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:06.392499 13128 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:06.392880 18367 raft_consensus.cc:3055] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:06.393285 18367 raft_consensus.cc:740] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:06.394017 18367 consensus_queue.cc:260] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.395756 18367 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:06.384665 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.398397 13134 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:21:06.398397 13208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36412 (request call id 1125) took 1811 ms. Trace:
I20260709 12:21:06.393035 13103 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:06.402704 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.403294 13882 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:06.386432 13135 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:06.406176 18399 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:06.406724 18399 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.407697 18645 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:06.408269 18542 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:06.383385 18685 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.409173 18399 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.408785 18542 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.409361 18546 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.410180 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:06.411271 13841 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:06.381603 18671 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.401988 13208 rpcz_store.cc:276] 0709 12:21:04.587479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.589441 (+  1962us) service_pool.cc:224] Handling call
0709 12:21:04.589724 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:04.794956 (+205232us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:06.005800 (+1210844us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b1800426dc0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f4a354bc 00007f70f1d8348b 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9d455 00007f70f88853c7 00007f70f4e979a7 00007f70f4ea70bf
0709 12:21:06.005962 (+   162us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.252749 (+246787us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:21:06.306134 (+ 53385us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.306357 (+   223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:06.306403 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:06.306454 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.397026 (+ 90572us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b1800426dc0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d6e2a6 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419
0709 12:21:06.398176 (+  1150us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54002a2bd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:06.398215 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.398334 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":582768,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":301,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":2730,"spinlock_wait_cycles":584842880,"thread_start_us":676541,"threads_started":3,"wal-append.queue_time_us":207537}
I20260709 12:21:06.412046 13100 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:06.311172 18049 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.411836 18139 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:06.413276 18579 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:06.432813 18579 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.433243 18579 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:06.413856 18455 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:06.436108 18678 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.436669 18678 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.438956 18678 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.439865 18537 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:06.441048 18537 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.441463 18537 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.404479 18499 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:06.412786 18536 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:21:06.428932 18493 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:06.447101 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:21:06.417398 18656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.005s	sys 0.011s
I20260709 12:21:06.456348 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:06.458222 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:06.464660 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.465965 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.467706 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.429471 18474 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:06.411401 18542 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.470893 13175 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:06.471511 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.472235 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.472450 13212 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:06.473616 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:06.474625 18529 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:06.474892 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:06.475656 18529 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:06.476011 18529 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:06.476368 18529 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:06.415889 18465 consensus_queue.cc:1059] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 12:21:06.458479 18656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.005s	sys 0.011s
I20260709 12:21:06.413739 18246 consensus_queue.cc:1059] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:21:06.454356 18493 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:06.486039 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.486806 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.484330 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.509907 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.489007 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:06.489703 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.484567 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.512769 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:06.513473 13210 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:06.494792 13212 raft_consensus.cc:1240] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:06.514520 18593 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:06.515215 18593 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.518399 18593 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.518986 18600 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:06.519948 18246 raft_consensus.cc:3055] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:06.520380 18246 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:06.520978 18688 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:06.521291 18246 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.522959 18049 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:06.444397 18499 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.525017 18499 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.487175 18645 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:21:06.442669 18583 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.526593 18139 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.469856 18546 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:06.483592 18474 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.532125 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.540969 13135 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:06.527729 18537 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:06.532500 13209 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:06.527226 18139 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:06.561003 13249 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:06.564513 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.490146 18462 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.567692 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.567407 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.549896 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.569259 13133 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:21:06.539549 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.487272 18383 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:06.565958 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.469153 18149 consensus_queue.cc:1059] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:21:06.568676 13207 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:06.483336 18652 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:06.570346 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.598764 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.597671 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.541512 18246 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:06.601156 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.491582 18542 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:21:06.603739 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.604311 13209 raft_consensus.cc:1275] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:21:06.601801 13207 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:06.527894 18600 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.551127 18474 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:06.605878 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.545172 18583 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:06.647868 13207 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:06.567394 18643 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:06.648428 13209 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:06.483057 18529 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.596165 18499 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:21:06.663185 13286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42730 (request call id 1111) took 2699 ms (client timeout 2286 ms). Trace:
W20260709 12:21:06.747956 13286 rpcz_store.cc:269] 0709 12:21:03.964192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.044330 (+ 80138us) service_pool.cc:224] Handling call
0709 12:21:06.662943 (+2618613us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540029dbd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:06.663081 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2738324352}
W20260709 12:21:06.677865 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.598037 18383 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.603797 18149 consensus_queue.cc:1243] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:21:06.511199 18370 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:21:06.701862 13212 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:21:06.761031 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:06.761665 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.762094 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.596611 18462 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.761706 13212 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
W20260709 12:21:06.744884 18718 log.cc:927] Time spent T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.002s
I20260709 12:21:06.754317 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.766736 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:06.742424 18717 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.082s	user 0.000s	sys 0.003s
I20260709 12:21:06.742343 18600 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:06.747689 18499 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.770354 13212 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:21:06.776646 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.776795 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.773953 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.753352 18383 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:06.777686 13132 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:06.778553 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.779064 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:06.780652 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:06.781410 18363 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:06.782361 13133 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:21:06.781917 18363 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.784655 18363 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.785185 18363 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:06.775278 18499 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:06.785590 18529 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:06.787106 18363 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.787600 18363 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:06.794659 18363 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.796139 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:06.796942 18363 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.797466 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.798563 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:06.799264 13207 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:06.799708 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:06.800634 18720 log.cc:927] Time spent T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:21:06.800868 18462 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:06.801499 13210 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 17.
I20260709 12:21:06.778502 13209 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:21:06.803946 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:06.804831 18499 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.786562 13838 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:06.779086 13252 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:06.779175 13132 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 10.
I20260709 12:21:06.814888 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:06.817617 13137 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:06.819281 18542 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:21:06.785631 18680 log.cc:927] Time spent T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.863s	user 0.004s	sys 0.000s
I20260709 12:21:06.820513 13207 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:06.824735 13841 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:06.821112 13249 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:06.825728 18382 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:06.822544 13252 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:06.822835 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:06.826974 18382 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:06.827128 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:06.827915 18382 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:06.828333 13252 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:06.826293 13249 leader_election.cc:400] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14.
I20260709 12:21:06.829403 13249 leader_election.cc:403] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:06.826956 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.830549 18410 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.831015 18410 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.833148 18410 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:06.834630 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:06.835372 13881 raft_consensus.cc:2393] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:06.835819 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:06.837311 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.837534 18579 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:06.837612 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:06.839017 18382 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:06.839479 18412 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:06.840312 13881 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:06.840799 18529 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14.
I20260709 12:21:06.841210 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.840018 18382 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:06.841614 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.842746 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.843603 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.844121 13884 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:06.845321 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:06.846035 13884 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 15: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:06.845901 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.846505 18601 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:06.846976 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.817119 18583 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:06.849957 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.851233 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.839406 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.852450 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.853044 13883 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 15: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:06.852443 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.854215 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.854816 13882 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:06.857576 13841 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:06.853803 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.859903 13883 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:21:06.863126 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.866073 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.867837 18412 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:06.869230 18579 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:06.869282 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:06.867882 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.871111 18579 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:06.875032 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:06.873433 18583 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:06.867857 18410 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:21:06.893069 18499 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:06.897455 18583 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:06.898214 18579 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:06.898479 18600 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.937853 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:06.941396 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:06.944169 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:06.945138 13137 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:21:06.946899 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:06.948971 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:06.953577 13209 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:06.961598 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:21:06.939105 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.940233 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2354) took 1679 ms. Trace:
I20260709 12:21:06.963743 13130 rpcz_store.cc:276] 0709 12:21:05.262151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.263041 (+   890us) service_pool.cc:224] Handling call
0709 12:21:05.263505 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:05.351499 (+ 87994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:05.351536 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:05.365786 (+ 14250us) log.cc:844] Serialized 26 byte log entry
0709 12:21:05.523706 (+157920us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:05.523748 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.267949 (+744201us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b5400137ed4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:06.268013 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.785101 (+517088us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:21:06.939675 (+154574us) raft_consensus.cc:1685] finished
0709 12:21:06.939721 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.939997 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2571,"raft.queue_time_us":639,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":10387,"spinlock_wait_cycles":229131904,"thread_start_us":157589,"threads_started":1,"wal-append.queue_time_us":556386}
I20260709 12:21:06.973780 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:06.980448 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:06.985773 18399 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:06.986209 18215 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:06.987352 18215 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:06.988340 18399 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:06.990070 18215 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:06.995018 18139 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.997990 18139 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:07.033030 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 206736us
I20260709 12:21:07.036918 18727 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:07.040396 18727 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:06.890329 18474 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.046972 18474 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:07.048089 13136 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:07.043170 18727 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:07.040424 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:07.062937 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:07.070166 13886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 947) took 2230 ms. Trace:
W20260709 12:21:07.072963 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 244543us
I20260709 12:21:07.077873 18410 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.078811 18410 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.079692 18600 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.070694 13886 rpcz_store.cc:276] 0709 12:21:04.839758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.840693 (+   935us) service_pool.cc:224] Handling call
0709 12:21:04.840995 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:05.402383 (+561388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.069487 (+1667104us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54007517d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:07.069862 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242365312}
I20260709 12:21:07.079249 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.093845 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2508) took 1227 ms. Trace:
I20260709 12:21:07.094460 13282 rpcz_store.cc:276] 0709 12:21:05.866008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.866169 (+   161us) service_pool.cc:224] Handling call
0709 12:21:07.093310 (+1227141us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54002297d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:07.093589 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779891968}
W20260709 12:21:07.098526 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 58271.7us
I20260709 12:21:07.101424 18671 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:07.102561 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.103139 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.103720 18435 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.104393 18407 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:07.104943 18407 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.105419 18215 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.106153 18215 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.106930 18363 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:07.107415 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:07.107714 18363 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.108489 13211 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:07.110235 13204 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:07.110622 18363 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.111811 18466 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:07.112922 13885 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:07.112663 18466 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.116660 13210 raft_consensus.cc:1217] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Deduplicated request from leader. Original: 11.9->[13.10-15.11]   Dedup: 13.10->[15.11-15.11]
I20260709 12:21:07.117436 13210 raft_consensus.cc:1240] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 15. Current term is 16. Ops: [13.10-15.11]
I20260709 12:21:07.118968 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:07.119997 13204 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:21:07.120136 18215 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.122750 18577 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.125455 18466 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.125232 18577 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.128741 18577 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.129709 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:07.104529 18435 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.094942 13103 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:07.135593 13130 raft_consensus.cc:2393] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:07.118592 18493 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.141162 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:07.143792 18727 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:07.143999 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.144868 18727 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.146354 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:07.147471 18382 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:21:07.148700 13102 connection.cc:256] RPC call timeout handler was delayed by -1.6529996829999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 12:21:07.149718 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.150135 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.150665 13284 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:07.150925 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:07.152132 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:07.152853 18529 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:07.154706 18645 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:21:07.155527 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 67658.9us
I20260709 12:21:07.131264 18643 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:07.111250 18363 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.156587 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.166996 13286 raft_consensus.cc:2393] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 14: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:07.157933 13280 raft_consensus.cc:1240] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:07.157783 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:07.158782 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 63994.8us
I20260709 12:21:07.159010 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.159633 18493 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:07.160534 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:07.170612 13278 raft_consensus.cc:2410] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:21:07.168525 13277 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:07.148394 18382 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.148412 13283 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:07.152160 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.170428 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.171334 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.161119 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.176704 13137 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:07.181545 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.170228 18643 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:07.183466 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 44454.5us
I20260709 12:21:07.189039 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.190160 13279 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:07.184592 18577 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:07.170140 18363 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.203357 13284 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:21:07.190877 18727 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:07.191990 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.203358 18669 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:07.210731 18382 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:07.219552 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.222026 18599 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.185290 18645 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.229981 18645 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:07.230752 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:07.234256 18499 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:21:07.235707 18652 consensus_queue.cc:1048] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:07.236831 18728 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:07.237766 18728 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:07.238971 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.241333 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:07.247709 13285 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:21:07.231060 18536 raft_consensus.cc:3055] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:07.202901 18577 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:07.260501 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:07.262660 13280 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:21:07.247769 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.252530 18536 raft_consensus.cc:740] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:07.264390 18577 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.271826 18727 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:07.280292 18727 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.280735 18727 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:07.282424 18435 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:07.287701 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 136947us
I20260709 12:21:07.290136 13102 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:07.287801 18643 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.293722 18537 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:07.296584 18643 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:07.296377 18454 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:07.202054 18529 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.296921 18363 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.299360 18363 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:07.300064 18363 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.301090 18529 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:07.302224 18363 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.305507 18678 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:07.312525 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 45724.8us
I20260709 12:21:07.315222 18616 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:07.317883 18557 raft_consensus.cc:3055] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:07.318500 18557 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:07.320520 18536 consensus_queue.cc:260] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.322513 18536 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:07.328141 18383 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.330533 18383 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.330708 13207 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:07.274070 13137 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:21:07.268270 18466 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:21:07.338315 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 72075.5us
I20260709 12:21:07.343199 18557 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.344235 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.349016 13252 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:07.354509 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:07.368891 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:07.369197 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:07.363631 18645 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:07.363996 18466 raft_consensus.cc:697] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:07.350195 18529 consensus_queue.cc:1059] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:21:07.375028 18557 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:07.392104 13887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1347) took 1183 ms. Trace:
I20260709 12:21:07.392589 13887 rpcz_store.cc:276] 0709 12:21:06.208557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.208718 (+   161us) service_pool.cc:224] Handling call
0709 12:21:06.221674 (+ 12956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:06.224779 (+  3105us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:06.239839 (+ 15060us) log.cc:844] Serialized 14 byte log entry
0709 12:21:07.068639 (+828800us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b18001447c0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d23a 00007f70f4e97a2a
0709 12:21:07.278363 (+209724us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.279197 (+   834us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.279465 (+   268us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:07.279503 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.279603 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:07.391590 (+111987us) raft_consensus.cc:1685] finished
0709 12:21:07.391715 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:07.391889 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12367,"prepare.queue_time_us":16612,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":19776,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":2664,"spinlock_wait_cycles":7542528,"thread_start_us":187665,"threads_started":1,"wal-append.queue_time_us":1113361}
I20260709 12:21:07.382377 13884 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:07.382512 13252 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:07.385830 18601 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:07.396339 18601 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.396840 18601 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.398047 13277 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:07.398859 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.386813 13102 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:07.400571 13284 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 12:21:07.401069 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:07.401628 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.402307 13281 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:07.377344 18645 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:07.388089 13841 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:07.388761 18728 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:07.404281 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:07.389490 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 112144us
I20260709 12:21:07.404951 18466 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.406365 13249 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:07.403788 18645 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:07.379101 18454 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:07.407648 18474 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:07.410240 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:07.410893 13204 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:21:07.412528 13208 raft_consensus.cc:1240] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:07.417024 18593 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:07.418397 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48629.2us
I20260709 12:21:07.419188 13252 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:07.418888 18407 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.420462 13840 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:07.422080 13252 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:07.422473 18546 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:07.422931 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:07.424100 18307 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:07.424502 18307 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.424767 18651 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:07.424786 18601 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.427052 18474 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:07.427798 18601 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:07.424880 18307 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.436089 18474 consensus_queue.cc:1059] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:07.438575 18579 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.439285 13885 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:07.439277 18579 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:07.458146 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 51850.7us
I20260709 12:21:07.487730 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:07.426205 18651 raft_consensus.cc:2955] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 6 to 9, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:07.491158 13103 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:07.490896 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.494625 13252 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:07.515592 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 98772.2us
I20260709 12:21:07.517323 18456 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:07.517500 18579 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.517902 18456 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:07.518375 18456 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:07.518930 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:07.521450 18603 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.558346 18603 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.560907 18603 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:07.561285 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 77170.2us
I20260709 12:21:07.562077 13252 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:07.490916 18652 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:07.564245 18652 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:07.564716 18652 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.527410 18382 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:07.568004 18382 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:07.568377 18382 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.568775 18382 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:07.512185 18678 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:07.571843 18678 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.573450 13128 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:21:07.574097 18678 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:07.532275 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 109463us
I20260709 12:21:07.575225 13840 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:07.576617 13840 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:07.577702 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 57229.2us
I20260709 12:21:07.577786 13840 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:07.579718 13208 raft_consensus.cc:2955] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:07.494053 18383 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.554260 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:07.583889 18383 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.584548 13210 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 17.
I20260709 12:21:07.585551 13203 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:07.586381 18383 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:07.589959 18577 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.592111 18407 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:07.592816 18407 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.593248 18695 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:07.593384 18407 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.594141 18695 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:07.596459 18418 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:07.596849 18418 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.597177 18418 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:07.555888 13101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.600890 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.601889 13128 raft_consensus.cc:2410] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:21:07.602509 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:07.602697 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.603127 13134 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:07.600898 13841 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:07.604530 18643 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:07.604905 18643 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.605252 18643 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:07.606690 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.609448 18727 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.611584 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.612416 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.612954 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.617632 13212 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:21:07.618124 13212 pending_rounds.cc:85] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 9
I20260709 12:21:07.618472 13212 pending_rounds.cc:107] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:21:07.618933 13212 raft_consensus.cc:2889] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:07.612987 13134 raft_consensus.cc:2468] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 17.
I20260709 12:21:07.506817 18474 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:07.623967 18474 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.624384 18474 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:07.553489 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.568509 18139 consensus_queue.cc:1059] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:07.628749 18139 raft_consensus.cc:3055] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:07.629277 18139 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:07.556106 13102 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:07.635155 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 117992us
I20260709 12:21:07.654838 13175 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:07.661824 13203 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:07.662777 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:07.665457 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 102022us
W20260709 12:21:07.671669 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.630321 18139 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:07.697403 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 55928us
I20260709 12:21:07.698310 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.704015 13885 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:07.706691 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.684295 18529 raft_consensus.cc:3055] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:07.726027 13280 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:07.714260 18383 raft_consensus.cc:2804] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:07.734874 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:07.749099 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 193096us
I20260709 12:21:07.707826 18536 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:07.757164 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:07.758119 13277 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:07.694344 18499 consensus_queue.cc:1059] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:21:07.774734 18738 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:07.775512 18738 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.777979 18738 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:07.713135 18307 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.782042 18307 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.788270 18652 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.790675 18652 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:07.739809 18727 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:07.734397 18678 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:07.798286 18410 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.810199 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.735121 18529 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:07.804761 18139 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:07.813992 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:07.814692 13208 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:07.748744 18383 raft_consensus.cc:697] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:07.810956 13282 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:07.816663 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.818305 18631 raft_consensus.cc:2764] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:21:07.818607 18529 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.769747 18454 raft_consensus.cc:3055] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:07.829939 18643 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.830843 13102 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:07.831523 18149 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:07.813760 18600 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:07.834859 18652 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:07.808892 18407 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.838732 13212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46536 (request call id 2057) took 1017 ms. Trace:
I20260709 12:21:07.839375 18363 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.814309 18577 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:07.794763 18418 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.745784 18537 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:07.759596 18601 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:07.853598 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:07.857874 13208 raft_consensus.cc:2468] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:21:07.855176 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:07.880158 13212 rpcz_store.cc:276] 0709 12:21:06.821754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.824130 (+  2376us) service_pool.cc:224] Handling call
0709 12:21:06.824439 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:07.638147 (+813708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.838404 (+200257us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b54002d5d54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:07.838659 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1822698240}
W20260709 12:21:07.842092 18730 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.570s	user 0.000s	sys 0.002s
I20260709 12:21:07.843343 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:07.885088 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:07.858383 18454 raft_consensus.cc:740] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:21:07.896142 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 65392.3us
I20260709 12:21:07.892403 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.894037 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:07.858464 18499 consensus_queue.cc:1243] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:07.899025 13249 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:07.905469 13284 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:07.901422 13841 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:07.910311 18599 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:07.911687 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 46321.5us
I20260709 12:21:07.911798 18383 consensus_queue.cc:237] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.912613 18643 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.887042 18652 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.913640 13100 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:07.915421 18652 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:07.916144 18149 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:07.916713 18149 raft_consensus.cc:697] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:07.917763 18149 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.920156 13206 raft_consensus.cc:2410] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:21:07.920922 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.921684 13206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46522 (request call id 3328) took 1460 ms. Trace:
I20260709 12:21:07.922098 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:07.922236 18493 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.922825 18493 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.924397 18454 consensus_queue.cc:260] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.893265 18363 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.928267 18420 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:07.928611 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:07.928329 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:07.892266 18536 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:07.923233 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.928390 13211 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:07.931620 13285 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:07.922142 13206 rpcz_store.cc:276] 0709 12:21:06.461655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.465528 (+  3873us) service_pool.cc:224] Handling call
0709 12:21:07.921442 (+1455914us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001c3c54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:07.921608 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3238785792}
I20260709 12:21:07.929410 18420 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:07.884845 18645 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.888012 18678 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.946906 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.943969 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:07.951825 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:07.953990 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:07.954725 18367 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:07.928424 18363 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:07.941723 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:07.944658 13209 raft_consensus.cc:2393] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 16: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:07.930003 18601 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:07.958822 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:07.964746 13280 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:07.940953 18410 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:07.940676 18420 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:07.975564 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:07.978463 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 50263us
I20260709 12:21:07.979017 18412 raft_consensus.cc:2804] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:07.985213 18412 raft_consensus.cc:697] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:07.986271 18412 consensus_queue.cc:237] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.979288 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2380) took 1041 ms. Trace:
I20260709 12:21:07.987653 13132 rpcz_store.cc:276] 0709 12:21:06.938239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.939749 (+  1510us) service_pool.cc:224] Handling call
0709 12:21:06.940486 (+   737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:06.941304 (+   818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:06.941350 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:06.942446 (+  1096us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.132190 (+189744us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:07.132226 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.132287 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:07.841346 (+709059us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:21:07.978854 (+137508us) raft_consensus.cc:1685] finished
0709 12:21:07.978878 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:07.979104 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34979,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":324,"spinlock_wait_cycles":93736320,"thread_start_us":189154,"threads_started":1,"wal-append.queue_time_us":251548}
I20260709 12:21:07.959635 18499 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:07.929893 18537 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:07.993325 18537 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:07.956187 18652 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:07.996693 18601 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:07.998795 18678 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:07.987309 18420 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.000788 18420 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:07.959587 18367 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:07.994130 18652 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.016211 18529 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:08.016583 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 207817us
W20260709 12:21:08.022621 18743 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:21:08.023553 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 86744.4us
I20260709 12:21:08.030020 13177 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:08.036417 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 137480us
I20260709 12:21:08.041939 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.044714 13883 raft_consensus.cc:1240] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:21:08.048172 13285 raft_consensus.cc:2410] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:21:08.050045 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:08.050966 13885 raft_consensus.cc:2368] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12.
I20260709 12:21:08.060282 13177 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:08.042227 18652 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.056740 18363 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:08.075119 18600 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:08.053087 18139 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:08.077527 18139 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.079799 18139 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.082480 13285 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:08.084369 13278 raft_consensus.cc:1240] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:08.082538 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:08.086290 13208 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:21:08.071903 18456 consensus_meta.cc:287] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.005s
I20260709 12:21:08.096120 13102 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:08.097944 18536 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:08.098337 18536 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:08.098672 18536 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:08.099489 18683 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:08.099968 18683 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:08.101177 18683 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.102607 18727 raft_consensus.cc:3055] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:08.103664 18307 consensus_queue.cc:1059] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:08.106508 18583 raft_consensus.cc:3055] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:08.107182 18583 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:08.108631 18583 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.110483 18583 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:08.111302 18139 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.111930 18139 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:08.112337 18651 consensus_meta.cc:287] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.002s
I20260709 12:21:08.113382 13100 leader_election.cc:400] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12.
I20260709 12:21:08.113722 13100 leader_election.cc:403] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:08.114164 18139 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.114791 18370 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:08.106815 18536 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.103768 13204 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:21:08.121318 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:08.125237 13277 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:08.103046 18727 raft_consensus.cc:740] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:08.102900 18683 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:08.062659 18474 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.136402 18649 consensus_queue.cc:1059] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:21:08.137933 18649 raft_consensus.cc:3055] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:08.138406 18649 raft_consensus.cc:740] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:08.138590 18474 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.128259 13177 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:08.126664 18407 consensus_queue.cc:1059] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 12:21:08.123510 18382 consensus_meta.cc:287] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.553s	user 0.012s	sys 0.000s
I20260709 12:21:08.121047 18435 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.149660 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:08.151093 13277 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:08.118774 18652 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 12:21:08.159935 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 65935us
I20260709 12:21:08.145684 18600 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:08.148178 18542 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:08.149276 18418 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.156651 18579 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:08.152428 18601 raft_consensus.cc:476] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 12:21:08.122311 18456 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.172550 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:08.163151 18367 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:08.163537 18536 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.150143 18382 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:08.179679 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 51528.9us
I20260709 12:21:08.181394 13208 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 18.
I20260709 12:21:08.169046 18645 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.189581 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:08.189801 13283 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:21:08.190865 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:21:08.191610 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.194442 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:08.195393 13841 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:08.195715 13281 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:21:08.196424 18738 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:08.196925 18738 raft_consensus.cc:697] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:08.197990 18695 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:08.197811 18738 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.198740 18695 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 18 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:08.201503 18454 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:08.201591 18695 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:08.205214 18747 log.cc:927] Time spent T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:21:08.211735 13205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46522 (request call id 3325) took 1751 ms. Trace:
I20260709 12:21:08.191233 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.214756 13283 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:08.224045 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.219682 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.212141 13205 rpcz_store.cc:276] 0709 12:21:06.460599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.463559 (+  2960us) service_pool.cc:224] Handling call
0709 12:21:06.463939 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:06.485692 (+ 21753us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:06.539416 (+ 53724us) log.cc:844] Serialized 14 byte log entry
0709 12:21:07.431186 (+891770us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b18001a85a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d82e07 00007f70fabdd9a9 00007f70f1d9f69b 00007f70f1d9d93f 00007f70f1d9fc02 00007f70f4a2720b 00007f70f4a2cd23 00007f70f4a2d23a 00007f70f4e97a2a
0709 12:21:07.706050 (+274864us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.796531 (+ 90481us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.796765 (+   234us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:07.797087 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 12:21:07.797299 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.797414 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:08.021793 (+224379us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:21:08.188129 (+166336us) raft_consensus.cc:1685] finished
0709 12:21:08.188153 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.211552 (+ 23399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56091,"prepare.queue_time_us":65742,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":105,"raft.queue_time_us":69601,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":73755,"spinlock_wait_cycles":73403392,"thread_start_us":199951,"threads_started":1,"wal-append.queue_time_us":1317989}
I20260709 12:21:08.228150 13286 raft_consensus.cc:2393] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 18: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:08.168823 18435 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.228813 13278 raft_consensus.cc:2368] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12.
I20260709 12:21:08.182391 18651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46326 (request call id 6) took 2876 ms. Trace:
I20260709 12:21:08.235160 18435 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.237963 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:08.230829 18367 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.213081 18727 consensus_queue.cc:260] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.240530 18727 raft_consensus.cc:3060] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:08.240188 18367 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.242997 18367 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.246245 18363 raft_consensus.cc:3055] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:08.247741 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:08.254352 18456 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.256709 18382 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.257264 18645 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:08.262207 13885 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:08.275255 13102 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:08.262091 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.263023 13129 raft_consensus.cc:1240] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:08.263227 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:08.276535 13130 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
I20260709 12:21:08.276877 13886 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:08.263758 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:08.264659 13133 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:08.265424 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:08.265491 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:08.265945 18616 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.264681 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:08.155685 18649 consensus_queue.cc:260] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.281689 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:08.284650 13880 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:08.286301 13134 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:08.287237 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.289870 13129 raft_consensus.cc:1240] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:21:08.290628 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:08.291738 18139 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:08.291952 13134 raft_consensus.cc:2410] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:21:08.292213 18139 raft_consensus.cc:697] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:08.292651 13102 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:08.293071 18139 consensus_queue.cc:237] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.293807 18649 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:08.297748 18577 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:08.301136 18616 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.307216 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.307550 18435 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.307796 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:08.308109 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.308955 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:08.284333 18536 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.310482 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:08.311060 18536 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.312182 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.312808 13205 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:08.313318 18536 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.285893 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:08.315037 18367 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:08.315204 13102 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:08.316277 13132 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:08.309055 13130 raft_consensus.cc:2410] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:21:08.269970 18363 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:08.317267 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:08.326507 13205 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:08.326752 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:08.329838 13102 leader_election.cc:400] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12.
I20260709 12:21:08.335958 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:08.342430 18410 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:08.308063 18435 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.305449 18407 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:08.350256 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.315472 18367 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.349201 18435 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.274737 18412 consensus_queue.cc:1059] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
W20260709 12:21:08.352700 13136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1796) took 1883 ms (client timeout 1928 ms). Trace:
I20260709 12:21:08.355614 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.337944 18557 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:08.332137 18669 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:21:08.357283 13136 rpcz_store.cc:269] 0709 12:21:06.463029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.470534 (+  7505us) service_pool.cc:224] Handling call
0709 12:21:08.318975 (+1848441us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540027d654. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:08.346074 (+ 27099us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232000384}
I20260709 12:21:08.367055 18370 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 11. Current term is 12.
I20260709 12:21:08.367630 18493 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.368645 18363 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.369887 18363 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:08.371790 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:08.373214 13177 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:08.356890 18537 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:08.352213 18583 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:08.375828 18435 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:08.376349 18435 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:08.376201 18583 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.376827 18435 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:08.378464 18583 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.378808 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.379187 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.374485 13177 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:08.379756 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.363823 18407 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.382187 13134 raft_consensus.cc:2393] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:08.382408 13137 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:08.383087 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.383508 18407 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.380465 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.380187 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:08.381489 13133 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:08.390547 13128 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:21:08.392048 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:08.393386 13884 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:08.394914 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:08.357577 18367 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:08.392761 13887 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 17.
I20260709 12:21:08.396281 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.396699 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.400362 13279 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:08.400563 13278 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:08.401248 13879 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:08.404944 13277 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:08.401835 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.380245 18493 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:08.401530 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.405642 13281 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:08.384199 18537 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.406369 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.361056 18557 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.375716 18616 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.409392 18246 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.354981 18410 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.410765 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:21:08.422289 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 47876.4us
I20260709 12:21:08.422689 13286 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:08.422914 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.412037 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.423906 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.413904 18537 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.269212 18651 rpcz_store.cc:276] 0709 12:21:05.295844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.296001 (+   157us) service_pool.cc:224] Handling call
0709 12:21:05.351521 (+ 55520us) log.cc:844] Serialized 494 byte log entry
0709 12:21:05.953148 (+601627us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54009509a0. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e06142 00007f70f4de6eaa 00007f70f4dedd53 00007f70f4dedcd9 00007f70f4dedc69 00007f70f4dedc31 00007f70f4decdfd 0000000000388634 0000000000388479 00007f70f1da0475
0709 12:21:06.010152 (+ 57004us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:21:08.172241 (+2162089us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":269,"raft.queue_time_us":3364,"raft.run_cpu_time_us":17765,"raft.run_wall_time_us":691469,"spinlock_wait_cycles":44291840,"thread_start_us":172685,"threads_started":1,"wal-append.queue_time_us":527826,"wal-append.run_cpu_time_us":5579,"wal-append.run_wall_time_us":1383624}
I20260709 12:21:08.424746 13204 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
W20260709 12:21:08.411213 18752 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:21:08.424096 13203 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:08.406908 18600 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:08.395557 18756 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:08.420269 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:08.423200 13177 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:08.417418 18557 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:08.428982 13841 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:08.432499 13204 raft_consensus.cc:1275] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:21:08.434067 13177 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:08.435401 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:08.435722 13177 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:08.436452 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b5031b82872c430cbd03772ba96480ff with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 12:21:08.439535 18466 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:08.439983 18466 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.440150 18600 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:08.440332 18466 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:08.440937 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:08.441767 18600 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:08.442166 18600 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:08.442530 18600 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:08.443662 18579 raft_consensus.cc:3055] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:08.425105 18246 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.431771 18756 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.444216 18579 raft_consensus.cc:740] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:08.431772 18493 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:08.445348 18579 consensus_queue.cc:260] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.446555 18579 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:08.446764 13177 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:08.447760 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.449925 18493 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:08.458475 13210 raft_consensus.cc:2410] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:21:08.458369 18600 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.461719 18600 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.462922 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:08.463671 13208 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:08.463979 13130 raft_consensus.cc:1240] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 12:21:08.464980 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:08.465690 13136 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:08.466650 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.445914 18246 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.468367 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:08.469025 13207 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:08.467231 13208 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:08.463814 13883 raft_consensus.cc:2410] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:21:08.470501 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.471004 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.471338 18756 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.471704 13209 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:08.473158 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:08.473483 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.473986 13209 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:08.474169 13211 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:08.474892 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:08.475034 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.475801 13211 raft_consensus.cc:2393] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:08.476596 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:08.477262 13211 raft_consensus.cc:2393] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 18: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:08.477952 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:08.479197 13203 raft_consensus.cc:1240] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:08.475821 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.480778 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.481565 13208 raft_consensus.cc:2410] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:21:08.484127 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.485908 13887 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:08.435204 18651 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:08.486842 13207 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:08.509527 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:08.509968 13838 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:08.493553 13881 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:21:08.500976 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.507678 13136 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:21:08.517068 13252 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:08.517808 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.519767 13252 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:08.528714 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.529031 13252 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:21:08.562043 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.529376 13133 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:08.574172 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.575012 13130 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
W20260709 12:21:08.589478 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 60503.9us
I20260709 12:21:08.595651 13252 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:21:08.598006 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 77398us
I20260709 12:21:08.508849 18651 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:08.606894 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.604061 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.564759 18645 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:08.631898 18775 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:08.632596 18775 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:08.633074 13175 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:08.633134 18775 raft_consensus.cc:3060] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:08.638489 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 128643us
I20260709 12:21:08.640154 18777 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:08.643030 18777 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.521152 18756 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:21:08.621400 18456 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:08.641484 13175 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:08.630064 13206 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:08.624320 18651 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:08.570391 18407 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:21:08.624441 18631 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.658552 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:08.713904 13135 raft_consensus.cc:2393] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:08.603871 18435 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.689218 18577 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:08.691493 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.691138 18542 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:08.723155 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.649471 18777 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:08.651808 18456 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:08.652390 13175 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:21:08.741621 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 89309us
I20260709 12:21:08.625910 18546 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:08.651290 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2388) took 1429 ms. Trace:
I20260709 12:21:08.710870 13177 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:08.664572 18474 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:21:08.715531 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 108662us
I20260709 12:21:08.624312 18529 consensus_queue.cc:1048] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 12:21:08.735364 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:08.696290 13033 catalog_manager.cc:5697] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 4 to 5, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 5 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
W20260709 12:21:08.748018 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 43701.8us
I20260709 12:21:08.742622 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:08.752159 18474 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.754374 18603 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:08.705857 18583 consensus_queue.cc:1059] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:21:08.751119 13249 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:08.722416 18645 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.732972 18542 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.775758 18542 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:08.713757 18383 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:21:08.770613 18774 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:08.819228 18774 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:08.820006 18774 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:08.733042 18631 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.771145 18755 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:08.771353 18603 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:08.772621 18645 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.824678 18631 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:08.826134 18645 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.768085 18382 consensus_queue.cc:1059] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:21:08.773765 13103 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:08.774906 18760 log.cc:927] Time spent T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:21:08.774718 18684 consensus_queue.cc:1059] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:08.781921 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:08.779238 18383 consensus_queue.cc:1243] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer b190224a708b4f068a6dda4006c3a133 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:08.783849 18410 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:08.784621 18529 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:08.785127 18363 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:08.758426 18775 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.786398 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.792114 18466 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.793404 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.794595 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:08.796236 18763 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:21:08.796824 18669 consensus_queue.cc:1059] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:08.826951 18382 consensus_queue.cc:1243] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer cbc6af7757ec459ab451e47724fdf44b log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:21:08.819082 18307 raft_consensus.cc:3055] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:08.841342 18307 raft_consensus.cc:740] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:08.842836 13277 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:08.842561 18777 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.842437 18307 consensus_queue.cc:260] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.745435 18456 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:08.901942 18600 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:08.851020 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 69186.5us
I20260709 12:21:08.910130 18781 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.910706 18781 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.911908 13132 raft_consensus.cc:1275] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:08.913015 18781 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.913592 13252 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:08.914912 13252 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:08.840219 18529 raft_consensus.cc:697] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:08.867856 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:08.843905 18363 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.865267 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:08.920418 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:08.920446 18645 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:21:08.921614 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 124035us
I20260709 12:21:08.928136 13033 catalog_manager.cc:5697] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:08.928925 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:08.930080 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:08.931178 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:08.931689 18755 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:08.930672 13033 catalog_manager.cc:5697] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 9 to 10, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 10 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:08.932849 18767 log.cc:927] Time spent T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.145s	user 0.002s	sys 0.002s
I20260709 12:21:08.935803 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.937016 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:08.939572 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:08.940536 18645 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:08.943223 18456 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.944591 13284 raft_consensus.cc:2410] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:21:08.945616 18456 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:08.948038 18536 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:08.948664 18536 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.950949 18536 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.952320 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:08.953342 13137 raft_consensus.cc:2410] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:21:08.802919 13131 rpcz_store.cc:276] 0709 12:21:07.222138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.227980 (+  5842us) service_pool.cc:224] Handling call
0709 12:21:08.483861 (+1255881us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b5800001298. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d68a22 00007f70fac818d9 00007f70f9ddbee0 00007f70f9ea50ab 00007f70f9ea5131 00007f70f9e66fc0 00007f70f9e51929 00007f70f9e513d2 00007f70f33c8bd4
0709 12:21:08.484049 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.484244 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:08.484588 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 12:21:08.650834 (+166246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:08.650909 (+    75us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:08.650976 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.651061 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.651212 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":104,"spinlock_wait_cycles":64098944,"thread_start_us":165811,"threads_started":1,"wal-append.queue_time_us":343530}
I20260709 12:21:08.848325 18435 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:08.835934 18770 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:21:08.801049 18542 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.957370 18324 raft_consensus.cc:3055] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:08.957785 18324 raft_consensus.cc:740] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:08.958026 18542 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.846079 18474 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.899171 13177 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:08.852854 18684 raft_consensus.cc:3055] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:08.900524 13282 raft_consensus.cc:1217] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 12.7->[14.8-17.10]   Dedup: 14.8->[15.9-17.10]
I20260709 12:21:08.961462 13282 pending_rounds.cc:85] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 8
I20260709 12:21:08.961732 13282 pending_rounds.cc:107] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:21:08.961959 13282 raft_consensus.cc:2889] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:08.923544 18756 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:08.963788 18684 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:08.923806 18382 consensus_queue.cc:1059] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:21:08.923943 18370 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.966014 18370 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.845093 18669 raft_consensus.cc:3055] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:08.966897 18669 raft_consensus.cc:740] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:08.968211 18370 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.968128 18669 consensus_queue.cc:260] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:08.924490 18363 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:08.969820 18669 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:08.806744 18367 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:08.901923 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 128237us
I20260709 12:21:08.973613 13129 raft_consensus.cc:2368] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16.
I20260709 12:21:08.973681 13103 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:08.974946 13103 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:08.975636 18370 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:08.976096 18370 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.903165 18455 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:08.976619 18370 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:08.913805 18766 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:21:08.976420 18474 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:08.847117 18557 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:08.916149 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 276733us
I20260709 12:21:08.842617 18775 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:08.931051 13206 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:08.952198 18603 consensus_queue.cc:1048] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:08.964931 18684 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.802302 13286 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:21:08.924222 13283 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:08.923357 18529 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.734548 18577 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:08.744810 18546 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:08.979176 13878 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 16: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:08.954602 13033 catalog_manager.cc:5697] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 6 to 9, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 9 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:08.846074 18466 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:08.993599 13838 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
W20260709 12:21:08.989423 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 390319us
W20260709 12:21:08.987396 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 57391.5us
I20260709 12:21:09.009452 13249 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:08.997417 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 98343.9us
I20260709 12:21:09.010679 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:08.988767 13103 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:09.015303 13203 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:08.976071 18367 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:08.977969 18474 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:09.018477 18493 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.018704 18466 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:09.020777 13203 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:09.015044 18455 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:09.015375 18435 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:09.022389 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:09.023767 13285 raft_consensus.cc:1240] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:21:09.026973 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:09.028416 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:09.008651 18546 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:09.031267 13211 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:09.033977 13205 raft_consensus.cc:2393] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 16: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:08.994591 18755 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:09.034798 13206 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:09.039671 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:21:09.040024 13840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.918569 18651 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.009120 18583 consensus_queue.cc:1059] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:21:09.018528 13033 catalog_manager.cc:5697] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index 8 to 2, term changed from 12 to 8, leader changed from <none> to af3f42f0797349058724e0cb2e637d24 (127.11.163.1), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from VOTER to NON_VOTER, now has a pending config: VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3), VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1), VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2), VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 8 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:21:09.094802 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.031128 18600 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:21:09.042124 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 48606.4us
I20260709 12:21:08.976492 18324 consensus_queue.cc:260] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.028769 18382 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:09.079595 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:09.112758 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:09.153795 13129 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:09.088603 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 51890.9us
I20260709 12:21:09.200335 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:09.149237 13283 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:09.165678 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:09.033944 18493 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.206287 13132 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:09.123572 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:09.168370 13284 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:21:09.155692 18727 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 12:21:09.168792 13028 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51922 (request call id 209) took 14092 ms (client timeout 15000 ms). Trace:
I20260709 12:21:09.168907 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:09.218390 13209 raft_consensus.cc:2368] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16.
I20260709 12:21:09.169519 18557 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:09.036042 18466 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.170078 18651 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:09.096385 18683 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:09.100486 18537 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:09.088025 18307 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:09.088179 18775 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:09.030975 18645 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 12:21:09.172154 13033 catalog_manager.cc:5697] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:09.175216 18418 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:09.091667 18649 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:09.247175 18649 raft_consensus.cc:697] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:09.248307 18649 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.175318 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:09.176700 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:09.176988 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:09.179845 18779 raft_consensus.cc:3055] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:09.183597 18536 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.190843 13879 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:21:09.251843 13838 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:09.191601 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:09.192806 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:09.194260 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:09.192868 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:09.196137 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:09.183377 18370 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:09.107887 18474 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:09.268117 18370 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:09.209072 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 179847us
I20260709 12:21:09.268967 13203 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:09.034228 18455 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.210494 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:09.276984 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:09.277855 13279 raft_consensus.cc:3060] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:09.056798 18684 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:09.096952 18776 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.221820 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:09.101826 18777 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:09.100646 18577 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:09.218444 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:09.225666 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 184561us
I20260709 12:21:09.226754 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:09.227859 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:09.229369 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:09.230309 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:09.234712 13885 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:09.473376 13880 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 16: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:09.225998 18792 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:09.236044 18643 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:21:09.240953 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:09.243595 18418 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.497455 18418 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:09.244868 18466 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:09.235720 18683 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:09.235941 18537 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:09.107676 18774 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:09.218837 18603 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:09.219643 18149 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.511478 13135 raft_consensus.cc:2468] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
I20260709 12:21:09.512231 13129 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:09.260378 13285 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 16: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:09.042074 18756 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:09.263224 18536 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:09.233430 18454 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:21:09.260901 13887 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 17.
W20260709 12:21:09.280282 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 88822.8us
I20260709 12:21:09.296066 13131 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:09.305152 13204 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:09.295768 18410 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:09.318390 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:09.519538 13284 raft_consensus.cc:3060] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:09.501181 18669 consensus_meta.cc:287] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.001s
I20260709 12:21:09.295533 18557 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:09.259064 18779 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:09.303858 18324 raft_consensus.cc:3060] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:09.427762 18784 log.cc:927] Time spent T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:21:09.295565 18456 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:09.296254 18455 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:09.467836 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 162845us
I20260709 12:21:09.327958 18776 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:09.448881 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 217776us
I20260709 12:21:09.460182 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:09.472259 13206 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:21:09.495622 13882 raft_consensus.cc:2410] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:21:09.305897 18529 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.177s
W20260709 12:21:09.499096 18363 consensus_meta.cc:287] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.002s
I20260709 12:21:09.547389 13879 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:09.531314 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:09.548372 13207 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 16: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:09.532140 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:09.533735 18557 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.541163 13208 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:09.541333 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:09.251550 18775 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.534715 13279 raft_consensus.cc:2468] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:09.524593 18149 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.568648 18683 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:09.542116 18456 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:09.529035 18631 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:21:09.539291 18651 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:21:09.556973 18557 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:09.563887 13878 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:09.573791 13883 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:21:09.672508 18775 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:09.679662 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 378291us
I20260709 12:21:09.552965 18363 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.691854 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:09.692595 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:09.695163 13209 raft_consensus.cc:2393] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 9: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:09.704351 13205 raft_consensus.cc:2368] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 17. Current term is 18.
I20260709 12:21:09.705909 13284 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:09.668852 18779 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.703524 18603 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:09.710242 18779 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:09.712863 18537 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:09.715163 13204 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
W20260709 12:21:09.720393 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 509935us
I20260709 12:21:09.721244 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:09.723536 18645 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:09.723806 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:09.724262 18645 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.724793 18645 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:09.725158 18727 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:09.725921 18557 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.727070 18645 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:09.727391 13252 leader_election.cc:400] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16.
I20260709 12:21:09.731601 13252 leader_election.cc:403] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:21:09.733249 18645 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16.
I20260709 12:21:09.733872 13211 raft_consensus.cc:1240] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:09.736691 13841 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:09.737121 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:09.739717 13207 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:09.704103 18546 consensus_meta.cc:287] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.621s	user 0.013s	sys 0.000s
I20260709 12:21:09.728231 18557 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:09.741641 13103 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:09.697767 18493 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:09.747305 18796 log.cc:927] Time spent T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:21:09.748128 18785 log.cc:927] Time spent T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:21:09.748015 18773 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:09.749614 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:09.756513 13103 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:09.768864 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:09.760504 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:09.773295 13204 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:09.762274 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:09.743744 18738 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:09.705932 18466 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:21:09.764437 13207 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
I20260709 12:21:09.759692 18537 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:09.800305 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:09.794447 18454 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:09.811914 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:09.798161 18774 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:09.744532 18546 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.821506 13203 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:21:09.833792 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 110780us
I20260709 12:21:09.810181 18537 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.837602 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:09.774521 18773 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.836992 13840 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:09.840114 13207 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 16: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:09.824690 18807 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:09.818744 18418 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:09.842787 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:09.860783 13278 raft_consensus.cc:1240] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:09.860919 13203 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:09.862056 13286 raft_consensus.cc:1275] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:21:09.862496 13286 pending_rounds.cc:85] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 10
I20260709 12:21:09.862798 13286 pending_rounds.cc:107] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:21:09.863103 13286 raft_consensus.cc:2889] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:09.843806 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:09.821213 18454 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 16 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:09.862648 13841 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:09.869273 13249 leader_election.cc:400] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16.
I20260709 12:21:09.869671 13249 leader_election.cc:403] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:09.839756 18776 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:09.833760 18738 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:09.842535 18537 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:09.857573 18774 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.877877 13102 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:09.863459 18807 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.888126 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:09.860455 18775 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
W20260709 12:21:09.881289 18307 consensus_meta.cc:287] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.003s
I20260709 12:21:09.881963 18454 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:09.864245 18803 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:09.872434 18418 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:09.868011 18794 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.898355 18806 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:09.889076 18669 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:09.911872 18773 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:09.914844 18149 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:09.918213 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:09.889389 18410 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:09.919950 18410 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.920387 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:09.921379 13133 raft_consensus.cc:2368] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16.
I20260709 12:21:09.921665 18149 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:09.922688 18683 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:09.890309 18774 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:09.925506 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:09.933004 13281 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:09.925786 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:09.936568 13883 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:09.939620 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:09.890866 18324 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:21:09.889910 18363 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:09.958101 18684 consensus_meta.cc:287] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.000s
I20260709 12:21:09.960744 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:09.920399 18410 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:09.929508 18779 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:09.962877 13131 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:09.961403 13133 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:21:09.980683 13249 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:09.979779 13136 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:21:09.953253 18804 log.cc:927] Time spent T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:21:09.955909 18806 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.988505 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:09.937450 18794 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:09.923384 18455 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.981794 18790 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.992228 18382 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:09.959745 18307 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:09.953406 18792 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:09.986872 18669 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:09.991539 18529 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:21:09.996937 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 290314us
I20260709 12:21:10.005126 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:10.007696 18792 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.010675 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:10.010921 18792 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.011452 13284 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:10.011817 18542 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:10.016045 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:10.016645 13883 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 8.
I20260709 12:21:09.985270 18779 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.019033 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:10.019766 13883 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:10.000299 18790 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:09.218093 13028 rpcz_store.cc:269] 0709 12:20:54.916251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.940106 (+ 23855us) service_pool.cc:224] Handling call
0709 12:21:08.996738 (+14056632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:03.082350 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:03.112112 (+ 29762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:03.112169 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:21:03.112190 (+    21us) tablet.cc:662] Decoding operations
0709 12:21:03.199575 (+ 87385us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:03.199695 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:03.199729 (+    34us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:21:03.201774 (+  2045us) tablet.cc:701] Row locks acquired
0709 12:21:03.201833 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:21:03.202040 (+   207us) write_op.cc:270] Start()
0709 12:21:03.202216 (+   176us) write_op.cc:276] Timestamp: P: 1783599663201954 usec, L: 0
0709 12:21:03.202246 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:21:03.215083 (+ 12837us) log.cc:844] Serialized 8600 byte log entry
0709 12:21:03.732937 (+517854us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b54003633d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e88e28 00007f70f88c3581 00007f70f88c2d58 00007f70f88c79f1 00007f70f88c79a9 00007f70f88c7939 00007f70f88c7901 00007f70f88c6b2d 0000000000388634 0000000000388479
0709 12:21:04.549472 (+816535us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:21:05.349750 (+800278us) op_driver.cc:464] REPLICATION: finished
0709 12:21:05.923866 (+574116us) write_op.cc:301] APPLY: starting
0709 12:21:05.923951 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:06.211035 (+287084us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:06.211061 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:06.444760 (+233699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:06.445093 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 12:21:06.445141 (+    48us) write_op.cc:312] APPLY: finished
0709 12:21:06.445552 (+   411us) log.cc:844] Serialized 196 byte log entry
0709 12:21:06.652552 (+207000us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:06.652774 (+   222us) write_op.cc:454] Released schema lock
0709 12:21:06.652847 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:06.653315 (+   468us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:06.653348 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1223674,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":558234,"apply.run_cpu_time_us":43654,"apply.run_wall_time_us":729413,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96219,"num_ops":22,"prepare.queue_time_us":205861,"prepare.run_cpu_time_us":63854,"prepare.run_wall_time_us":650818,"raft.queue_time_us":421841,"raft.run_cpu_time_us":34737,"raft.run_wall_time_us":260040,"replication_time_us":2118693,"spinlock_wait_cycles":43580416,"thread_start_us":868270,"threads_started":5,"wal-append.queue_time_us":533526,"wal-append.run_cpu_time_us":40721,"wal-append.run_wall_time_us":3772019}]]}
I20260709 12:21:10.021994 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:10.022138 18790 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.022759 13883 raft_consensus.cc:2393] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 16: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:10.003355 18307 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:09.993162 13249 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:10.031883 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:10.032889 13203 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:21:10.040561 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:10.041287 13879 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:09.988816 18418 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.036474 18529 raft_consensus.cc:697] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:10.047397 18529 consensus_queue.cc:237] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.055363 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:10.056249 13882 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:10.057108 18456 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.058290 18456 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:10.060444 13103 leader_election.cc:400] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 17. Current term is 18.
W20260709 12:21:10.060567 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 67492.8us
I20260709 12:21:10.060952 13103 leader_election.cc:403] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:10.058099 18324 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16.
I20260709 12:21:10.063122 13281 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:10.063642 13207 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:10.047524 18684 consensus_queue.cc:1059] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:09.993084 18789 consensus_queue.cc:1059] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:21:10.067545 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:09.995393 18806 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.006894 18774 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.029209 18669 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.076939 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:10.077684 18149 raft_consensus.cc:3055] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:10.066349 18367 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:21:10.074816 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:10.076442 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:10.087162 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:10.088338 13207 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:10.088757 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:10.078083 18149 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:10.079406 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:10.080976 13252 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:10.090056 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:10.071738 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:10.099014 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:10.088442 13282 raft_consensus.cc:2393] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:10.067451 18738 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.065716 18790 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:10.104303 13277 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:10.111061 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:10.111856 13177 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:10.107096 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:10.078536 18363 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.116230 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.121836 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:10.121662 18363 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.122759 13887 raft_consensus.cc:2410] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:21:10.123616 18435 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:10.124307 18435 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:10.125303 18435 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.127734 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.128314 18363 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.128667 13130 raft_consensus.cc:2410] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:21:10.107036 18324 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:10.129422 18324 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.129844 18324 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:10.130353 18684 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:10.130723 18307 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.123757 18149 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.133680 18149 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:10.133671 18536 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.136518 18806 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:10.138255 13279 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
I20260709 12:21:10.140769 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:10.143111 13277 raft_consensus.cc:2393] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:10.144956 13177 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:10.145978 13177 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:10.100618 18780 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:10.121044 18542 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:21:10.171639 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 52392.5us
I20260709 12:21:10.172731 13249 leader_election.cc:400] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16.
I20260709 12:21:10.173264 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:10.174180 13211 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:10.104887 18645 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:21:10.141610 18683 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.143690 18776 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.200373 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.201117 13134 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:10.201556 18825 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:10.201978 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 93730.8us
I20260709 12:21:10.149108 18780 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.156721 18669 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.158977 18420 raft_consensus.cc:2804] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:10.209295 13249 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:10.159929 18600 raft_consensus.cc:2804] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:10.247072 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 1177) took 1234 ms. Trace:
W20260709 12:21:10.247400 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 43735.9us
I20260709 12:21:10.200220 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.250505 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 1181) took 1253 ms. Trace:
I20260709 12:21:10.251891 18779 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:10.259240 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 110464us
I20260709 12:21:10.116720 18738 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.285805 18807 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.287650 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:10.276163 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:10.278825 13286 rpcz_store.cc:276] 0709 12:21:08.997010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.008034 (+ 11024us) service_pool.cc:224] Handling call
0709 12:21:09.008411 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:09.869281 (+860870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:10.250160 (+380879us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54002503d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:10.250426 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953492736}
I20260709 12:21:10.277482 13278 rpcz_store.cc:276] 0709 12:21:08.971801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.994726 (+ 22925us) service_pool.cc:224] Handling call
0709 12:21:09.013780 (+ 19054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:09.861247 (+847467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:10.205859 (+344612us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54002305d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:10.206089 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947384192}
I20260709 12:21:10.289649 13177 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:10.288331 13209 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:21:10.296084 13841 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:21:10.277005 18815 log.cc:927] Time spent T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:21:10.248098 18780 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:10.248765 18651 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.255158 18695 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:10.305269 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 117935us
I20260709 12:21:10.289347 13212 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:10.328346 13177 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:10.332616 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:10.333698 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 124503us
W20260709 12:21:10.295601 18818 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:21:10.203770 18683 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.337540 13249 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:10.341563 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:10.291303 18420 raft_consensus.cc:697] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:10.248160 18825 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.205500 18776 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.326968 18803 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:10.327077 18600 raft_consensus.cc:697] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:10.361094 18777 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.391984 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:10.392422 18777 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.392824 18600 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.395040 18777 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.396790 18831 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.397372 18831 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.400734 13103 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:21:10.363526 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.401902 18830 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:10.402341 18830 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.402714 18830 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:10.321755 18455 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.335038 18773 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:10.417207 18683 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.295635 18529 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:10.359552 18774 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:10.378360 18776 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:10.367288 18803 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.346936 18695 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.385052 18420 consensus_queue.cc:237] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.347604 18466 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:10.336643 18794 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:10.404194 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 66739us
I20260709 12:21:10.409204 13879 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 18.
I20260709 12:21:10.410529 18546 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.411682 18367 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 17. Current term is 18.
I20260709 12:21:10.412173 18792 raft_consensus.cc:3055] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:21:10.418013 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 139472us
I20260709 12:21:10.418977 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:10.423480 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:10.459635 13249 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:10.338976 18651 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.470271 13278 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:10.425765 18774 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.422241 18756 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:10.469373 13102 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:10.444958 18803 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:10.481974 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:10.474030 18831 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.496446 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:10.473827 18792 raft_consensus.cc:740] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:10.493503 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:10.500252 13102 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:10.473755 18669 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:10.479941 18774 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:10.493216 18834 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.487178 18529 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:10.487097 18603 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:10.547712 18603 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.550328 18546 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:10.550880 18546 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.555346 13208 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:10.556524 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:10.556778 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:10.557893 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:10.463363 18466 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.530988 13102 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:10.559495 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:10.560492 13102 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:10.533668 18695 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.525843 18669 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.536465 18683 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:10.526270 18684 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:10.541409 18738 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.544286 18834 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.545168 18529 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.597654 13211 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
I20260709 12:21:10.582958 13206 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:10.601323 13102 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:10.526749 18777 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:10.571774 18455 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:10.610167 13102 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:10.610855 13252 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:10.608749 13103 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:10.622383 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.624205 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.630589 18466 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.630882 18246 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:10.631246 18837 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.631603 18246 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.631888 18837 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:10.632407 18324 consensus_meta.cc:287] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 12:21:10.632903 18324 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.633922 18838 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:10.634456 18838 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:10.634863 18838 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:10.619567 18683 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:10.637980 13136 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:10.609092 18529 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:10.607061 18807 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:10.610575 18794 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.643996 18367 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:10.611004 18777 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.635159 18324 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:10.650696 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:21:10.650159 18149 consensus_meta.cc:287] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 12:21:10.640441 18683 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:10.637305 18678 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:10.623703 18645 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 12:21:10.729501 18410 consensus_meta.cc:287] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.744s	user 0.006s	sys 0.006s
I20260709 12:21:10.730201 18410 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.619143 18780 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.713223 18777 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:10.748653 13887 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 16: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:10.660156 18807 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.751888 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:21:10.753918 18835 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:21:10.755156 18410 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:10.740517 18149 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:10.756924 18149 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.720127 18683 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.761358 18683 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.762269 18834 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.766673 18546 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:10.756101 18846 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:10.738731 18455 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:10.759155 18149 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.794958 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.716090 18774 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:10.784241 18537 consensus_meta.cc:287] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.848s	user 0.014s	sys 0.002s
I20260709 12:21:10.805140 18149 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.808142 18149 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.810403 18149 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.812019 18837 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.812353 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:10.815351 18842 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 12:21:10.776141 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:10.721096 18367 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 16 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:10.817045 18367 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:10.818584 18845 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:21:10.744642 18825 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.783851 18324 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:10.820995 18324 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:10.822258 13102 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.3:35631 timed out after 1.662s (SENT) [suppressed 7 similar messages]
I20260709 12:21:10.768661 18651 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.708099 18794 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.759248 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.803397 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.829366 13133 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 18.
I20260709 12:21:10.823365 18324 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:10.830551 13175 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:10.833806 18774 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.791131 18529 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.844067 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:10.806385 18455 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.839421 18813 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:10.829070 18537 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:10.864411 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 253600us
I20260709 12:21:10.858888 18853 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.857839 18466 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:10.874958 13100 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:10.859241 18669 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.884109 13137 raft_consensus.cc:2393] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:10.886680 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:10.880048 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 57817.5us
I20260709 12:21:10.886682 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:10.884116 18837 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:10.888438 13204 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:10.874341 18794 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.887358 13100 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:10.892357 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:10.892940 13206 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:10.893384 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.896390 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:10.897987 13133 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:10.898984 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.903659 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.903779 18807 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.905362 18537 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.905500 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.893513 18466 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:10.858253 18777 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.911624 18825 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:10.912470 18529 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:10.915376 18823 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.631s	user 0.003s	sys 0.000s
I20260709 12:21:10.915637 18466 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.918249 18455 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:10.920554 18803 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.922818 18803 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.923380 18780 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:10.925274 18456 consensus_meta.cc:287] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.866s	user 0.012s	sys 0.001s
I20260709 12:21:10.926214 13281 raft_consensus.cc:2410] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:21:10.891295 18669 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 12:21:10.929921 18830 consensus_meta.cc:287] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.003s
I20260709 12:21:10.934823 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:10.939951 13211 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:10.940562 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:10.930356 18830 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.948148 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:10.907567 18837 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:10.954459 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:10.955142 13205 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 14: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:21:10.960968 18857 log.cc:927] Time spent T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:21:10.970042 18833 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:10.970669 18833 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:10.976316 13131 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 15: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:10.977420 18830 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:10.884509 18853 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:10.979291 13129 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:21:11.001322 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:11.001986 13136 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:11.006405 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.007201 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.006990 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.007764 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.008486 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.008721 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.010921 13133 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:11.007061 13281 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:11.008641 13286 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:21:11.008922 13278 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:21:11.015590 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.016153 13283 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:21:11.016530 13283 pending_rounds.cc:85] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 7
I20260709 12:21:11.016815 13283 pending_rounds.cc:107] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:21:11.016660 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.017202 13283 raft_consensus.cc:2889] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:10.995817 18830 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:11.018955 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:11.017516 13286 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:11.019325 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:10.996865 18806 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:11.022682 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:10.959990 18756 consensus_queue.cc:1059] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 12:21:11.017625 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 72988.8us
I20260709 12:21:11.024322 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.043507 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:11.025884 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:11.032096 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.046074 13133 raft_consensus.cc:2393] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 12: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:11.047725 13283 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:11.047134 13285 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 11.
I20260709 12:21:11.007457 18813 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:11.051380 13206 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:11.059131 13136 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:11.063907 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.056936 13102 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:11.065402 13102 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:11.048219 13281 raft_consensus.cc:2376] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16. Re-sending same reply.
I20260709 12:21:11.008471 18789 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:11.064527 13285 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:11.067965 18825 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:11.068384 18825 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:11.068645 18816 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.982s	user 0.000s	sys 0.009s
I20260709 12:21:11.068740 18825 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:11.076195 18825 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.076581 18246 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.077862 13102 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:11.079066 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.083580 13211 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:11.080495 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.079741 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.082304 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.077749 13283 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:11.079540 18853 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.059681 18456 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.089499 18456 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.090106 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:11.090807 13212 raft_consensus.cc:2393] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 10: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:11.091543 18456 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.091518 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:11.092553 13212 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:11.095836 18777 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.097285 18603 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.098366 18856 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:11.098794 18856 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.099121 18856 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:11.102555 18792 consensus_queue.cc:260] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.107568 18669 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:11.087292 13249 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:11.111527 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.113433 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:11.122913 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:11.123540 13286 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 15: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:11.120797 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:11.124728 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.125360 13204 raft_consensus.cc:1813] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Handling vote request from an unknown peer af3f42f0797349058724e0cb2e637d24
I20260709 12:21:11.125954 13204 raft_consensus.cc:2410] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:21:11.123756 13103 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:11.116526 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.127130 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.129244 13209 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:11.130581 13249 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:11.128084 13203 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
W20260709 12:21:11.115600 18773 consensus_meta.cc:287] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.004s
I20260709 12:21:11.136897 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:11.134199 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.135798 13177 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:11.137662 13282 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:11.138950 13103 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:11.024412 18830 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.144865 13177 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:11.141728 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:11.154016 13281 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 11: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:11.124950 18833 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:11.097685 18838 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:11.066082 18806 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.150005 18727 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:11.167182 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:11.133512 18853 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:11.140030 18807 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:11.191681 18807 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:11.192162 18807 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:11.171620 18324 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:11.168040 18420 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:11.164505 18794 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:11.196686 18830 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.171406 18853 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.204005 18853 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:11.146703 18246 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:11.204643 18246 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.205215 18246 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:11.182855 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:11.187809 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.140251 18773 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:11.209233 13210 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:11.212582 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.172246 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.125391 18831 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:21:11.149232 18792 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:11.216162 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 44238.1us
I20260709 12:21:11.151211 18777 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:11.219905 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.161676 18456 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:11.221684 13135 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:11.087890 18789 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.222900 13129 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:21:11.225433 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 58338.2us
I20260709 12:21:11.227788 13252 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:11.230803 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:11.224704 18324 raft_consensus.cc:697] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:11.234712 18777 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:21:11.236178 18866 log.cc:927] Time spent T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 12:21:11.236670 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 909377us
I20260709 12:21:11.229138 18727 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:11.237391 13838 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:11.237360 18727 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.238744 18833 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:11.241858 18806 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.235420 18324 consensus_queue.cc:237] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:11.251999 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.253063 13136 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 13: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:21:11.255539 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 854322us
I20260709 12:21:11.256846 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:11.260113 18825 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.223390 18684 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:11.261206 18669 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.261718 18669 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:11.261509 18684 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.263558 18466 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:11.264081 18466 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.266363 18466 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:11.280336 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 49641.9us
I20260709 12:21:11.282131 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.284571 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.285418 13207 raft_consensus.cc:2410] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:21:11.287855 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.288671 13211 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 10.
I20260709 12:21:11.259248 18838 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.293889 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:11.297982 13211 raft_consensus.cc:2393] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 16: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:11.230193 18830 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:11.277158 18631 raft_consensus.cc:2804] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:11.284062 18683 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:11.267191 18807 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:11.264155 18418 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
W20260709 12:21:11.330928 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 49347.9us
I20260709 12:21:11.331018 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:11.301316 18727 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.303401 18557 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.307464 18738 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:11.341117 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.315392 18833 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:11.341993 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.355777 13278 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:21:11.350225 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:11.360630 13840 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:11.370325 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.372056 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.372798 13886 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
W20260709 12:21:11.374428 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 116506us
I20260709 12:21:11.380999 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.381173 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.352759 18684 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.385807 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.386468 13886 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:11.387063 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.383855 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.349272 18535 consensus_queue.cc:1059] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:21:11.362097 18631 raft_consensus.cc:697] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:11.353240 18779 consensus_queue.cc:1048] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:21:11.397343 13282 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:11.355060 18557 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.385485 18695 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:11.380177 18837 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:11.365761 18833 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:11.368983 18853 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.407928 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.408279 13879 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:11.420410 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:11.396924 18836 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:11.425160 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.402354 18773 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.431926 13128 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
I20260709 12:21:11.432020 13883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45928 (request call id 993) took 1406 ms. Trace:
I20260709 12:21:11.407558 18802 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.404816 18695 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.442380 13838 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:11.443822 13838 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:11.448405 18583 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:11.449139 18583 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:11.449504 18583 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:11.449867 18583 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:11.452131 18807 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:11.425925 18836 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.434127 13883 rpcz_store.cc:276] 0709 12:21:10.025262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.025439 (+   177us) service_pool.cc:224] Handling call
0709 12:21:10.025832 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.068512 (+ 42680us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:10.101001 (+ 32489us) log.cc:844] Serialized 14 byte log entry
0709 12:21:10.356893 (+255892us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b1800337a20. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1da03f3 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd 0000000000388634 0000000000388479 00007f70f1d8383a
0709 12:21:10.376859 (+ 19966us) log.cc:844] Serialized 14 byte log entry
0709 12:21:11.235349 (+858490us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b1800337a20. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70fac68ab1 00007f70fac75281 00007f70f1d1ac0a 00007f70fb45a219 00007f70f8d6158f 00007f70f1da0571 00007f70f1da27c1 00007f70f1da2779 00007f70f1da2709 00007f70f1da26d1 00007f70f1da19cd
0709 12:21:11.327683 (+ 92334us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:11.328164 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:21:11.349940 (+ 21776us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:11.349981 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.350051 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:11.431777 (+ 81726us) raft_consensus.cc:1685] finished
0709 12:21:11.431798 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:11.431938 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1001888,"prepare.queue_time_us":26500,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":95,"raft.queue_time_us":1001493,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":45961,"spinlock_wait_cycles":24680960,"thread_start_us":221484,"threads_started":3,"wal-append.queue_time_us":172798}
I20260709 12:21:11.463845 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:11.427907 18789 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.434772 18631 consensus_queue.cc:237] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.469210 18695 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.474720 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.464998 18836 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:11.488514 13206 raft_consensus.cc:1240] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:11.490751 18418 raft_consensus.cc:3055] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:21:11.491554 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.493366 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.495774 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:11.496596 13206 raft_consensus.cc:2393] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:11.498725 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.501108 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:11.501322 18557 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.502357 18830 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:11.503041 13881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:21:11.503798 13881 raft_consensus.cc:606] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:11.503446 18830 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:11.504217 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 158149us
I20260709 12:21:11.433781 18773 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:11.510864 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.471315 18738 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:11.512140 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.515204 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:11.517004 13279 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:11.517908 13882 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:11.518148 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 119487us
I20260709 12:21:11.515566 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:11.522826 13280 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:11.523597 13278 raft_consensus.cc:2368] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14.
I20260709 12:21:11.491223 18418 raft_consensus.cc:740] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:11.528054 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.465767 18802 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.533315 18855 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:21:11.543174 13279 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:11.544643 13881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:21:11.545297 13881 raft_consensus.cc:606] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 18 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:11.550419 18755 raft_consensus.cc:3055] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:11.550839 18755 raft_consensus.cc:740] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:11.551692 18755 consensus_queue.cc:260] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:11.552796 13100 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:11.553148 18418 consensus_queue.cc:260] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.553675 18848 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:11.553753 13882 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 10.
I20260709 12:21:11.554410 18418 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:11.554795 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:11.538125 13841 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:11.555207 18853 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.555912 18779 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:11.557498 18246 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.558720 13133 raft_consensus.cc:2368] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
I20260709 12:21:11.560107 18833 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:11.560657 18833 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.560747 13175 leader_election.cc:400] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
I20260709 12:21:11.561138 13175 leader_election.cc:403] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:11.561103 18833 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:11.562251 18456 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:11.562495 18382 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:11.562918 18456 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.563207 18382 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.564996 18456 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.565337 18813 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:21:11.565546 18382 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:11.565771 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 58003.8us
I20260709 12:21:11.566174 18382 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:11.570604 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:11.572325 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.572710 18856 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:11.570814 13208 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:21:11.574262 13130 raft_consensus.cc:2368] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16.
I20260709 12:21:11.561178 13102 leader_election.cc:400] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14.
I20260709 12:21:11.575971 18779 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:11.575227 13102 leader_election.cc:403] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:21:11.579612 13102 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:11.580209 18846 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:11.580673 18831 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:11.581001 18802 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.575862 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.583659 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:11.554067 13100 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:11.589264 13100 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:11.591679 13882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:21:11.592811 13882 raft_consensus.cc:606] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:21:11.593284 13882 raft_consensus.cc:614] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:11.575106 18856 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.595551 13100 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:11.595772 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.596812 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.595960 13283 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:11.552798 18755 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:11.605866 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:11.598292 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.609997 13209 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:11.600250 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.601889 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.601999 13283 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:11.613041 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.585678 13249 leader_election.cc:400] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16.
I20260709 12:21:11.608282 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:11.600646 13204 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:21:11.614018 13249 leader_election.cc:403] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:21:11.614989 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.614904 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.585184 18833 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:11.625013 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.610284 13280 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:21:11.623266 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.627633 13278 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:21:11.629860 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:11.591714 18838 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:11.631278 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:11.635573 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.635826 13278 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:11.637429 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:11.638199 13277 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:11.592926 18837 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:11.641791 13280 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:21:11.643249 13130 raft_consensus.cc:2393] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 15: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:11.598093 18683 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:11.598348 18829 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:11.608775 18684 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:11.655056 13884 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:21:11.659055 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:11.653362 18838 raft_consensus.cc:697] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:11.608289 18246 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.632915 13100 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:11.674021 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:11.634740 18382 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:11.676093 13885 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:11.603936 18825 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:21:11.677271 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.678480 13840 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:11.683266 13840 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:11.654376 18807 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:11.689605 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 57148.5us
I20260709 12:21:11.661574 18838 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.669338 18695 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:11.694585 18848 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:11.669515 18535 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:11.695417 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.695662 18651 consensus_queue.cc:1059] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:21:11.696095 18877 log.cc:927] Time spent T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:21:11.696106 13884 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:11.695628 18535 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.698904 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:11.698721 18669 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.699581 13884 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:11.705803 18643 raft_consensus.cc:993] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:11.709787 18643 raft_consensus.cc:1081] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:11.696888 18651 raft_consensus.cc:3055] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:11.696890 13137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:21:11.710981 18669 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:11.694710 18695 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.713213 18695 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:11.710860 18651 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:11.715173 18651 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.716962 18651 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:11.716984 13209 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
I20260709 12:21:11.700340 18535 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:11.686798 18412 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:21:11.688868 18382 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:11.720818 13884 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:11.721511 18382 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:11.725332 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.727370 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.666719 18583 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.731555 18583 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.731910 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.735023 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.736115 18773 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.668092 18802 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:11.740123 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.740096 18802 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.687458 18873 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:11.742208 13886 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:11.742601 18802 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.743554 13103 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:11.744455 18794 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:11.744766 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:11.744989 18794 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 16 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:11.745850 18794 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:11.753082 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:11.753160 18649 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:11.688684 18307 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:11.755679 18307 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:11.756408 18307 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:11.755378 18649 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.759963 18649 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:11.754390 18776 raft_consensus.cc:993] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:11.764046 18651 raft_consensus.cc:1081] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 18 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:11.771873 13277 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
W20260709 12:21:11.781443 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 90992.3us
I20260709 12:21:11.782897 13100 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:11.799106 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.808310 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.799983 13100 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:11.810495 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:11.811959 13207 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 14: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:11.814953 13100 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:11.816013 18669 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:11.775884 18324 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16.
I20260709 12:21:11.828473 18777 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:11.783557 18848 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.843834 18848 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:11.846016 18848 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:11.846153 18836 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.853076 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:11.857334 18649 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.862394 18307 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.808777 18831 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:11.881096 13278 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:11.832206 18773 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:21:11.919714 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 104875us
I20260709 12:21:11.814041 18684 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:11.879334 13883 raft_consensus.cc:2468] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
W20260709 12:21:11.883618 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 272170us
I20260709 12:21:11.924494 13838 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:11.929551 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:11.930410 13883 raft_consensus.cc:2393] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 10: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:11.931064 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.938064 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:11.938738 13883 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:11.942152 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:11.914541 13207 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:11.881981 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:11.904649 18846 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14.
I20260709 12:21:11.915835 13887 raft_consensus.cc:1813] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Handling vote request from an unknown peer af3f42f0797349058724e0cb2e637d24
I20260709 12:21:11.852913 18813 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
I20260709 12:21:11.946797 13883 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:11.953572 13887 raft_consensus.cc:2393] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:11.922513 18837 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:11.957942 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:11.966442 13885 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:11.967092 13883 raft_consensus.cc:1240] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:11.967551 13137 raft_consensus.cc:606] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:11.968120 13137 raft_consensus.cc:614] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:11.970546 13884 raft_consensus.cc:1240] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:11.971891 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.956699 18412 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:11.972563 13129 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:11.972899 18848 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.973366 18848 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:11.981848 18837 raft_consensus.cc:697] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:11.988817 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:11.944011 18873 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:11.994050 13133 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:21:12.018374 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:12.020967 18307 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:12.022526 18882 log.cc:927] Time spent T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.361s	user 0.003s	sys 0.000s
I20260709 12:21:12.023443 18557 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.024001 18557 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:12.026167 18557 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:12.027359 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:12.028095 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:12.031597 18683 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:12.031996 18683 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.032337 18683 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:12.032686 18649 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:12.036876 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:12.037694 13131 raft_consensus.cc:2368] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 14. Current term is 15.
I20260709 12:21:12.038496 18631 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:11.969278 18831 raft_consensus.cc:697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:12.015203 18780 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:12.056166 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:12.056849 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 133848us
I20260709 12:21:12.045763 18848 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:12.051379 18836 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:12.069001 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 111149us
I20260709 12:21:12.069480 13100 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:12.071914 13100 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:12.078050 13100 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:12.082266 13838 leader_election.cc:400] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 14. Current term is 15.
W20260709 12:21:12.082693 18887 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:12.080961 18848 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:12.083762 18894 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:12.084316 18897 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:12.084393 18894 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:12.086700 18894 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:12.082697 13838 leader_election.cc:403] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:21:12.083845 18848 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.092134 13177 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:12.073808 18684 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:12.097716 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:12.098627 13131 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:21:12.098878 18895 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:12.100080 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:12.113267 18891 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:12.115072 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:12.118587 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:12.072255 18888 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:21:12.120651 13207 raft_consensus.cc:1275] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:21:12.093832 18848 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:12.092793 18836 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:12.132068 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:12.071080 18837 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:12.088820 18831 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:12.141155 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:12.122295 18684 raft_consensus.cc:697] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:12.157327 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:12.158231 13204 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:12.161942 13205 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
W20260709 12:21:12.176781 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 63940.3us
I20260709 12:21:12.137984 18777 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:12.179117 13841 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:12.182511 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:12.182935 13206 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:12.146193 18631 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:21:12.189702 13137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:21:12.187209 18307 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:12.194528 18684 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:12.195024 18683 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:12.193591 13129 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:12.184332 18776 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:12.192456 18557 consensus_queue.cc:1048] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:21:12.198848 18557 consensus_queue.cc:1243] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer a99436c294734e5cbc3657b2517cefca log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:21:12.205504 13206 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:21:12.209019 18683 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:12.213377 13841 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:12.216140 18897 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:12.219060 18848 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:12.229310 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:12.232215 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:12.256040 13210 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:12.247025 13207 raft_consensus.cc:1217] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Deduplicated request from leader. Original: 11.9->[13.10-16.12]   Dedup: 13.10->[15.11-16.12]
I20260709 12:21:12.259732 13207 pending_rounds.cc:85] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 10
I20260709 12:21:12.260093 13207 pending_rounds.cc:107] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:21:12.260404 13207 raft_consensus.cc:2889] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:12.222306 18836 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 14. Current term is 15.
I20260709 12:21:12.275605 13103 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:12.279556 13131 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 14: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:12.280776 13137 raft_consensus.cc:606] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:21:12.254900 18535 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:21:12.297972 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 642089us
W20260709 12:21:12.301465 13249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.302193 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:12.305472 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:12.307324 18529 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:12.307776 18790 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.308542 18727 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.308701 18848 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:12.309286 18848 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:12.309072 18727 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:12.309772 18848 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:12.310621 18848 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:12.311575 18382 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:12.312100 18382 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:12.314698 18756 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:12.315117 18756 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:12.315531 18756 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:12.283668 18535 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.316071 18535 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:12.318329 18807 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:12.322309 13252 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:12.326407 18755 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.287757 18831 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:12.328146 13278 raft_consensus.cc:1275] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:21:12.329630 13881 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:21:12.329747 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:12.309283 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:12.340085 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:12.362710 13135 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 15: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:12.327147 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:12.363741 13286 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:12.318890 18807 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:12.308079 18529 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:12.314257 18382 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:12.351004 13210 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:12.355901 13132 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:12.373312 13128 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:21:12.356994 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:12.359571 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:12.361544 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:12.374641 13129 raft_consensus.cc:2368] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15.
I20260709 12:21:12.365841 13878 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 11. Current term is 12. Ops: []
W20260709 12:21:12.367717 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 58548.6us
I20260709 12:21:12.367926 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:12.375288 13103 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:12.380110 13884 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:12.380313 13249 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:12.371582 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49366.8us
I20260709 12:21:12.308334 18790 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:12.379596 18557 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:12.386549 18790 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:12.388245 13277 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:12.388739 18807 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:12.389808 18382 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:12.365260 18755 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:12.390444 18382 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:12.391002 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:12.391806 18755 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:12.392156 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:12.373003 18456 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:12.393317 18456 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:12.397331 18856 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:12.397938 18856 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:12.393322 13249 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:12.392354 18755 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:12.400750 13841 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:12.362771 18727 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:12.410063 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:12.412498 13249 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:12.392289 18529 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:12.411341 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:12.422900 18789 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:12.424242 18792 consensus_queue.cc:1059] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:21:12.428115 18856 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:12.433202 18529 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:12.414763 18807 raft_consensus.cc:2804] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:12.435828 18807 raft_consensus.cc:697] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:12.436787 18807 consensus_queue.cc:237] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:12.442603 18902 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:21:12.414942 18382 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:12.445566 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:12.446400 18886 log.cc:927] Time spent T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.648s	user 0.002s	sys 0.000s
I20260709 12:21:12.451898 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:12.451833 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:12.446410 13279 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:12.461107 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:21:12.461164 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 79004.4us
I20260709 12:21:12.467391 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:12.467638 18813 consensus_queue.cc:1048] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:12.470466 18600 raft_consensus.cc:2764] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:21:12.471669 13177 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:12.472668 18600 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:12.473121 18600 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:12.473606 18600 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:12.480511 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:12.482788 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:12.483544 13249 leader_election.cc:400] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15.
I20260709 12:21:12.483968 13249 leader_election.cc:403] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:12.484943 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:12.463105 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 104858us
I20260709 12:21:12.573388 18813 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:12.430557 18872 raft_consensus.cc:2804] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:12.707984 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:12.724709 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 75365.4us
I20260709 12:21:12.689584 18792 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:21:12.690675 18557 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.735034 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:12.739970 18813 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:12.745222 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:12.756435 13286 raft_consensus.cc:2368] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 14. Current term is 15.
I20260709 12:21:12.756865 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:12.780372 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:12.781292 13279 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:21:12.739305 18901 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:12.782058 18886 log.cc:927] Time spent T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:21:12.785202 18885 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:12.919639 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:21:12.914167 18882 log.cc:927] Time spent T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:21:12.918634 18885 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:12.780761 18813 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:12.932475 18727 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:12.956873 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:12.957707 13285 raft_consensus.cc:3060] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:12.885552 18901 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:13.000042 18923 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:21:12.952787 18727 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:13.009989 18727 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:13.011210 18813 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:12.749356 18603 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.264s
I20260709 12:21:13.013955 18885 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:12.983604 18535 consensus_meta.cc:287] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.004s
I20260709 12:21:13.014761 18535 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:12.992401 18756 consensus_meta.cc:287] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.676s	user 0.007s	sys 0.004s
I20260709 12:21:13.016075 13887 raft_consensus.cc:2368] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
I20260709 12:21:13.016080 18756 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.017177 18535 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:13.018646 18756 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:13.019349 13282 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:13.019948 18901 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:12.774622 18557 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.023341 18557 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:13.015179 18382 raft_consensus.cc:3055] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:13.026459 18382 raft_consensus.cc:740] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:21:13.037452 13280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.003s	sys 0.016s
W20260709 12:21:13.037957 13280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.003s	sys 0.016s
W20260709 12:21:13.039160 13284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.013s	sys 0.005s
W20260709 12:21:13.039616 13284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.014s	sys 0.005s
I20260709 12:21:13.048069 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:13.049451 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:13.058490 13282 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:13.051759 13280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:42730
I20260709 12:21:13.081045 13280 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:13.081529 13280 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:13.093166 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:13.093611 13840 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:13.093951 13278 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:13.095007 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:13.097854 13277 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.031s	sys 0.126s
W20260709 12:21:13.098340 13277 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.031s	sys 0.126s
I20260709 12:21:13.078922 18901 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.045954 18382 consensus_queue.cc:260] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.103180 13840 leader_election.cc:400] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 14. Current term is 15.
I20260709 12:21:13.106349 13284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:42730
I20260709 12:21:13.061980 18872 raft_consensus.cc:697] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:13.114392 13883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1406) took 1181 ms. Trace:
I20260709 12:21:13.092547 18727 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:13.114879 13883 rpcz_store.cc:276] 0709 12:21:11.933109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.014644 (+ 81535us) service_pool.cc:224] Handling call
0709 12:21:12.016116 (+  1472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:12.059030 (+ 42914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:12.059077 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:12.065798 (+  6721us) log.cc:844] Serialized 26 byte log entry
0709 12:21:12.146927 (+ 81129us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:12.146978 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.107231 (+960253us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b54005f0354. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:13.107291 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:13.107355 (+    64us) raft_consensus.cc:1685] finished
0709 12:21:13.107375 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.114298 (+  6923us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5406,"spinlock_wait_cycles":97736448,"thread_start_us":67561,"threads_started":1,"wal-append.queue_time_us":197806}
W20260709 12:21:13.147591 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 368997us
I20260709 12:21:13.147054 13278 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:13.098798 18790 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:13.115101 18382 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:13.169205 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 62077.7us
I20260709 12:21:13.110567 18901 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:13.158278 18756 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:13.161415 18802 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:13.170220 13840 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:13.158385 18324 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:13.158561 18934 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:13.194563 18940 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:21:13.196969 18755 consensus_meta.cc:287] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.002s
I20260709 12:21:13.197413 18755 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:13.198031 13283 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:13.162186 18727 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.205315 18727 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:13.173480 18829 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:13.206050 18829 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:13.172019 18420 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:13.188697 18756 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.207726 18420 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.209542 18756 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:13.192512 18324 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.214942 18324 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:13.215157 18873 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:13.215826 18873 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.186684 18872 consensus_queue.cc:237] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.226334 13283 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:13.227665 13285 raft_consensus.cc:2468] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:21:13.171398 18807 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:13.230701 18600 consensus_meta.cc:287] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.757s	user 0.013s	sys 0.003s
I20260709 12:21:13.221936 18557 raft_consensus.cc:2804] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:13.220635 18825 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:21:13.255187 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 82030.7us
I20260709 12:21:13.234822 18836 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:13.273599 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 1118) took 1151 ms. Trace:
I20260709 12:21:13.275087 13131 rpcz_store.cc:276] 0709 12:21:12.121790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.122331 (+   541us) service_pool.cc:224] Handling call
0709 12:21:13.273416 (+1151085us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54002b5054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:13.273541 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333814528}
I20260709 12:21:13.280543 13883 raft_consensus.cc:1240] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:21:13.282141 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:13.282820 13883 raft_consensus.cc:2368] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:21:13.284044 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:13.284626 13883 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:13.285799 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:13.286414 13883 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:13.269779 18557 raft_consensus.cc:697] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:13.288086 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.291092 13249 leader_election.cc:400] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:21:13.291441 13249 leader_election.cc:403] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:21:13.292819 13249 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:13.168591 18790 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.287846 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:13.349267 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:13.290760 13131 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 18.
I20260709 12:21:13.376780 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:13.379073 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:13.381961 13206 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:13.261085 18600 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.269246 18825 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:13.401978 18897 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.402777 18825 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:13.394026 13280 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.406404 13285 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:13.408704 13880 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:13.414085 13284 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:13.414700 13284 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:13.417377 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.420046 18603 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:13.420588 18603 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:13.423508 18931 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:21:13.370517 18789 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:13.425879 18789 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:13.426291 18789 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:13.429646 13284 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.434643 13203 raft_consensus.cc:3060] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:13.438947 13881 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:21:13.442061 18938 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:21:13.368139 18854 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:21:13.405666 18873 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:13.402709 18897 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:13.454509 18897 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:13.283159 18807 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:13.457749 18807 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:13.457911 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.458878 13277 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:13.280975 18813 consensus_queue.cc:1059] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:21:13.458087 13203 raft_consensus.cc:2468] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:13.460475 18813 raft_consensus.cc:3055] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:13.460570 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.460968 18813 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:13.459403 18789 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.461972 18813 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.464679 13881 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:21:13.464260 18557 consensus_queue.cc:237] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.465091 13881 pending_rounds.cc:85] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Aborting all ops after (but not including) 8
I20260709 12:21:13.465389 13881 pending_rounds.cc:107] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:21:13.466243 13881 raft_consensus.cc:2889] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:13.303443 18727 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.279358 18836 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.398494 18367 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.478806 13206 raft_consensus.cc:3060] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:13.480278 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.483748 13280 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:13.481317 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.488680 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:13.499378 13210 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:21:13.502286 13210 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:13.407601 18307 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:13.512044 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:13.514025 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:13.514837 13211 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 12.
I20260709 12:21:13.515336 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:13.475839 18873 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.517318 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 3318) took 1075 ms. Trace:
I20260709 12:21:13.517722 13282 rpcz_store.cc:276] 0709 12:21:12.441818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.451631 (+  9813us) service_pool.cc:224] Handling call
0709 12:21:13.517179 (+1065548us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54002dafd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:13.517266 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303360256}
I20260709 12:21:13.463338 18813 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:13.504521 18367 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:13.527261 18307 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:13.529237 13887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 1009) took 1191 ms (client timeout 1522 ms). Trace:
W20260709 12:21:13.575495 13887 rpcz_store.cc:269] 0709 12:21:12.325809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.334920 (+  9111us) service_pool.cc:224] Handling call
0709 12:21:13.516802 (+1181882us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54007602d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:13.516921 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464204032}
I20260709 12:21:13.528867 18873 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.475955 18789 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:13.530263 13251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.530602 13134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60854 (request call id 1123) took 1178 ms. Trace:
I20260709 12:21:13.485540 18727 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:13.597388 18727 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:13.579049 18901 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:13.579933 13134 rpcz_store.cc:276] 0709 12:21:12.351829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.351973 (+   144us) service_pool.cc:224] Handling call
0709 12:21:12.352349 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:13.212453 (+860104us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:13.212486 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:13.212965 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:21:13.271028 (+ 58063us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:13.271067 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.519381 (+248314us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b540027db54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:13.519982 (+   601us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:13.520032 (+    50us) raft_consensus.cc:1685] finished
0709 12:21:13.520048 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.530544 (+ 10496us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":819253,"raft.queue_time_us":820780,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":78,"spinlock_wait_cycles":92886912,"thread_start_us":57685,"threads_started":1,"wal-append.queue_time_us":226639}
I20260709 12:21:13.600020 13277 raft_consensus.cc:1240] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:13.600639 13282 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:21:13.597303 13132 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:13.602093 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.534514 13283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38644 (request call id 3324) took 1073 ms. Trace:
I20260709 12:21:13.580116 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.608322 13277 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:13.608573 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.609506 13134 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:13.604640 13283 rpcz_store.cc:276] 0709 12:21:12.460699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.460822 (+   123us) service_pool.cc:224] Handling call
0709 12:21:13.534327 (+1073505us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400336b54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:13.534446 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692445440}
I20260709 12:21:13.613730 13252 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:13.606328 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:13.615916 13212 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:13.616219 13277 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:13.616762 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.581096 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:13.581250 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.585207 13280 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:21:13.579174 18936 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.586851 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:13.587742 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.588294 18897 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:13.588721 18535 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:13.589685 18307 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:13.590632 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:13.578982 18935 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.591789 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.593480 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.593873 18873 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:13.574865 18825 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:13.620010 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.624568 13102 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:13.620862 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.621433 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.619297 13204 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:13.628475 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:13.629312 18936 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.610886 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:13.618330 18792 consensus_meta.cc:287] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.871s	user 0.009s	sys 0.006s
I20260709 12:21:13.644604 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.650451 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.656801 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.658990 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.659747 13283 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:13.628973 18727 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.657734 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.627111 18755 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:13.624558 18883 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:13.606024 18856 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:21:13.691550 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:13.656297 18792 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 14. Current term is 15.
I20260709 12:21:13.655396 18855 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:13.656037 18873 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:13.700229 13280 raft_consensus.cc:2368] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
I20260709 12:21:13.701272 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.637444 18246 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:21:13.723191 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.647409 18825 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:13.724395 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.725011 13135 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:13.726126 18825 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:13.726759 18420 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:13.642338 18535 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.727380 18830 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:13.647575 18382 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:21:13.689617 18727 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:13.709751 18802 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:13.686715 18848 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:21:13.711640 18367 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:13.713662 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.681406 18837 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:21:13.695688 18883 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.719249 18873 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.720126 18790 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:13.720618 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:13.727535 18420 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:13.636647 18897 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:13.730384 13134 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:13.643976 18935 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.734138 13212 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
W20260709 12:21:13.734840 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 431939us
I20260709 12:21:13.734254 18825 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:21:13.749544 13881 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:13.760314 13281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2595) took 1434 ms. Trace:
I20260709 12:21:13.750131 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:13.834659 13285 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 17.
I20260709 12:21:13.833179 13281 rpcz_store.cc:276] 0709 12:21:12.325429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.332068 (+  6639us) service_pool.cc:224] Handling call
0709 12:21:12.332394 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:12.398759 (+ 66365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:12.398790 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:12.399246 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:21:12.762188 (+362942us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:12.762462 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.737350 (+974888us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b5400264dd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:13.737397 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:13.737441 (+    44us) raft_consensus.cc:1685] finished
0709 12:21:13.737453 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.760230 (+ 22777us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7162,"raft.queue_time_us":9125,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3761,"spinlock_wait_cycles":151768832,"thread_start_us":301641,"threads_started":1,"wal-append.queue_time_us":543934}
W20260709 12:21:13.860512 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 81221.1us
I20260709 12:21:13.833191 18836 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:13.883510 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 191171us
W20260709 12:21:13.913791 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.832108 18420 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.927289 13838 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:13.928637 13175 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:13.952560 13840 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:21:13.966425 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 247742us
I20260709 12:21:13.935137 18936 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:13.977301 18936 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:13.977695 18936 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.955236 18855 raft_consensus.cc:697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:13.978163 18936 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:13.978754 18855 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:13.980618 13103 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:13.915118 18466 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.982672 13103 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:13.913465 18901 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:13.993995 18901 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:13.976038 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 47522.6us
W20260709 12:21:13.953110 18918 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:21:13.985875 18684 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:13.991704 18773 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:13.992218 13881 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:21:13.952672 18382 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:21:13.993412 18949 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:21:13.926831 18307 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:13.996414 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:13.890643 18780 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:13.931075 18942 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:13.953825 18950 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:13.954109 18837 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:21:14.025276 18952 log.cc:927] Time spent T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:21:14.027329 13211 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:14.027614 18958 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:14.028968 18935 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.029306 18883 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.062893 18946 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:14.030879 18600 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.009936 18683 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:14.036893 18873 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:14.066984 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 139790us
I20260709 12:21:14.037338 18420 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:13.959348 18941 consensus_queue.cc:1059] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:21:14.039021 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:14.048275 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:14.053555 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 57239.4us
I20260709 12:21:14.058431 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:14.056988 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 104496us
I20260709 12:21:14.000010 18936 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.045691 18846 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:14.062000 18958 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.000837 18466 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.047137 18557 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:14.073786 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:14.046890 18961 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:14.063306 18946 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:14.078193 13209 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 17: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:14.053098 18382 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.073729 18535 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.058838 18950 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.080670 13103 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:14.182548 18951 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:21:14.183054 18836 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.054380 18773 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.183652 18825 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:14.183868 18957 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:21:14.184113 18950 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.060179 18942 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.080505 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.185302 18773 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.186074 18557 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:14.186532 18942 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.183709 18836 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:14.187536 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 113835us
W20260709 12:21:14.187714 18956 log.cc:927] Time spent T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:21:14.188297 13838 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:14.188832 18836 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.189376 18836 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:14.189867 18836 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.189288 18946 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.190209 18836 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:14.190619 18946 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:21:14.191715 18965 log.cc:927] Time spent T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:21:14.191928 18967 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:14.193040 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.194298 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.194892 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.072292 18683 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.195870 18683 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:14.196185 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.197546 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:14.198390 13281 raft_consensus.cc:2410] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:21:14.198789 18936 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.178498 18901 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.186606 18557 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.176955 18324 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:14.200392 18324 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.201661 18557 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.199292 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.202452 18324 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:14.182950 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 102365us
I20260709 12:21:14.082756 18962 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.129s
I20260709 12:21:14.102806 18961 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.205406 18961 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:14.206820 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:14.191347 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.209865 18947 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:14.210549 18958 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.210367 18947 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.211378 18466 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.091935 18846 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.212563 18947 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:14.212848 18813 consensus_meta.cc:287] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.000s
I20260709 12:21:14.054795 18307 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.213670 18846 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.213600 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:14.215049 18307 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.215301 18948 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:14.215541 18941 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.215894 18948 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.216099 18941 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.218116 18948 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.218174 18941 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.218758 18897 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.220165 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:14.220335 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.220423 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:14.220945 13881 raft_consensus.cc:2393] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 16: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:14.221058 13209 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
I20260709 12:21:14.222108 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:14.223728 18966 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.224555 18966 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.195586 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.226311 18382 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.076552 18959 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:14.226706 18966 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.232229 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:14.232694 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:14.232995 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.233270 13881 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:14.234309 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.235157 13881 raft_consensus.cc:1275] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:21:14.236081 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:14.236545 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:14.056803 18780 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.239739 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:14.239229 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 156992us
I20260709 12:21:14.253330 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:14.253994 13887 raft_consensus.cc:3055] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:14.254333 13887 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:14.234338 13281 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:14.295902 13252 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:14.060971 18837 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.319918 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:14.321121 13175 leader_election.cc:400] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
I20260709 12:21:14.308205 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:14.342928 13204 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:14.354034 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 95758.1us
I20260709 12:21:14.371948 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.373698 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.527122 13204 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 17.
I20260709 12:21:14.387907 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:14.255038 13887 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.400126 13841 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:14.401528 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.429694 18941 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:21:14.398191 18683 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.430835 18684 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:14.431520 18825 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:14.433022 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:21:14.560494 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 127547us
I20260709 12:21:14.560729 13887 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.438628 18897 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:14.405083 18367 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:21:14.353956 18940 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:14.440076 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:14.398190 18846 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:21:14.449981 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.480804 18837 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.400915 18790 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:14.485484 13881 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 19.
I20260709 12:21:14.487602 18780 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.218766 18836 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:14.552106 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 152055us
I20260709 12:21:14.557641 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.558015 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.558418 18966 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:14.566067 13209 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
W20260709 12:21:14.564613 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 176826us
I20260709 12:21:14.563143 18897 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
W20260709 12:21:14.582304 13841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.584738 13252 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:14.568203 18790 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.585922 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:14.565634 18969 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:14.585263 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.568645 18382 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:14.580910 18897 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:14.568300 18940 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:14.588706 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 233542us
I20260709 12:21:14.589390 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.590014 13841 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:14.594506 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.590669 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:14.601279 13209 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:14.601275 13207 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
I20260709 12:21:14.608543 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:14.609277 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 301170us
I20260709 12:21:14.610262 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.611414 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.614569 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:14.625288 18970 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:21:14.626166 18683 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.626852 18683 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:14.627048 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.616062 18855 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:21:14.629148 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.630260 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.627373 18683 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:14.632565 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.633356 18683 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.636499 18917 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:14.636960 18917 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:14.637344 18917 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:14.639962 18897 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.645208 18940 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.590657 18966 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.646056 18966 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.646576 18897 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.648234 18966 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.589274 18790 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:14.649855 13128 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:14.588961 18950 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:14.656425 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.659451 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:14.657007 13841 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:14.589092 18969 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:14.661958 13280 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:14.664779 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.661500 13129 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:14.657675 18946 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:14.663712 13840 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:14.670519 18836 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.671516 18836 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:14.671746 18969 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:14.671958 18836 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.672508 18836 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:14.674527 13841 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:14.675616 18802 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:14.675848 13841 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:14.676301 18802 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:14.676684 18802 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:14.677047 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:14.677670 18941 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:14.678248 18946 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:14.678572 13278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42730 (request call id 1225) took 1942 ms. Trace:
I20260709 12:21:14.679009 13278 rpcz_store.cc:276] 0709 12:21:12.736507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.166541 (+430034us) service_pool.cc:224] Handling call
0709 12:21:13.169120 (+  2579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.229232 (+ 60112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.229279 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:13.229336 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:21:13.229383 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.678355 (+1448972us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b54002756d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:14.678405 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.678519 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137610496}
I20260709 12:21:14.679662 18950 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.680151 18950 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:14.677055 18802 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:14.670650 18961 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.684820 13841 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:14.654857 13887 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:21:14.694052 13841 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:14.695025 18535 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:14.698601 13204 raft_consensus.cc:1240] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:14.704939 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:14.707939 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 122117us
I20260709 12:21:14.710148 13209 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 19.
I20260709 12:21:14.725379 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:14.726951 13206 raft_consensus.cc:1275] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:14.695803 18971 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:14.736296 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:14.722703 18535 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:14.741022 13880 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:21:14.735230 18948 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:14.741176 18829 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.743207 18382 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:21:14.767063 13203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36412 (request call id 1223) took 1720 ms (client timeout 1927 ms). Trace:
I20260709 12:21:14.767390 13204 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:21:14.767544 13203 rpcz_store.cc:269] 0709 12:21:13.047204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.049169 (+  1965us) service_pool.cc:224] Handling call
0709 12:21:14.766871 (+1717702us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400215cd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:14.767002 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884104960}
I20260709 12:21:14.764222 18979 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.774281 18684 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:14.774672 18979 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.774940 18684 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.777146 18979 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.753062 18948 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.777175 18684 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.778326 18790 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.749186 18981 consensus_queue.cc:1059] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:21:14.779458 18948 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.750859 18971 consensus_queue.cc:1048] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:21:14.760138 18945 consensus_queue.cc:1059] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:21:14.779855 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:14.780611 18945 raft_consensus.cc:3055] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:14.781015 18945 raft_consensus.cc:740] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:14.781841 18945 consensus_queue.cc:260] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.782984 18684 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:14.765298 18324 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:14.783778 18684 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.783946 18324 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.784281 18961 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.785885 18324 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.791172 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:14.845104 13249 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:14.783111 18945 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:14.864558 13175 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:14.839257 18684 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.874433 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:14.878564 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.880797 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.882984 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.867799 18969 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.897711 18969 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.903913 18382 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.886889 18777 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:14.856544 18979 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:14.913478 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.915277 18979 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.913746 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.868554 18894 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:14.913821 18974 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:14.917905 18894 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.918322 18894 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:14.918072 18974 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.920329 18974 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.921945 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:14.914737 18777 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.922721 13880 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:14.870646 18324 consensus_queue.cc:1048] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:21:14.887246 18977 raft_consensus.cc:3055] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:14.924206 18977 raft_consensus.cc:740] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:14.924912 18324 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:14.925031 18977 consensus_queue.cc:260] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.914139 18790 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.926262 18324 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:14.926630 18790 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:14.913026 18802 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.928737 18836 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.929471 18802 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.930133 13887 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:14.930809 18836 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:14.932017 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.933384 13883 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:21:14.933926 18897 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:14.934430 18897 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:14.936565 18897 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.938334 18777 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.939893 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:14.939914 18950 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.917399 18979 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.966523 13882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45944 (request call id 1412) took 1674 ms. Trace:
I20260709 12:21:14.971051 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:14.971256 13882 rpcz_store.cc:276] 0709 12:21:13.292541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.293538 (+   997us) service_pool.cc:224] Handling call
0709 12:21:13.395646 (+102108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.513648 (+118002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.513695 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:13.513776 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:13.513839 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.966212 (+1452373us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54007cf1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:14.966293 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.966463 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270767872}
I20260709 12:21:14.975023 13100 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:14.965212 18603 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.945822 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:14.992193 13135 raft_consensus.cc:2393] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:14.946657 13284 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:14.947045 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.947871 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:14.084676 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:14.983055 18897 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:14.987262 18950 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:14.944252 18894 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:14.989575 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:14.996919 13280 raft_consensus.cc:3060] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:14.987586 18966 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:14.999367 18966 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.000867 18600 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:14.990453 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:14.992900 13137 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:14.995877 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:42730 (request call id 1223) took 2257 ms. Trace:
I20260709 12:21:15.001905 13281 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:15.002712 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 128358us
I20260709 12:21:15.005635 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:15.010749 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:15.001891 13284 rpcz_store.cc:276] 0709 12:21:12.735229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.093720 (+358491us) service_pool.cc:224] Handling call
0709 12:21:13.637479 (+543759us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54004088d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e84a3d 00007f70f9e54cd0 00007f70f33d9254 00007f70f33d91e2 00007f70f33d9111 00007f70f33d908c 00007f70f33d8342 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:14.946502 (+1309023us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b4c002ecc80. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f3159a20 00007f70f316aa29 00007f70f316b13f 00007f70f312f2ab 00007f70f315cf3c 00007f70f315d3fe 00007f70f33ea88b 00007f70f4de9495 00007f70f4e3a30f 00007f70f4e84a55 00007f70f9e54cd0
0709 12:21:14.992659 (+ 46157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714833920}
I20260709 12:21:15.014971 18727 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:15.015187 18979 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:15.016603 18894 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:15.018893 13133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1869) took 1399 ms. Trace:
I20260709 12:21:15.022581 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:15.033125 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 314874us
I20260709 12:21:15.033303 13278 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:21:15.035185 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.036330 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.032071 13133 rpcz_store.cc:276] 0709 12:21:13.619542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.648873 (+ 29331us) service_pool.cc:224] Handling call
0709 12:21:13.649244 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.860639 (+211395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.860672 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:13.860728 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:13.860758 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.018671 (+1157913us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400061b54. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:15.018715 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.018836 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483426688}
I20260709 12:21:15.035789 13211 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 11.
I20260709 12:21:15.036994 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:15.037784 13206 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:15.024058 13249 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:14.994536 18897 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:15.039106 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.039186 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:15.039978 13840 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:15.040809 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:15.045611 13203 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 18: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:15.047312 13249 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:15.021106 18966 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:15.020344 18993 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:15.028584 18950 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:15.056222 13280 raft_consensus.cc:2468] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:21:15.045604 18727 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:15.067646 18853 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:15.068222 18853 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.070475 18853 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:15.071226 13840 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:15.001461 18600 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.057288 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:15.038188 18953 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.021s	sys 0.004s
I20260709 12:21:15.059859 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:15.046250 18897 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:15.077641 13206 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:15.079603 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:15.080134 13211 raft_consensus.cc:2410] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 16 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:21:15.052762 18971 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.047770 18961 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:15.047760 18984 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:15.082278 18727 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:15.085405 18961 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:15.078022 18583 raft_consensus.cc:2804] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:21:15.078302 18953 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.022s	sys 0.004s
I20260709 12:21:15.061544 18978 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:15.097028 18600 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:15.036834 18979 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.089365 18583 raft_consensus.cc:697] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:15.094085 13286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2615) took 1443 ms. Trace:
I20260709 12:21:15.088812 13282 raft_consensus.cc:2955] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:15.104307 13286 rpcz_store.cc:276] 0709 12:21:13.650667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.093239 (+1442572us) service_pool.cc:224] Handling call
0709 12:21:15.093566 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.093752 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.093781 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:15.093828 (+    47us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:15.093866 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.093924 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.094028 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:15.105183 18727 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:15.108181 18727 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.110263 18727 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:15.112072 18583 consensus_queue.cc:237] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.112633 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:15.113304 13208 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:15.116142 13177 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:15.084971 18950 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:15.118757 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.072373 18917 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.088493 18961 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:15.124116 18382 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:15.124737 18382 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.104957 18937 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.126380 18937 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.126731 18999 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:15.127246 18999 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.128479 18937 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:15.129364 18999 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:15.130012 18324 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:15.130592 18324 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.088011 18971 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.119764 18367 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.133294 18367 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.134380 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.134629 18971 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:15.131199 18984 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:15.135478 18984 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.136533 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.137184 13279 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:15.137814 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.138381 13277 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:15.138900 18950 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.139518 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.139382 18950 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.140657 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:15.141594 18950 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:15.143833 18830 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:15.144237 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.144330 18830 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.144949 13279 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:15.145812 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.146401 13279 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:15.146481 18830 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:15.146976 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.147303 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:15.148881 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:15.147311 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.135098 13280 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 18: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:15.147807 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.153043 18977 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:15.156141 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.158056 13280 raft_consensus.cc:1240] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 12:21:15.150518 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 715727us
I20260709 12:21:15.161260 13838 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:15.162969 18802 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:15.171789 13278 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 11.
I20260709 12:21:15.176964 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:15.177771 13133 raft_consensus.cc:3060] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:21:15.178293 18324 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:15.180001 18367 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:15.182394 13840 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:15.183985 18947 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:15.184442 18947 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.184854 18947 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:15.189759 18934 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:21:15.198832 13208 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 17.
I20260709 12:21:15.199613 13280 raft_consensus.cc:1240] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:15.200218 13838 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:15.201994 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.202615 13278 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 17.
I20260709 12:21:15.202035 18802 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:15.203352 18917 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:15.203672 18802 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:15.204145 18802 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:15.204859 18979 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:15.206374 18940 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.206732 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:15.206902 18940 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.201642 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.207969 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.209304 18940 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:15.201644 13838 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:15.210386 18971 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:15.210613 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.211823 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:15.212646 13205 raft_consensus.cc:2393] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
W20260709 12:21:15.219620 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 103607us
I20260709 12:21:15.220415 13177 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:15.222391 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.222555 13252 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:15.226598 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:15.227674 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.228125 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.228461 13281 raft_consensus.cc:2468] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
I20260709 12:21:15.229383 13285 raft_consensus.cc:1240] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 15. Current term is 16. Ops: []
W20260709 12:21:15.211977 13178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.245404 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.246131 13212 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:21:15.236291 13840 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:15.254191 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.255151 13208 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:15.250413 13841 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:15.258931 13203 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:15.261940 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.263365 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.264757 13206 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:15.266117 13252 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:15.269785 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:15.270567 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 49196.7us
I20260709 12:21:15.213081 18802 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.272998 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.274631 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:15.122795 18975 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:15.248950 18324 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.282120 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.283572 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.288112 13133 raft_consensus.cc:2468] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 18.
I20260709 12:21:15.288146 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.298769 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.292313 18324 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.300762 13881 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:15.302158 13280 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:15.303381 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.264321 18631 raft_consensus.cc:2804] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:15.262145 18979 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:15.258337 18953 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:15.304616 13252 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:15.277665 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:15.329772 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.329365 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.331892 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.331416 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.314066 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.269375 18830 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:15.415419 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.255873 18367 consensus_queue.cc:1059] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:21:15.411084 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:15.424356 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 122075us
I20260709 12:21:15.412845 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:15.425099 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 147500us
I20260709 12:21:15.264904 18848 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:21:15.414620 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.400208 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.265537 18966 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 12:21:15.415773 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.428368 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:15.429320 13133 raft_consensus.cc:2393] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 18: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:15.419592 13279 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 8.
I20260709 12:21:15.353420 13887 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:15.266655 18948 raft_consensus.cc:2804] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:15.271126 18780 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:15.423652 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 123614us
I20260709 12:21:15.386453 18382 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:15.405037 18324 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:15.413678 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.267036 18669 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:15.458460 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.458933 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.426734 13281 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:21:15.421355 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.432031 13177 leader_election.cc:400] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
I20260709 12:21:15.463232 13177 leader_election.cc:403] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:21:15.432911 13886 raft_consensus.cc:1240] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:21:15.434531 18830 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:15.404255 19000 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:21:15.437291 18600 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:15.438504 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.439394 13029 catalog_manager.cc:5697] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:15.441021 13175 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:15.441699 18536 raft_consensus.cc:3055] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:15.420581 18631 raft_consensus.cc:697] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:15.290577 18944 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:15.297762 18978 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:15.309213 18975 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.332250 18999 consensus_queue.cc:1059] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
I20260709 12:21:15.291581 18872 consensus_queue.cc:1059] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.158s
I20260709 12:21:15.453715 18979 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 19 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:15.471213 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.473388 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.475389 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.477850 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:15.481395 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.332332 18825 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:15.484210 13177 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:21:15.557358 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 73521.6us
I20260709 12:21:15.558018 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.558668 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:21:15.523856 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 84414.6us
I20260709 12:21:15.559731 18324 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:15.561290 13177 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:15.524192 18937 raft_consensus.cc:2804] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:15.502557 18669 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.567755 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.572669 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.452308 18917 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:15.450611 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:15.630811 13131 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:15.482527 18603 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
I20260709 12:21:15.573107 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.573887 18825 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.574831 18324 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.576462 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:15.503011 18948 raft_consensus.cc:697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 17 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:15.622845 18999 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:21:15.607280 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 46058.1us
I20260709 12:21:15.644484 13177 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:15.614854 18848 raft_consensus.cc:3055] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:15.522720 18600 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:15.571944 18631 consensus_queue.cc:237] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.527961 18536 raft_consensus.cc:740] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:15.534912 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:15.539915 18978 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.625384 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:15.628985 18937 raft_consensus.cc:697] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:21:15.627146 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 349023us
I20260709 12:21:15.626602 13211 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:21:15.629580 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 332125us
I20260709 12:21:15.632648 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.634316 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:15.632652 13252 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:15.641247 13883 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:15.618244 18940 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:15.544987 18944 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.660990 13103 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:15.658095 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:15.739393 13885 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.024s
W20260709 12:21:15.630623 18583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.002s
W20260709 12:21:15.743785 13885 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.000s	sys 0.024s
I20260709 12:21:15.697969 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:21:15.747144 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 86268us
I20260709 12:21:15.639822 18959 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:21:15.657070 18897 consensus_meta.cc:287] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 12:21:15.752736 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:21:15.754084 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 121532us
I20260709 12:21:15.754487 18324 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:15.755311 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.773671 13134 raft_consensus.cc:2410] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:21:15.653493 18848 raft_consensus.cc:740] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:15.657475 18600 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:15.641477 18894 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.653338 18968 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:15.653100 18999 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:21:15.750334 18583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.010s	sys 0.002s
I20260709 12:21:15.659281 18917 raft_consensus.cc:697] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:15.738850 18978 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:15.743202 18367 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:15.785804 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:21:15.790184 13284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.006s	sys 0.028s
W20260709 12:21:15.873960 13284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.007s	sys 0.028s
I20260709 12:21:15.790628 18324 consensus_queue.cc:1059] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:15.782058 18830 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:15.812840 18780 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:15.810886 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:15.816035 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:15.747188 18856 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:15.773521 18991 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:15.820410 13103 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:15.774473 19004 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:15.814419 18977 consensus_meta.cc:287] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.000s
W20260709 12:21:15.798167 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 162060us
W20260709 12:21:15.875799 18989 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:21:15.739864 18940 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:15.781445 18897 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:15.897550 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 155735us
I20260709 12:21:15.900349 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:15.906929 13249 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.163.4:37379 timed out after 1.814s (SENT) [suppressed 3 similar messages]
I20260709 12:21:15.875236 18324 raft_consensus.cc:3055] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:21:15.908275 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 87951.1us
I20260709 12:21:15.783762 18846 consensus_queue.cc:1059] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.109s
I20260709 12:21:15.865634 18999 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:15.810810 18802 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:15.912909 19004 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.923552 18940 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:15.893832 18991 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:15.925724 18944 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:15.784091 18948 consensus_queue.cc:237] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.893569 18937 consensus_queue.cc:237] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:15.893889 18536 consensus_queue.cc:260] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.928282 13283 raft_consensus.cc:2410] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:21:15.930927 13131 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:15.782334 18959 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.937592 13249 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:16.037359 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 99844.5us
I20260709 12:21:16.038205 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.039397 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:15.953774 18324 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:15.931216 18669 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:15.924244 18825 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:15.973243 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.819653 18894 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:15.981338 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:16.051216 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:15.986241 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 331967us
I20260709 12:21:15.931617 18964 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:16.007877 13129 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:15.944299 18777 raft_consensus.cc:3055] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:16.005563 18991 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:15.963454 18975 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:15.963797 19003 log.cc:927] Time spent T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.298s	user 0.001s	sys 0.001s
I20260709 12:21:15.953377 18977 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:16.032845 19012 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:16.041786 18382 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:16.039047 18959 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.058213 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.972419 18984 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.059020 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:15.774045 18979 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.066876 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:15.964229 19005 log.cc:927] Time spent T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:21:16.070149 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:16.059577 18777 raft_consensus.cc:740] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:16.073599 18324 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.080433 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:16.055217 18961 consensus_meta.cc:287] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.912s	user 0.010s	sys 0.001s
I20260709 12:21:15.981690 18856 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:21:16.091418 13211 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:16.137041 18324 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:16.067832 19002 log.cc:927] Time spent T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:16.098760 13286 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:16.070535 18981 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:16.127326 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:16.140769 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:16.133973 18978 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.167707 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:16.093214 19030 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.113523 18993 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:16.148830 18961 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.186364 18961 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:16.187665 13880 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 14. Current term is 15. Ops: []
W20260709 12:21:16.211522 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 67711.8us
I20260709 12:21:16.179463 18975 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:16.213032 18975 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:16.216506 19015 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:21:16.046001 18917 consensus_queue.cc:237] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:16.097600 18977 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.279397 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:21:16.286355 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 316913us
I20260709 12:21:16.287282 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:16.289494 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 250150us
I20260709 12:21:16.291087 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.292400 13249 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.293191 18324 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:16.295612 13249 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.297621 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.298913 13249 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.299810 18382 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:16.302030 13281 raft_consensus.cc:1275] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:16.304347 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.304997 13884 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:16.277412 18966 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:16.309386 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:16.310643 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:16.300988 13249 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.311852 18324 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:16.310883 13131 raft_consensus.cc:1240] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:16.319603 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.320468 13885 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:16.320544 13249 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.321749 18324 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:16.297230 18981 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:16.324949 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.301389 18993 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:16.326876 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:16.301457 18984 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:16.312112 18836 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.312988 18966 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
W20260709 12:21:16.316431 19028 log.cc:927] Time spent T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:21:16.336318 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.354815 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:16.325532 18947 consensus_meta.cc:287] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 1.138s	user 0.009s	sys 0.004s
I20260709 12:21:16.204097 19030 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.317451 19004 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:16.374171 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:16.376991 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
W20260709 12:21:16.381780 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 54989.2us
I20260709 12:21:16.382550 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.285360 18777 consensus_queue.cc:260] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.386178 13209 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:16.351316 18975 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.361536 19017 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:21:16.395488 19035 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:16.396097 19035 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.398679 19035 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.399749 18894 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.402215 13175 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:16.404096 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:16.405433 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:16.403329 13102 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:16.419047 13102 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:16.419118 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:16.380677 19021 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:16.425868 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:16.426048 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:16.393055 18953 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:16.429942 13102 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:16.412113 18894 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:16.434041 18894 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:16.433846 19031 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:21:16.434487 18894 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:16.374961 18947 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.438460 13102 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:16.435196 18978 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.409967 18885 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:16.375979 18836 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.475803 13177 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:16.478394 18836 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:16.535174 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 166191us
I20260709 12:21:16.412060 19024 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:16.418119 18831 consensus_queue.cc:1059] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:21:16.428009 18974 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:16.540933 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:16.423520 18777 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:16.440779 18367 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:16.542773 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 67074.5us
I20260709 12:21:16.543282 13277 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:21:16.546928 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.549180 13881 raft_consensus.cc:2393] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 13: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:16.435860 18837 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:16.548794 13840 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:21:16.563655 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 125252us
I20260709 12:21:16.564756 13838 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.479377 19021 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:16.566480 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:16.532965 18684 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:21:16.611627 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 47220.6us
W20260709 12:21:16.612092 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 220519us
I20260709 12:21:16.543329 18246 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.619531 13102 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:16.543045 18974 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:16.542472 19041 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:16.539698 18953 consensus_queue.cc:1059] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
W20260709 12:21:16.629671 19014 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:21:16.616215 19024 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:16.610298 19036 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:16.601388 19046 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.618321 18978 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.627592 18974 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:16.568362 19034 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:16.629971 18836 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:21:16.646920 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 221165us
I20260709 12:21:16.632050 18977 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.637387 19024 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.636565 19056 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:16.655853 19045 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:16.626048 18246 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.658277 18246 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.653579 19036 raft_consensus.cc:3055] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:16.653442 18846 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:16.661697 19038 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:16.661022 18977 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:16.663606 18977 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.666158 18977 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.666709 19036 raft_consensus.cc:740] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:21:16.649686 18600 consensus_meta.cc:287] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.830s	user 0.012s	sys 0.000s
I20260709 12:21:16.651149 19046 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:16.658634 18848 consensus_queue.cc:260] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.641696 18684 consensus_queue.cc:1059] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:21:16.691545 18947 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:16.654240 19035 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:16.655522 19024 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:16.696249 13285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3354) took 1366 ms. Trace:
I20260709 12:21:16.675766 19056 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:21:16.696394 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 130045us
I20260709 12:21:16.698520 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:16.699874 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.700450 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:16.647114 18978 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.697925 13285 rpcz_store.cc:276] 0709 12:21:15.330028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.413632 (+ 83604us) service_pool.cc:224] Handling call
0709 12:21:15.414050 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:15.414528 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.414571 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:15.426840 (+ 12269us) log.cc:844] Serialized 52 byte log entry
0709 12:21:15.773066 (+346226us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:15.773109 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.773182 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:16.695982 (+922800us) raft_consensus.cc:1685] finished
0709 12:21:16.696011 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.696186 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4445,"raft.queue_time_us":746,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8716,"thread_start_us":218881,"threads_started":1,"wal-append.queue_time_us":799822}
I20260709 12:21:16.703240 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:16.704270 19039 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:16.704839 19039 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.705273 19039 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:16.709126 13252 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.710624 18367 raft_consensus.cc:3055] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:16.711097 18367 raft_consensus.cc:740] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:16.712013 18367 consensus_queue.cc:260] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:16.713348 18367 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:16.714671 18940 consensus_meta.cc:287] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.000s
I20260709 12:21:16.717299 19034 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:16.695636 19036 consensus_queue.cc:260] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.719055 19036 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:16.722035 19055 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:16.722590 19055 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:16.695765 19030 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:16.702441 19035 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:16.725052 19055 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:16.726429 19035 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:16.695025 18977 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.727504 18977 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.728293 19046 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:16.729768 18977 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.695084 18848 raft_consensus.cc:3060] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:16.730549 18978 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.736148 18894 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.689440 18600 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.742204 18600 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.743410 13203 raft_consensus.cc:1240] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:16.703001 19056 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:16.744290 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:16.745450 13129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2500) took 1182 ms. Trace:
I20260709 12:21:16.745803 13129 rpcz_store.cc:276] 0709 12:21:15.562748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.562886 (+   138us) service_pool.cc:224] Handling call
0709 12:21:15.563165 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:16.052816 (+489651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.745214 (+692398us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54001f4ad4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:16.745393 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022304128}
I20260709 12:21:16.737950 19050 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:16.747788 19050 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.748894 13882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 1026) took 1321 ms. Trace:
I20260709 12:21:16.749307 13882 rpcz_store.cc:276] 0709 12:21:15.429994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.438186 (+  8192us) service_pool.cc:224] Handling call
0709 12:21:16.748674 (+1310488us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54005f0354. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:16.748837 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971135360}
I20260709 12:21:16.750787 19050 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.752355 13887 raft_consensus.cc:1240] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 17 LEADER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:16.738659 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.738970 18917 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:16.755129 19013 log.cc:927] Time spent T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.463s	user 0.001s	sys 0.002s
I20260709 12:21:16.739456 18981 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:21:16.777081 19019 log.cc:927] Time spent T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.706s	user 0.000s	sys 0.009s
I20260709 12:21:16.778411 13284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38644 (request call id 3337) took 1623 ms. Trace:
I20260709 12:21:16.778813 13284 rpcz_store.cc:276] 0709 12:21:15.155523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.227155 (+ 71632us) service_pool.cc:224] Handling call
0709 12:21:15.227509 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.258774 (+ 31265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.258805 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:15.259332 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:21:15.874398 (+615066us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:15.874441 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.874518 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:16.754414 (+879896us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b4400022b4c. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1cc6c85 00007f70f1cc76a2 00007f70f4a391db 00007f70f4a34aaf 00007f70f4a2886e 00007f70f4a27bb6 00007f70f4a277d8 00007f70f4a31221 00007f70f4a311d9 00007f70f4a31169
0709 12:21:16.778109 (+ 23695us) raft_consensus.cc:1685] finished
0709 12:21:16.778144 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.778349 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30889,"raft.queue_time_us":36365,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10420,"spinlock_wait_cycles":58558720,"thread_start_us":614718,"threads_started":1,"wal-append.queue_time_us":920839}
I20260709 12:21:16.715114 18940 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:16.782516 18940 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:16.726529 18999 consensus_meta.cc:287] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.745s	user 0.012s	sys 0.000s
I20260709 12:21:16.783349 18999 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.785666 18999 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.786475 13205 raft_consensus.cc:2393] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 14: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:16.788933 13206 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:16.794948 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:16.756654 18966 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:16.739610 18991 consensus_meta.cc:287] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.002s
I20260709 12:21:16.809724 18966 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:16.765771 18894 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.822324 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.823900 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:16.825296 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:16.766798 19024 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.825965 13205 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 19.
I20260709 12:21:16.826311 13883 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 14. Current term is 15. Ops: []
W20260709 12:21:16.770232 13283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38658 (request call id 2622) took 1631 ms (client timeout 2108 ms). Trace:
W20260709 12:21:16.826939 13283 rpcz_store.cc:269] 0709 12:21:15.138380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.140429 (+  2049us) service_pool.cc:224] Handling call
0709 12:21:16.769998 (+1629569us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54002657d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:16.770172 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1775548160}
I20260709 12:21:16.824545 13206 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:16.827417 19024 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:16.829144 19009 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.901s	user 0.000s	sys 0.005s
I20260709 12:21:16.765004 18829 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:16.830828 18536 raft_consensus.cc:3060] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:16.840665 19006 log.cc:927] Time spent T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.913s	user 0.007s	sys 0.000s
I20260709 12:21:16.836231 13203 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:16.843360 18829 raft_consensus.cc:3055] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:16.843809 18829 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:16.843981 19039 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.774528 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:16.844730 18829 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.809520 18991 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.846478 19039 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.847369 18991 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.848161 13279 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:16.851367 19017 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
W20260709 12:21:16.853778 13103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.854693 19024 consensus_queue.cc:1048] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:16.855990 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:16.851907 19017 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.817930 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.864990 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:16.865957 13282 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 15: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:16.820384 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.866966 13886 raft_consensus.cc:2368] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:21:16.865942 19017 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:16.820884 18802 consensus_queue.cc:1059] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:16.868477 18802 raft_consensus.cc:3055] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:16.868824 13132 raft_consensus.cc:2468] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 17.
I20260709 12:21:16.868876 18802 raft_consensus.cc:740] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:16.870071 13132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 1158) took 1098 ms. Trace:
I20260709 12:21:16.869973 18802 consensus_queue.cc:260] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.870493 13132 rpcz_store.cc:276] 0709 12:21:15.771915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.772064 (+   149us) service_pool.cc:224] Handling call
0709 12:21:16.869905 (+1097841us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54003cf0d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:16.870015 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228908416}
I20260709 12:21:16.821732 18780 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:16.871865 18780 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:16.856668 13280 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:16.858155 19032 log.cc:927] Time spent T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.469s	user 0.001s	sys 0.000s
I20260709 12:21:16.881848 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:16.859783 13278 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:16.833472 13881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45928 (request call id 1032) took 1261 ms. Trace:
I20260709 12:21:16.889027 13881 rpcz_store.cc:276] 0709 12:21:15.572325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.572432 (+   107us) service_pool.cc:224] Handling call
0709 12:21:16.833274 (+1260842us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54004560d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:16.833413 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118130432}
I20260709 12:21:16.861408 13277 raft_consensus.cc:1275] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:16.861399 18885 raft_consensus.cc:3055] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:16.890327 18885 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:16.891475 18885 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.892800 18885 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:16.836392 18897 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:16.862257 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:16.895210 19056 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:16.896554 18829 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:16.896047 13029 catalog_manager.cc:5697] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 6 to 10, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 10 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:16.900278 18802 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:16.900858 13838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:16.813588 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.910037 13841 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:16.911923 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:16.911984 18964 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:21:16.914656 18964 raft_consensus.cc:3055] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:16.915133 18964 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
W20260709 12:21:16.915851 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 177306us
I20260709 12:21:16.916603 13252 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.916282 18964 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.917491 19046 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:16.917963 18964 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:16.918195 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:16.919166 19046 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:16.915179 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 295718us
I20260709 12:21:16.920224 19055 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:16.921730 19017 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:16.922224 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:16.923126 19055 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:16.922307 19017 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.924319 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:16.939680 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:16.940501 13880 raft_consensus.cc:2393] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 12: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:16.940708 13102 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:16.941277 18944 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:16.926113 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 63372.2us
I20260709 12:21:16.927543 18946 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:16.941674 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:16.941890 18944 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:16.942346 13279 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:16.928580 19017 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:16.929316 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:16.927923 19008 consensus_queue.cc:1048] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:16.942981 19055 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:16.931623 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.943727 19055 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:16.928799 19046 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:16.932863 19059 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:16.944888 18825 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:16.946156 18897 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:16.945228 19059 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:16.946476 13881 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:16.946636 18897 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:16.947633 18897 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:16.948287 19059 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:16.949483 13281 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:21:16.932379 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.934793 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:16.935087 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:16.935750 19044 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:16.950598 13886 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:21:16.936846 13887 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:16.950870 13286 raft_consensus.cc:2368] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 12. Current term is 13.
I20260709 12:21:16.937484 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:16.950853 19044 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:16.938578 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:16.953420 19044 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:16.955987 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.956298 18897 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:16.958307 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:16.958639 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:16.958915 13282 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:16.959226 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:16.959517 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:16.959807 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:16.960690 13136 raft_consensus.cc:2410] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:21:16.961202 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.961776 13135 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:21:16.933768 19056 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:16.942356 18944 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:16.964264 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.964988 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:16.965826 13134 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:16.964213 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:21:16.967602 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49472.4us
W20260709 12:21:16.968257 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 55071.6us
I20260709 12:21:16.968999 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:16.969614 13881 raft_consensus.cc:2376] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 19. Re-sending same reply.
I20260709 12:21:16.972543 13280 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:16.772496 18974 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:16.939165 13177 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:16.983165 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 44088.5us
W20260709 12:21:16.991662 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 81727.5us
I20260709 12:21:17.001485 13130 raft_consensus.cc:2410] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:21:17.014529 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:16.992177 13177 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:17.000464 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.013497 13840 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:17.074334 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.180094 13128 raft_consensus.cc:1275] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:21:17.084924 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:17.229473 13128 pending_rounds.cc:85] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 8
I20260709 12:21:17.230008 13128 pending_rounds.cc:107] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:21:17.230469 13128 raft_consensus.cc:2889] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.021235 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:17.230721 13878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:17.084200 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:17.179287 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:21:17.068874 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 185559us
I20260709 12:21:17.142818 13249 leader_election.cc:400] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:21:17.055751 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60854 (request call id 1159) took 1270 ms. Trace:
I20260709 12:21:17.083761 13884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:17.084581 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:17.232774 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 90118.7us
I20260709 12:21:17.081012 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:17.233686 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:17.233995 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:17.232553 13130 rpcz_store.cc:276] 0709 12:21:15.785187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.785436 (+   249us) service_pool.cc:224] Handling call
0709 12:21:17.055513 (+1270077us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540010d6d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:17.055677 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592505600}
I20260709 12:21:17.233186 13884 raft_consensus.cc:2368] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:21:17.235055 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.030431 13206 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:17.053499 13205 raft_consensus.cc:1240] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:17.076473 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.046628 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:17.191054 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:17.242316 13283 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:17.081880 13879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:17.246778 13879 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:17.020079 13279 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:17.078588 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.021632 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.080053 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:17.250773 13887 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:17.080693 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:17.076048 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.034116 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.259617 13207 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:17.260037 13885 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
W20260709 12:21:17.257771 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 244368us
W20260709 12:21:17.264777 13175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.272490 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.059970 18981 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:17.274899 18324 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:17.005759 19059 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:16.986019 19051 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:17.286374 13249 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:17.133069 18974 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:17.286762 13132 raft_consensus.cc:1275] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:17.278569 13838 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:17.295192 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.338696 13175 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:17.296672 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.339195 19045 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:21:17.340914 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 44315us
I20260709 12:21:17.341405 19045 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:17.341768 13249 leader_election.cc:400] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:21:17.342160 13249 leader_election.cc:403] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:21:17.339658 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 61193.6us
W20260709 12:21:17.298906 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 306815us
I20260709 12:21:16.992925 18975 consensus_queue.cc:1059] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.295s
I20260709 12:21:17.264252 18583 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:17.295954 18940 raft_consensus.cc:2764] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:21:17.048735 19017 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.241s
I20260709 12:21:17.126108 19056 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:17.290634 19059 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.296746 18984 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:17.264173 18848 consensus_queue.cc:1059] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:21:17.356114 18979 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:21:17.301961 18991 raft_consensus.cc:2764] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 19 LEADER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:21:17.297101 19024 consensus_queue.cc:1048] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:21:17.169971 19030 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:17.291939 18981 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:17.321852 13883 raft_consensus.cc:2468] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:17.331360 13887 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:17.174839 18944 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:17.340018 18966 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:17.341812 19045 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.259527 19039 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:21:17.369273 19059 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:17.361441 19064 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:17.387095 19045 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:17.390050 19069 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:21:17.369472 19056 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:17.384624 19030 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.401152 19063 raft_consensus.cc:3055] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:17.401247 18962 raft_consensus.cc:3055] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:17.401455 19030 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:17.401806 19063 raft_consensus.cc:740] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:17.401860 18962 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:17.401953 18981 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:17.402925 18962 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:17.402925 19063 consensus_queue.cc:260] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.404341 18962 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:17.175086 13029 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 7 to 11, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 11 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:17.306782 13033 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42062 (request call id 295) took 61851 ms (client timeout 15000 ms). Trace:
W20260709 12:21:17.440475 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.440157 13129 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:17.557018 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:21:17.557828 13100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.443713 13102 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:17.452071 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 111458us
W20260709 12:21:17.453470 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 109259us
I20260709 12:21:17.480517 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.482235 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.483705 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.485173 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.478577 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:17.496857 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 119427us
I20260709 12:21:17.497243 13882 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
W20260709 12:21:17.498042 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 276528us
I20260709 12:21:17.503587 18536 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:17.401458 19056 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:17.404404 19063 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:17.541756 13286 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:17.542790 18944 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:17.585044 18536 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.518321 19045 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.590184 19045 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:17.544875 18872 consensus_queue.cc:1048] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:21:17.591728 18367 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:17.551858 13207 raft_consensus.cc:1240] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:17.593677 18780 consensus_meta.cc:287] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.721s	user 0.010s	sys 0.005s
I20260709 12:21:17.594249 18780 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:17.598157 13029 catalog_manager.cc:5697] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
W20260709 12:21:17.594990 18829 consensus_meta.cc:287] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.007s
I20260709 12:21:17.602780 13249 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.605957 13177 leader_election.cc:400] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 12. Current term is 13.
I20260709 12:21:17.621353 13177 leader_election.cc:403] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:21:17.606706 19051 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:17.622431 13277 raft_consensus.cc:1240] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:21:17.622774 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:17.609319 13282 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:17.613142 18536 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:17.613868 19059 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:17.619028 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 176004us
I20260709 12:21:17.607968 13280 raft_consensus.cc:2368] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 17. Current term is 18.
W20260709 12:21:17.623915 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 46342.4us
I20260709 12:21:17.629246 13881 raft_consensus.cc:2368] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 19. Current term is 20.
I20260709 12:21:17.629446 13208 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:17.639220 18944 consensus_queue.cc:1059] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:17.644383 18981 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:17.556007 13033 rpcz_store.cc:269] 0709 12:20:15.451798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.451998 (+   200us) service_pool.cc:224] Handling call
0709 12:21:17.303180 (+61851182us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:09.555682 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:09.566205 (+ 10523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:09.566280 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:21:09.566319 (+    39us) tablet.cc:662] Decoding operations
0709 12:21:09.567492 (+  1173us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:09.567574 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:09.567601 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:21:09.568223 (+   622us) tablet.cc:701] Row locks acquired
0709 12:21:09.568276 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:21:09.568443 (+   167us) write_op.cc:270] Start()
0709 12:21:09.568583 (+   140us) write_op.cc:276] Timestamp: P: 1783599669568370 usec, L: 0
0709 12:21:09.568624 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:21:09.691200 (+122576us) log.cc:844] Serialized 2754 byte log entry
0709 12:21:09.894498 (+203298us) op_driver.cc:464] REPLICATION: finished
0709 12:21:10.059777 (+165279us) write_op.cc:301] APPLY: starting
0709 12:21:10.059895 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:10.126712 (+ 66817us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:10.126880 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:10.383078 (+256198us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:10.422978 (+ 39900us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:21:10.444550 (+ 21572us) write_op.cc:312] APPLY: finished
0709 12:21:10.534869 (+ 90319us) log.cc:844] Serialized 65 byte log entry
0709 12:21:10.535156 (+   287us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:10.535329 (+   173us) write_op.cc:454] Released schema lock
0709 12:21:10.535441 (+   112us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:10.536079 (+   638us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:10.536112 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":242757,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":164918,"apply.run_cpu_time_us":13927,"apply.run_wall_time_us":476281,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":296690,"prepare.run_cpu_time_us":43436,"prepare.run_wall_time_us":234956,"raft.queue_time_us":100805,"raft.run_cpu_time_us":13180,"raft.run_wall_time_us":90632,"replication_time_us":325687,"thread_start_us":327448,"threads_started":4,"wal-append.queue_time_us":92523,"wal-append.run_cpu_time_us":9053,"wal-append.run_wall_time_us":1769495}]]}
I20260709 12:21:17.651998 13132 pending_rounds.cc:85] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Aborting all ops after (but not including) 9
I20260709 12:21:17.652598 13132 pending_rounds.cc:107] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:21:17.652992 13132 raft_consensus.cc:2889] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.656797 13100 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.666349 19059 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:17.667344 18940 raft_consensus.cc:3060] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:17.672219 13102 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:17.672322 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:17.674204 19078 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:17.674407 13102 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:17.674973 19078 raft_consensus.cc:697] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:17.675729 18974 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:17.676296 18975 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:17.678218 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.641914 18944 raft_consensus.cc:3055] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:17.690255 18944 raft_consensus.cc:740] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:17.685685 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.686815 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.691787 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.688031 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.693259 13212 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:17.694677 19045 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.696098 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.697011 13206 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:17.699409 18536 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:21:17.702872 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 97294.5us
I20260709 12:21:17.704574 18780 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:17.706344 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:17.707595 13203 raft_consensus.cc:2393] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:17.708400 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.711745 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:17.709869 13205 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:17.711127 13029 catalog_manager.cc:5697] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 6 to 7, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 7 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:17.713191 19030 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:17.713640 19030 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:21:17.713515 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 111122us
I20260709 12:21:17.714179 19030 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:17.714720 13029 catalog_manager.cc:5697] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 8 to 13, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 13 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:17.715473 18981 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:17.711652 19045 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:17.722502 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:17.723397 13882 raft_consensus.cc:2393] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 14: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:17.724535 19045 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:17.717865 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.717939 18962 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:17.727669 19078 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.728724 19051 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:17.729363 19051 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:17.728055 13029 catalog_manager.cc:5697] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 5 to 9, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 9 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:17.730515 19051 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:17.732529 13211 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:21:17.731813 13029 catalog_manager.cc:5697] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 2 to 10, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 10 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:17.733345 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:17.740126 18848 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:17.740449 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.737707 18962 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:17.742419 18962 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:17.738345 18975 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:17.743659 18975 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:17.743626 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:17.744973 18975 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:17.745687 18872 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:17.746428 18975 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:17.748894 18962 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:17.740684 13029 catalog_manager.cc:5697] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:17.691756 18944 consensus_queue.cc:260] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.756359 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.757529 13281 raft_consensus.cc:2393] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 15: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:17.736174 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:17.771333 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:21:17.775137 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 69078.7us
I20260709 12:21:17.776907 18944 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:17.778452 13841 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:17.778823 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:17.780330 13029 catalog_manager.cc:5697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 5 to 8, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 8 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:17.791054 13209 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:21:17.791224 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.793632 13128 raft_consensus.cc:1275] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:21:17.795836 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:17.796682 13212 raft_consensus.cc:2368] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:21:17.798354 13100 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.797519 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.799285 18962 raft_consensus.cc:3060] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:17.767613 13249 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:17.800802 18981 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:17.801190 18981 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.801563 18981 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:17.803514 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 68364.2us
I20260709 12:21:17.804414 18946 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:17.804921 18946 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:17.805330 18946 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:17.809149 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:17.810456 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:17.811147 13881 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:17.812008 13252 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:17.812189 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:17.814826 19046 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:17.815763 18856 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:17.816501 18856 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.804350 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.791788 13029 catalog_manager.cc:5697] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 2 to 8, term changed from 8 to 10, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b190224a708b4f068a6dda4006c3a133 (127.11.163.3), VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1), VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2), VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 10 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:17.832787 13252 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:17.833695 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:17.834415 19064 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:17.834545 13135 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:17.835012 19064 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.833755 13881 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:17.839866 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.832923 18897 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:17.835551 19064 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:17.841774 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:17.860649 13175 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:21:17.865532 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 45660.1us
I20260709 12:21:17.866392 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:17.860370 18802 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.872094 18984 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:21:17.872514 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 68306.8us
I20260709 12:21:17.872995 18964 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.880791 18897 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.881361 19030 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.881847 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:17.868443 18856 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:17.885751 19059 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:21:17.893918 18964 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.884061 18802 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.896598 18964 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:17.897964 18802 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:17.903498 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:17.857563 19046 consensus_queue.cc:1059] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:21:17.906812 13205 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:17.907938 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:17.915927 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:17.916684 13881 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 17.
I20260709 12:21:17.883381 18897 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:17.918181 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:17.923902 19056 raft_consensus.cc:2804] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:17.929494 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.930312 13205 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
I20260709 12:21:17.931227 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:17.933190 13211 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
I20260709 12:21:17.934301 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:17.939980 19036 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.940721 19036 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.941431 18984 raft_consensus.cc:3055] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:17.941856 18984 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:17.944979 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:21:17.948020 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 107417us
I20260709 12:21:17.948465 18991 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:17.948892 18991 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:17.949097 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.949970 19045 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:17.951651 13175 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:17.952457 19045 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:17.952523 13102 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.953037 19045 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:17.954213 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:17.925153 18780 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:17.954187 19045 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.955493 18964 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:17.955821 13102 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:17.956915 19063 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:17.956346 18964 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:17.957469 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:17.959612 18897 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:17.960707 13102 leader_election.cc:400] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 17. Current term is 18.
I20260709 12:21:17.961102 13102 leader_election.cc:403] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:17.965045 19030 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:17.969952 18897 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 17. Current term is 18.
I20260709 12:21:17.942934 19036 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:17.971661 13102 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:17.974112 18897 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:17.949321 18991 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:17.971819 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:17.980657 13128 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:17.981886 19046 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:17.982764 18962 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:17.955721 18780 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:17.984762 18946 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.985953 18780 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:17.986119 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:17.942919 18984 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:17.986611 13029 catalog_manager.cc:5697] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 8 to 11, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 11 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:17.987551 19051 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:21:17.988709 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 71359.7us
I20260709 12:21:17.990013 13100 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:17.991650 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:21:18.003481 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 81178.7us
I20260709 12:21:18.006856 13103 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:18.009721 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:18.009079 19056 raft_consensus.cc:697] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:18.001737 18940 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 12. Current term is 13.
W20260709 12:21:18.014436 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 92164.6us
I20260709 12:21:18.017637 18964 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:18.018627 13880 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:21:18.019371 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:18.020478 13879 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:18.013648 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:18.015846 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:18.023344 13887 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 19.
I20260709 12:21:18.018637 18964 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.024530 18964 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.024895 19064 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.025692 18966 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:18.027597 18964 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:18.028234 19036 consensus_queue.cc:1048] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:18.029325 18984 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:18.004334 18897 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:18.037820 13252 leader_election.cc:400] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 12. Current term is 13.
I20260709 12:21:18.038323 13249 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:18.042670 13208 raft_consensus.cc:2468] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:17.991706 18981 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.067983 18981 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:18.068784 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:18.061156 18324 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:18.062094 19064 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:18.063266 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:18.064189 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:18.072011 13175 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:18.072118 13211 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 13.
I20260709 12:21:18.064911 18897 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:18.065328 19081 log.cc:927] Time spent T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 12:21:18.073378 13177 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:18.074106 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 60986.2us
I20260709 12:21:18.075049 19056 consensus_queue.cc:237] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.070847 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
W20260709 12:21:18.082469 19084 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:21:18.051604 18966 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.088600 13103 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:18.080436 18897 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:18.095738 13249 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:18.097224 13132 raft_consensus.cc:1240] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:18.098831 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:18.092969 18848 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:18.099965 18940 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:18.100904 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:18.100469 18991 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.102293 13129 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:18.093992 18324 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.113065 13136 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:18.113742 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:18.108080 18964 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.121165 18964 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.122846 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:18.123579 13205 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:18.123723 18964 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:18.124676 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:18.123603 19036 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:18.125298 13204 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:18.125600 19036 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.126089 19036 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:18.128297 19039 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:18.128686 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:18.128925 19039 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.133950 13205 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:18.134500 19039 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:18.146029 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:18.146076 13252 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:18.090907 18966 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:18.091812 18981 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:18.094368 19045 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:18.145622 13204 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:18.158555 19064 raft_consensus.cc:2804] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:18.159255 19064 raft_consensus.cc:697] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:18.160321 19064 consensus_queue.cc:237] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.165881 13175 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:18.148336 18848 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.180143 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:18.180997 13204 raft_consensus.cc:2368] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 15. Current term is 16.
I20260709 12:21:18.187801 18940 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:18.188324 13249 leader_election.cc:400] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 19. Current term is 20.
I20260709 12:21:18.188565 18991 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:18.191216 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:18.191972 13280 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.179451 18848 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:18.195811 18885 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:18.196288 18885 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:18.196688 18885 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:18.202831 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:18.202695 18829 consensus_queue.cc:1059] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:18.203670 18979 raft_consensus.cc:2804] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:18.204064 18829 raft_consensus.cc:3055] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:18.204468 18979 raft_consensus.cc:697] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:18.204499 18829 raft_consensus.cc:740] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:18.205858 18979 consensus_queue.cc:237] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.203763 18780 consensus_queue.cc:1059] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:18.207594 18780 raft_consensus.cc:3055] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:18.208005 18780 raft_consensus.cc:740] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:18.208606 19063 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:18.209079 18780 consensus_queue.cc:260] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.210626 18780 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.205813 18829 consensus_queue.cc:260] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.223119 13280 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 9.
I20260709 12:21:18.209244 19063 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.222030 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:18.239682 13129 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:18.239753 13278 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:18.190889 18991 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:18.258231 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:18.259037 13280 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
W20260709 12:21:18.265281 13102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.220929 18829 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:18.188344 18940 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:18.289443 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:18.256856 19045 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:18.298082 18324 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:18.305927 13129 raft_consensus.cc:3060] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:18.306264 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:18.271334 18981 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:18.313437 13128 raft_consensus.cc:2393] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 18: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:18.310217 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:18.315785 13880 raft_consensus.cc:3060] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:18.315054 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:21:18.320713 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 156076us
I20260709 12:21:18.323269 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:18.328188 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:18.319818 19039 raft_consensus.cc:3055] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:18.317710 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:18.334822 13252 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:18.321205 19045 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:18.340629 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:18.341059 13882 raft_consensus.cc:2393] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:18.341670 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:18.343816 18324 raft_consensus.cc:2804] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:18.334685 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:18.316354 19036 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.343153 19056 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:21:18.345440 13134 raft_consensus.cc:2393] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 9: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:18.346208 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:18.346846 19036 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:18.346907 13285 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 14.
I20260709 12:21:18.360889 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:18.361558 13136 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:21:18.332448 19039 raft_consensus.cc:740] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:18.368773 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:18.371332 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:18.371942 13887 raft_consensus.cc:3060] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:18.330696 18981 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.380324 18324 raft_consensus.cc:697] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:21:18.368417 19083 log.cc:927] Time spent T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:21:18.384683 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 56600us
W20260709 12:21:18.386401 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 68785.4us
I20260709 12:21:18.361874 19106 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:18.375902 19030 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:18.375694 18991 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:18.396750 13249 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:18.403859 19030 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.447002 18324 consensus_queue.cc:237] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:18.488221 19099 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 12:21:18.503885 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.524461 13206 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:21:18.533018 18981 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:18.534205 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:18.535292 13281 raft_consensus.cc:2393] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 14: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:18.537647 19063 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:18.538568 19045 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.541370 18940 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.396811 18964 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:18.596585 13129 raft_consensus.cc:2468] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:18.602084 13880 raft_consensus.cc:2468] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:18.575313 13136 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 20.
I20260709 12:21:18.608700 13132 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:18.620311 13175 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
W20260709 12:21:18.622540 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 225839us
I20260709 12:21:18.645808 19090 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.646189 19108 raft_consensus.cc:2804] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:21:18.646842 19108 raft_consensus.cc:697] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 20 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:18.648259 19088 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:18.647890 19108 consensus_queue.cc:237] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.648855 19088 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.646705 19090 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.653003 18848 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.654893 19090 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:18.655157 19105 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:18.658761 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:18.651095 19088 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:18.670354 18984 consensus_meta.cc:287] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.003s
I20260709 12:21:18.681605 18885 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.619695 18780 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.683621 18780 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.685374 19105 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:18.686288 18780 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:18.687927 13283 raft_consensus.cc:2410] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:21:18.688473 18964 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.691119 18964 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:18.691308 13136 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:21:18.694170 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:18.712930 13887 raft_consensus.cc:2468] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 20.
W20260709 12:21:18.723210 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 315811us
I20260709 12:21:18.724984 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:18.725800 13129 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
W20260709 12:21:18.718905 19064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.040s	sys 0.054s
I20260709 12:21:18.732834 13282 raft_consensus.cc:1240] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:18.733094 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:18.739691 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
W20260709 12:21:18.739933 18944 consensus_meta.cc:287] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.925s	user 0.012s	sys 0.003s
W20260709 12:21:18.739367 19064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.040s	sys 0.054s
W20260709 12:21:18.739723 18966 consensus_meta.cc:287] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.002s
I20260709 12:21:18.728345 19106 raft_consensus.cc:697] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:18.743335 18966 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.744441 19106 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.745610 18966 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:18.750257 19045 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:18.718561 19056 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:21:18.751711 19045 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.752158 19045 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:18.764146 13284 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:18.764990 18946 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:18.765774 13279 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:21:18.766173 13279 pending_rounds.cc:85] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 9
I20260709 12:21:18.766467 13279 pending_rounds.cc:107] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:21:18.766706 13279 raft_consensus.cc:2889] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:18.769235 13177 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:18.765923 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:18.770370 13285 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 13.
I20260709 12:21:18.775070 18885 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:18.737234 18897 consensus_meta.cc:287] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.001s
I20260709 12:21:18.776183 18897 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.778367 18897 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:18.792838 18940 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:18.797236 13131 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 18: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:18.801168 19030 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:18.804407 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:18.805246 13131 raft_consensus.cc:2368] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
W20260709 12:21:18.813511 13102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.017s
W20260709 12:21:18.813987 13102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.001s	sys 0.018s
W20260709 12:21:18.814260 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 506928us
I20260709 12:21:18.815352 13102 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:18.816227 18536 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:18.816694 18536 raft_consensus.cc:697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:18.817842 18536 consensus_queue.cc:237] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.823984 18872 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:18.824606 18872 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.830704 13175 leader_election.cc:400] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
I20260709 12:21:18.831069 13175 leader_election.cc:403] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:21:18.831940 13208 raft_consensus.cc:1240] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:18.832769 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:18.833567 13131 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:18.835204 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:18.835999 13137 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 18: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:18.835845 13252 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:18.836948 19046 raft_consensus.cc:2764] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:18.838601 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:18.837005 18872 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:18.839412 13131 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 16: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:18.816628 13102 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:18.866278 13887 raft_consensus.cc:1240] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 12:21:18.868868 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 52301.3us
I20260709 12:21:18.874840 13102 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
W20260709 12:21:18.878444 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 47890.4us
W20260709 12:21:18.879420 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 110314us
I20260709 12:21:18.877936 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:18.883375 13887 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:18.885639 18780 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:18.887547 18991 consensus_queue.cc:1059] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:18.888368 18991 raft_consensus.cc:3055] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:18.888700 18991 raft_consensus.cc:740] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:18.889536 18991 consensus_queue.cc:260] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:18.890400 18991 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:18.891798 19111 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:18.902206 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:18.902825 13887 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:18.879073 18962 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:18.878937 18829 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:18.918673 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:18.895866 19111 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:18.900662 19036 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.913870 18962 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:18.930970 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:18.928157 13887 raft_consensus.cc:1275] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:21:18.964783 19115 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.965493 19115 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.931283 18324 consensus_queue.cc:1059] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:21:18.983529 19039 consensus_queue.cc:260] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.985052 19039 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:18.934331 18962 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:18.945194 19036 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:18.990119 19036 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:18.991124 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:18.995925 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 72871.5us
I20260709 12:21:18.996732 13883 raft_consensus.cc:2393] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 16: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:18.998028 13887 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:18.998633 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:18.999482 13882 raft_consensus.cc:2368] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 19. Current term is 20.
I20260709 12:21:19.003091 13841 leader_election.cc:400] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 15. Current term is 16.
I20260709 12:21:19.003530 13841 leader_election.cc:403] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:21:19.007905 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:19.009773 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:19.010593 13880 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:19.012916 13208 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:19.013684 19036 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:21:19.014686 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 100892us
I20260709 12:21:19.017395 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:19.017442 19036 consensus_queue.cc:1048] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:19.019199 19036 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:19.019655 19036 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.020053 19036 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:19.025182 19046 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:19.028712 13177 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:19.030475 19126 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:19.032895 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:19.033800 13128 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:19.004383 19106 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.006901 19030 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.057298 19045 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.059516 19106 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.061906 19106 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:19.059638 19030 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.062502 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:19.063463 13885 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 18: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:19.065743 13100 leader_election.cc:400] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 19. Current term is 20.
I20260709 12:21:19.066087 13100 leader_election.cc:403] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:19.070061 18962 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:19.072994 18962 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:19.068642 19120 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 12:21:19.068775 19111 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 19. Current term is 20.
I20260709 12:21:19.082975 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:19.083762 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:19.084383 13131 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:19.047662 19059 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 15. Current term is 16.
I20260709 12:21:19.088423 18848 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:19.091725 19126 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:19.097205 18780 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
I20260709 12:21:19.064922 19030 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:19.102226 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:19.108793 19122 log.cc:927] Time spent T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:21:19.110330 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:21:19.110877 19124 log.cc:927] Time spent T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.153s	user 0.003s	sys 0.000s
I20260709 12:21:19.111049 13207 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:21:19.117002 19115 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:19.118644 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:19.120541 19130 log.cc:927] Time spent T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:21:19.121398 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:19.122539 13207 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 18.
I20260709 12:21:19.123267 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:19.124820 13885 raft_consensus.cc:1275] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:21:19.125119 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:19.125514 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:19.129563 19045 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:19.091804 19129 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:19.132731 19129 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.133062 19129 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:19.135854 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:19.138607 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:19.139802 19089 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:19.140290 19089 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.140654 19089 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:19.145809 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:19.146675 18324 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:19.147233 18324 raft_consensus.cc:697] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
W20260709 12:21:19.148734 19123 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:21:19.152549 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:19.152881 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:19.153082 13285 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:19.153501 13282 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:19.161484 19110 consensus_queue.cc:1048] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:19.166041 18979 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.166349 19046 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.166589 18979 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.161804 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:19.168548 13128 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:19.168892 18979 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:19.128602 13103 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:19.148277 18324 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.177429 13282 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:19.173105 13212 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:19.191601 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:19.192101 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 63561.3us
I20260709 12:21:19.195643 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:19.202199 13285 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:19.202047 19036 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.195472 13102 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:19.171480 19120 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:19.209894 13212 raft_consensus.cc:1275] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:19.205327 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:19.207502 13102 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:19.216018 13279 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:19.203208 19105 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:19.166997 19046 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.211555 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:19.252127 13885 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:21:19.254266 13881 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:21:19.254490 18856 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:19.255162 18856 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:19.256215 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:19.263312 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:19.265671 13135 raft_consensus.cc:1275] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 20 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:21:19.272823 13204 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:19.273381 13211 raft_consensus.cc:2368] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 16. Current term is 17.
I20260709 12:21:19.222041 18536 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:19.193903 18979 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:19.277005 13128 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 17.
I20260709 12:21:19.216181 19111 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:19.216867 19115 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:19.298763 13175 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:19.305581 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:19.306596 13204 raft_consensus.cc:2368] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 16. Current term is 17.
I20260709 12:21:19.203207 19106 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:19.310055 13284 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:19.304322 19064 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.277263 18984 consensus_queue.cc:1048] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:21:19.319211 19106 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.319486 19064 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.321527 18964 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.321947 19064 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:19.322223 18964 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.322863 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:19.323715 13212 raft_consensus.cc:2393] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 18: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:19.323814 19046 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:19.325081 19036 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:19.300613 18536 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 18 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:19.327217 18536 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.275763 19127 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:21:19.334729 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:19.345996 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:19.346823 13128 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:21:19.360253 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 93631.3us
I20260709 12:21:19.311592 18940 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:19.364271 13128 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 17.
I20260709 12:21:19.370993 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:19.321604 19106 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:19.374131 13840 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:19.373358 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:19.382853 13881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:19.372320 13131 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:19.383600 13881 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 20.
I20260709 12:21:19.385530 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:19.386350 13883 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:19.373466 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:19.374511 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:19.387692 13207 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:19.375315 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:19.389009 13212 raft_consensus.cc:2393] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 13: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:19.310932 19111 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:19.303946 18979 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:19.401026 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 193621us
I20260709 12:21:19.406558 13103 leader_election.cc:400] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 16. Current term is 17.
I20260709 12:21:19.407068 13103 leader_election.cc:403] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:19.256229 18856 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:19.437358 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 403324us
I20260709 12:21:19.403523 19056 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:19.443274 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:19.342391 19105 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:19.400489 19108 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.405045 18940 raft_consensus.cc:697] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:19.469513 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:19.478404 13279 raft_consensus.cc:2368] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
I20260709 12:21:19.391775 19090 consensus_queue.cc:1048] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:21:19.460790 13249 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:19.425055 18872 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:19.475313 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:19.476706 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 70590.4us
I20260709 12:21:19.477551 13283 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:21:19.496958 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:19.476660 19056 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:19.510568 13282 raft_consensus.cc:2468] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:19.498629 19120 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:19.577714 18829 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.578383 18829 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.580163 19017 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.198s
I20260709 12:21:19.580614 18829 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:19.501248 18975 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 16. Current term is 17.
I20260709 12:21:19.575596 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:19.578776 19140 log.cc:927] Time spent T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:21:19.476210 19108 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:19.568048 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:19.461007 19089 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.610366 13281 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:19.504208 19129 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.577379 19120 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.607220 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:19.626140 13886 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:19.613586 19115 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:19.629711 19120 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:19.626099 18964 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:19.605454 19111 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:19.626614 18940 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:19.673074 19144 log.cc:927] Time spent T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:21:19.665735 18981 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.674561 18981 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.675493 18966 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:19.676905 18981 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:19.679970 19105 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:19.680490 19056 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:19.681874 19137 log.cc:927] Time spent T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:21:19.684162 18979 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:19.684772 19089 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:19.689841 13883 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 17.
I20260709 12:21:19.692550 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:19.694631 13135 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:19.707882 13885 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 17.
I20260709 12:21:19.664108 19115 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:19.773295 19115 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:19.744745 19129 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:19.745800 19108 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:19.754056 19117 log.cc:927] Time spent T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:21:19.758018 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:19.764201 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:19.764309 13249 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:19.801862 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:19.784124 13284 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:19.767047 18975 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.777070 13102 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:21:19.823400 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 46425.4us
I20260709 12:21:19.783330 13135 raft_consensus.cc:2468] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
W20260709 12:21:19.828809 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 64579.9us
W20260709 12:21:19.843344 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 440226us
I20260709 12:21:19.854792 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:19.855850 13285 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 16: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:19.856612 13131 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:21:19.860750 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:19.866577 13204 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:19.867179 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:19.869539 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:19.871218 13207 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:19.871444 13211 raft_consensus.cc:2393] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 16: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:19.867980 13206 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:19.827636 19115 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:19.852694 18979 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:19.882037 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:19.840557 19126 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:19.840167 19046 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:19.887106 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:19.888990 13211 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 16: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:19.856990 19039 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:19.827783 18975 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:19.892544 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:19.894272 13128 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 16: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:19.892596 13284 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:19.880666 19115 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.898150 13134 raft_consensus.cc:1275] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:19.895855 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:19.900022 13283 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:19.899200 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:19.887475 18979 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:19.920506 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 118225us
I20260709 12:21:19.920902 18979 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:19.921344 13252 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:19.891268 19126 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.901911 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:19.924953 19126 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:19.928273 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 99665.2us
I20260709 12:21:19.929996 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:19.902154 19115 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:19.930864 19148 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:19.932138 13281 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:19.932355 19148 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:19.907919 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:19.891893 19138 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.909214 19139 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:19.933233 13277 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 18.
I20260709 12:21:19.910633 13103 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:19.896521 19046 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.956831 13135 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 18.
I20260709 12:21:19.918825 19039 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:19.930800 13838 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:19.944561 13283 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 14.
I20260709 12:21:19.946934 13177 leader_election.cc:400] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15.
W20260709 12:21:19.947492 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 315031us
I20260709 12:21:19.946957 13284 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:21:19.961283 13841 leader_election.cc:400] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 16. Current term is 17.
I20260709 12:21:19.961701 13841 leader_election.cc:403] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:19.960666 13177 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:19.968180 13887 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:19.971669 13279 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 12:21:19.960626 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 50074.9us
I20260709 12:21:19.978199 13177 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:19.945830 18848 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:19.999724 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 43580.6us
I20260709 12:21:20.001966 13137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:21:20.002118 18848 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.004837 19154 raft_consensus.cc:2804] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:20.005136 13137 raft_consensus.cc:606] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:20.005437 19154 raft_consensus.cc:697] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:20.006866 18848 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:20.015589 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:20.006458 19154 consensus_queue.cc:237] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:19.958601 19138 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.029906 13128 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:20.003033 19129 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:19.979933 18964 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:21:20.024747 19152 raft_consensus.cc:3060] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:19.990732 18940 consensus_queue.cc:1059] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:21:19.989493 19105 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:21:19.945518 19148 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.029114 19120 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.053545 13130 raft_consensus.cc:1240] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: []
W20260709 12:21:20.054842 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 74176.9us
I20260709 12:21:20.067813 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:20.068466 13280 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
I20260709 12:21:20.069509 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:20.069669 13131 raft_consensus.cc:1240] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Rejecting Update request from peer b190224a708b4f068a6dda4006c3a133 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:20.073805 19165 raft_consensus.cc:3055] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:20.074292 19165 raft_consensus.cc:740] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:20.075215 19165 consensus_queue.cc:260] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.076547 19165 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:20.076640 19142 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:20.077069 19142 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.077416 19142 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:21:20.077963 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 116862us
I20260709 12:21:20.079092 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:20.080662 13841 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:20.083175 19078 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for earlier term 16. Current term is 17.
I20260709 12:21:20.083204 13131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:21:20.084180 19078 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:20.090425 13252 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:20.084986 19078 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:20.093799 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:20.091837 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:20.094833 19148 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:20.096298 18981 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:20.096799 19138 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:20.099773 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:20.103485 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:20.104226 13211 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 18.
I20260709 12:21:20.091795 13249 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:20.105417 19064 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:20.111544 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 180830us
W20260709 12:21:20.112675 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 147340us
I20260709 12:21:20.083088 18940 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.096746 18981 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:20.123852 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:20.059007 19110 consensus_queue.cc:1048] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:21:20.130718 18324 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:20.130894 13103 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:20.141155 19115 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.143538 19088 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.143980 18975 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:20.144088 19088 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.145593 19039 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:20.110457 18984 consensus_queue.cc:1059] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:21:20.146808 18984 raft_consensus.cc:3055] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:20.147171 18984 raft_consensus.cc:740] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:20.147554 13131 raft_consensus.cc:606] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:20.147936 13131 raft_consensus.cc:614] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:20.148042 18984 consensus_queue.cc:260] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.149351 18984 raft_consensus.cc:3060] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:20.124332 18981 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:20.154265 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:20.154418 18872 consensus_queue.cc:1059] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:20.124500 18940 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.156261 19141 raft_consensus.cc:3055] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:20.156631 19141 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:20.157601 18940 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:20.157429 19141 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.158630 19141 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:20.159660 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 77109.8us
I20260709 12:21:20.160624 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:20.161743 13841 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:20.162009 19030 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:20.162734 19030 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:20.166042 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:20.166687 13880 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:20.126540 19149 raft_consensus.cc:2804] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:20.167793 19149 raft_consensus.cc:697] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:20.168730 19149 consensus_queue.cc:237] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.169579 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:20.170199 13134 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:20.126442 19173 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:20.171687 13212 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
I20260709 12:21:20.124192 19126 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:21:20.174899 19173 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:20.177783 19173 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:20.181079 13887 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:21:20.123251 19046 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:20.186998 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:20.187568 13206 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:20.191797 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:20.193317 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:20.193892 13885 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:20.194227 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:20.171222 18536 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:20.197992 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:20.201484 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:20.201534 13175 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:20.202102 13277 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 18.
I20260709 12:21:20.206434 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:20.207401 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:20.207621 13175 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:20.212759 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:20.204799 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:20.180859 19142 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.199831 18536 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.212313 19165 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:20.269536 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.219177 19154 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:20.283406 13885 raft_consensus.cc:2468] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 21.
I20260709 12:21:20.288166 13128 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:21:20.260131 18536 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:20.262602 18940 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:20.286502 19154 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.310884 19154 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:20.318269 19088 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:20.305301 18940 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:20.367403 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 158556us
I20260709 12:21:20.324136 19115 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:20.331825 19152 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:20.265823 19182 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 12:21:20.368654 13249 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:20.374181 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:20.373785 18979 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:20.389683 19176 log.cc:927] Time spent T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:21:20.396719 19188 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:20.402316 19171 log.cc:927] Time spent T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:21:20.402737 19188 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:20.404448 18981 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.412329 18940 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:20.422060 18940 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.422683 18940 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.419541 18981 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:20.431850 19177 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:20.432860 19177 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.441774 18979 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:20.456698 18940 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:20.463799 19142 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:20.524284 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:20.527384 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:20.528422 13280 raft_consensus.cc:2368] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 20. Current term is 21.
I20260709 12:21:20.529673 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:20.490844 19078 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:20.546147 13841 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:20.549816 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 175733us
I20260709 12:21:20.539182 19177 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:20.555552 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:20.556223 13281 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:20.556231 13284 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:21:20.554464 19078 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:20.594017 13281 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
I20260709 12:21:20.592705 18536 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.596484 18536 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:20.601670 19173 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.602778 13279 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
I20260709 12:21:20.604054 19173 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:20.604727 19154 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.608500 19154 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:20.711783 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:20.712428 13885 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:20.722543 19168 log.cc:927] Time spent T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.827s	user 0.000s	sys 0.007s
I20260709 12:21:20.734040 13885 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 16.
I20260709 12:21:20.750854 13100 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:20.752110 18536 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:20.752736 18536 raft_consensus.cc:697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 16 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:20.753901 18536 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.762840 19120 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:20.768889 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:20.769661 13281 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:20.774143 18962 raft_consensus.cc:993] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:20.774019 19197 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:20.774705 18962 raft_consensus.cc:1081] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:20.776146 13280 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:20.777280 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:20.777913 13285 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:20.779742 19120 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:20.780320 19120 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.782644 19120 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:20.783396 13102 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:20.785202 18536 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:20.785633 18536 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.785991 18536 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:20.796854 13281 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 17.
I20260709 12:21:20.805604 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:20.806070 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:20.806794 13885 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:20.802547 13285 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 19.
I20260709 12:21:20.812117 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:20.814666 13249 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:20.824756 19120 raft_consensus.cc:2804] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:20.811757 18897 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:21:20.826066 19120 raft_consensus.cc:697] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 21 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:20.826996 19120 consensus_queue.cc:237] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.829077 13102 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:20.829907 13885 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:20.829135 13285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38644
I20260709 12:21:20.837586 13285 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:20.838318 13285 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:20.831365 19150 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:20.840461 18536 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.848201 13133 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:21:20.849010 19153 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:20.849612 19153 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:20.852517 13285 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.856766 13285 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:20.858587 19153 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:20.869150 18536 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:20.872591 19078 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:21:20.873216 13212 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:21:20.847731 19150 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 17 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:20.906376 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:20.907385 13207 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 17: Already voted for candidate a99436c294734e5cbc3657b2517cefca in this term.
I20260709 12:21:20.910364 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:20.918489 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:20.919265 13136 raft_consensus.cc:2368] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17.
I20260709 12:21:20.921693 19150 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:20.935007 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:20.988080 19110 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:20.974947 19195 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:21.000217 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:21.003465 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:21.003968 18991 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:21.004094 13133 raft_consensus.cc:3055] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:21.004701 13133 raft_consensus.cc:740] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:21.005462 13133 consensus_queue.cc:260] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:21.006346 13133 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.004711 18991 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.008256 13249 leader_election.cc:400] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17.
I20260709 12:21:21.008623 13249 leader_election.cc:403] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:21:21.009316 18991 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:21.009858 18991 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:21.016637 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:20.995193 19110 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:21.053424 13249 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:21.055063 19193 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:21.057061 13136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:21.058561 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:21.060166 19193 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:20.999158 19195 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:21.032823 19162 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:21:21.097340 13133 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:21.098796 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:21.099485 13207 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.100446 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:21.100587 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:21.101039 13209 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.101887 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:21.102695 13212 raft_consensus.cc:2368] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17.
I20260709 12:21:21.103595 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:21.104074 13212 raft_consensus.cc:3060] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.110877 13249 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:21.114998 13209 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
W20260709 12:21:21.120018 19203 log.cc:927] Time spent T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:21:21.122036 19202 log.cc:927] Time spent T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:21:21.122866 13207 raft_consensus.cc:2468] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:21.124289 18991 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201) with higher term. Message: Invalid argument: T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17.
I20260709 12:21:21.131284 13212 raft_consensus.cc:2468] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
I20260709 12:21:21.113480 19120 raft_consensus.cc:2804] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:21.136343 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:21.139899 19195 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:21.140869 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:21.140885 19110 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:21.139096 19120 raft_consensus.cc:697] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:21.144217 19120 consensus_queue.cc:237] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:21.150748 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:21.155874 13209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:21.167328 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:21.168076 13210 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:21.179800 13208 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:21.186242 13210 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 19.
I20260709 12:21:21.186899 13130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2554) took 1380 ms. Trace:
I20260709 12:21:21.187304 13130 rpcz_store.cc:276] 0709 12:21:19.807054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.807216 (+   162us) service_pool.cc:224] Handling call
0709 12:21:19.807533 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:20.070233 (+262700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.186662 (+1116429us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400061154. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:21.186819 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565303680}
I20260709 12:21:21.197615 13282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38658 (request call id 2686) took 1304 ms. Trace:
I20260709 12:21:21.198099 13282 rpcz_store.cc:276] 0709 12:21:19.893164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.893297 (+   133us) service_pool.cc:224] Handling call
0709 12:21:19.893557 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.999070 (+105513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.999117 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.999177 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:19.999222 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.197354 (+1198132us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54001adbd4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:21.197403 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.197534 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242079616}
I20260709 12:21:21.202394 13103 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:21.203887 19162 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:21.204416 19162 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 19 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:21.205268 19162 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:21.183923 19183 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:21.233362 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:21.239709 13282 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 17.
I20260709 12:21:21.234496 18962 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:21.248011 18962 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.251151 13207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:21.253069 13887 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:21.254472 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:21.255448 19182 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:21:21.260421 13135 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58712 (request call id 2559) took 1396 ms (client timeout 1602 ms). Trace:
W20260709 12:21:21.260874 13135 rpcz_store.cc:269] 0709 12:21:19.864010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.869227 (+  5217us) service_pool.cc:224] Handling call
0709 12:21:21.260242 (+1391015us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b5400060754. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e912fa 00007f70f9e52b17 00007f70f33cd6d4 00007f70f33cd662 00007f70f33cd591 00007f70f33cd50c 00007f70f33cc7c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:21.260341 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198781312}
I20260709 12:21:21.262066 18536 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.262372 13175 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:21.262552 18536 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.263173 19126 raft_consensus.cc:2764] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:21:21.265841 13102 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:21.267194 19125 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:21.267674 13209 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:21:21.267765 19125 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.269850 19125 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:21.271335 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:21.272683 13100 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:21.273098 18991 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:21.273694 18536 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:21.250144 18962 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:21.273624 18991 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.277460 19105 raft_consensus.cc:493] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:21.278136 19162 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:21.278033 19105 raft_consensus.cc:515] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.281697 13131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50024 (request call id 41) took 1198 ms. Trace:
I20260709 12:21:21.282042 13131 rpcz_store.cc:276] 0709 12:21:20.082776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.082904 (+   128us) service_pool.cc:224] Handling call
0709 12:21:21.281524 (+1198620us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b54002b5054. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e87853 00007f70f9e5560a 00007f70f33db7d4 00007f70f33db762 00007f70f33db691 00007f70f33db60c 00007f70f33da8c2 00007f70f31c848c 00007f70f31c78c6 00007f70f31c726f
0709 12:21:21.281618 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146039680}
I20260709 12:21:21.284565 18991 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:21.286600 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:21.287837 19162 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 17 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:21.289911 19162 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:21.294726 13205 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:21:21.295236 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:21.300482 13135 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:21.301079 13887 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:21:21.305147 18966 consensus_queue.cc:1059] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:21.312253 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:21.308317 13252 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:21.312656 13135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:21.314458 13887 raft_consensus.cc:2368] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 20. Current term is 21.
I20260709 12:21:21.318081 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:21.306759 18966 raft_consensus.cc:3055] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:21.320465 13252 leader_election.cc:400] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 16. Current term is 17.
I20260709 12:21:21.322358 13252 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:21.323460 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:21.324235 13885 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 17.
I20260709 12:21:21.323218 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:21.325771 13100 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:21.325788 13252 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:21.316573 18975 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:21:21.328980 13887 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:21:21.329032 18536 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:21.317518 19149 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.337219 18536 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.346922 18536 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:21.347175 13131 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:21:21.329916 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:21.320726 19195 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:21.320914 19150 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:21.351333 19105 leader_election.cc:290] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:21.355199 13137 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:21:21.321659 18966 raft_consensus.cc:740] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:21.357246 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:21.331192 19173 raft_consensus.cc:2804] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:21.362707 19132 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:21.346683 19149 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.373231 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:21.348832 19182 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:21.377075 19182 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:21.342584 19039 raft_consensus.cc:2804] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:21.388108 13283 raft_consensus.cc:1275] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:21:21.390625 13177 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:21.392138 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:21.392419 13175 leader_election.cc:400] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 20. Current term is 21.
I20260709 12:21:21.392716 13175 leader_election.cc:403] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:21.394004 19039 raft_consensus.cc:697] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:21.395780 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:21.396530 13281 raft_consensus.cc:2393] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 17: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
I20260709 12:21:21.396728 19039 consensus_queue.cc:237] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.401336 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:21.380664 19110 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:21.404486 19125 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:21.392037 19173 raft_consensus.cc:697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:21.406767 19210 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:21:21.408275 19200 log.cc:927] Time spent T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.559s	user 0.005s	sys 0.000s
I20260709 12:21:21.403978 18536 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.410471 13131 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:21:21.413758 19090 raft_consensus.cc:3060] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:21:21.419023 19154 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:21:21.423280 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:21.423589 19051 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:21.424085 13132 raft_consensus.cc:3060] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.414960 19210 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:21.432072 19210 raft_consensus.cc:697] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:21.432753 18966 consensus_queue.cc:260] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.434378 13128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58712 (request call id 2567) took 1226 ms. Trace:
I20260709 12:21:21.434789 13128 rpcz_store.cc:276] 0709 12:21:20.208296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.209151 (+   855us) service_pool.cc:224] Handling call
0709 12:21:20.209443 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.288607 (+ 79164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.434131 (+1145524us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b54003ab1d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e8de01 00007f70f4e8c83e 00007f70f9e51419 00007f70f33c8bd4 00007f70f33c8b62 00007f70f33c8a91 00007f70f33c8a0c 00007f70f33c7cc2 00007f70f31c848c 00007f70f31c78c6
0709 12:21:21.434320 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180499328}
I20260709 12:21:21.435307 18966 raft_consensus.cc:3060] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.436219 19182 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:21.437156 13880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:21:21.437743 13880 raft_consensus.cc:606] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:21.438066 13880 raft_consensus.cc:614] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:21.443282 13019 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e1a3fa2c26ae4d9a8803582f91f9cff2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cbc6af7757ec459ab451e47724fdf44b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:21.438324 13132 raft_consensus.cc:2468] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
W20260709 12:21:21.452664 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 80454.4us
I20260709 12:21:21.455762 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b675043435441bb980d9a219c4d3450"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:21:21.456398 13135 raft_consensus.cc:606] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:21:21.456749 13135 raft_consensus.cc:614] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:21.462841 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:21.466355 13277 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:21.470309 13285 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:21:21.477134 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:21.483067 18536 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:21.487350 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:21.489166 13885 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:21.406117 19173 consensus_queue.cc:237] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.524833 13278 raft_consensus.cc:1275] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
W20260709 12:21:21.525532 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 194827us
I20260709 12:21:21.527370 18324 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:21.527648 13278 pending_rounds.cc:85] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Aborting all ops after (but not including) 10
I20260709 12:21:21.528102 13278 pending_rounds.cc:107] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:21:21.528366 13278 raft_consensus.cc:2889] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:21.532200 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:21.533082 13278 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 12.
I20260709 12:21:21.571827 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:21.572965 13285 raft_consensus.cc:2393] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b in current term 16: Already voted for candidate af3f42f0797349058724e0cb2e637d24 in this term.
W20260709 12:21:21.576841 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 48115.8us
I20260709 12:21:21.577970 13252 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:21.527964 18324 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.581650 13252 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:21.589785 13282 raft_consensus.cc:1240] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Rejecting Update request from peer cbc6af7757ec459ab451e47724fdf44b for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:21.433040 19210 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:21.593161 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 129674us
I20260709 12:21:21.468405 19056 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.103s
W20260709 12:21:21.595542 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 126711us
I20260709 12:21:21.598033 13177 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:21.604547 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 136624us
I20260709 12:21:21.609282 13135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:21:21.588382 19195 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:21.620613 19222 log.cc:927] Time spent T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:21:21.954725 13135 raft_consensus.cc:606] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:21:21.954795 18885 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:21.955256 13135 raft_consensus.cc:614] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:21.625006 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:21.627466 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:21.751495 19210 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:21.955847 18885 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:21:21.956981 19210 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:21.957967 19126 consensus_queue.cc:1059] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:21.958994 19126 raft_consensus.cc:3055] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:21.825861 19059 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.865706 19090 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 20. Current term is 21.
I20260709 12:21:21.959352 19126 raft_consensus.cc:740] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:21.959730 19059 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.960290 19126 consensus_queue.cc:260] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.868858 18324 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:21.872430 19089 consensus_queue.cc:1048] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:21.961552 19126 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:21.873224 13840 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:21.962683 19059 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:21.962954 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 89823.4us
I20260709 12:21:21.581254 18991 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:21.963724 18991 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:21.959353 18885 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:21.965821 18991 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:21.588672 19149 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:21.930007 13839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.968883 13840 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:21.970639 19210 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:21.972136 19153 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:21.963387 19059 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:21.973523 19059 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:21.974082 19059 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:21.984953 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:21.986371 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc9abc16270419796fe8ad939321769" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:21.940795 18966 consensus_meta.cc:287] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.504s	user 0.014s	sys 0.000s
W20260709 12:21:21.954490 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 356582us
I20260709 12:21:21.987912 13177 leader_election.cc:400] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Vote denied by peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631) with higher term. Message: Invalid argument: T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca for earlier term 20. Current term is 21.
I20260709 12:21:21.966059 18885 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:21.991189 18885 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:21.991778 13177 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:21.996574 13885 consensus_meta.cc:287] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 12:21:21.996960 13885 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 18.
I20260709 12:21:21.997681 13887 raft_consensus.cc:1240] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:21:22.000707 13177 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:22.006649 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.006819 19051 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:21.992455 18885 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:21:22.025005 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.005553 19056 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:21.992581 19127 consensus_queue.cc:1048] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:21:22.041603 19059 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:22.044691 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:22.045331 13880 raft_consensus.cc:1240] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:22.047681 19059 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:22.053143 19226 log.cc:927] Time spent T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: Append to log took a long time: real 0.414s	user 0.004s	sys 0.000s
W20260709 12:21:22.064603 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 433015us
I20260709 12:21:22.067090 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:21:22.068202 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 113827us
I20260709 12:21:22.064661 19039 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:22.071662 13100 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:22.089476 18991 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.079170 13206 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:21:22.089028 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:22.095898 18324 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:22.096817 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:22.082762 13281 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:21:22.080617 19182 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:21:22.084438 18984 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:22.084890 19195 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:22.114120 19195 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:22.118515 13252 leader_election.cc:304] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:22.102432 13882 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:21:22.104149 13206 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:22.111614 13210 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:22.112115 18324 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:22.095902 19150 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:22.128288 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:22.129246 13283 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:21:22.131769 13840 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:22.138036 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:22.089982 18991 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:22.156188 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:22.156808 13137 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 17.
I20260709 12:21:22.144572 19059 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:22.172569 18324 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:22.130473 18984 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:22.200989 13132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:22.176725 18981 raft_consensus.cc:2749] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:22.219031 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:22.223989 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 64354.6us
I20260709 12:21:22.225320 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:22.160490 19225 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.045s
W20260709 12:21:22.228891 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 104021us
I20260709 12:21:22.229403 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:22.230898 13886 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:21:22.237403 13886 pending_rounds.cc:85] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: Aborting all ops after (but not including) 11
I20260709 12:21:22.232291 13882 raft_consensus.cc:1275] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:22.237658 13886 pending_rounds.cc:107] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:21:22.237989 13886 raft_consensus.cc:2889] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:22.236917 13284 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:21:22.227996 19195 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:22.240130 19106 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:22.240599 19106 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:22.241032 19106 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:22.264484 13211 raft_consensus.cc:1275] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 21 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:21:22.233611 19150 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 18 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:22.270519 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:22.268759 18981 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:21:22.291179 19244 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:22.292066 18984 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:22.293303 18991 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:22.269018 19195 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:21:22.295415 19056 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:22.297081 19195 consensus_queue.cc:1048] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:22.301419 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:22.303285 19156 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:22.303802 19156 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.304179 19156 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:22.307245 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:22.307940 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:22.313829 19150 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:22.293330 13204 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:21:22.352892 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:22.371835 13102 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:22.369484 13177 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:22.381942 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:22.457341 13285 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:21:22.460450 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 78333.7us
I20260709 12:21:22.469939 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:22.470028 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:22.462505 19127 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:22.397068 18975 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:22.380105 19177 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:22.489396 19177 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:22.479732 13134 raft_consensus.cc:1275] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:22.485977 18944 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:22.497812 19177 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:22.504917 18897 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.483711 13249 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:22.505673 18897 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } attrs { replace: true } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:22.507539 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:22.509037 13033 catalog_manager.cc:5697] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 14 to 17, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 17 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.510313 18897 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:22.474148 19249 log.cc:927] Time spent T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24: Append to log took a long time: real 0.099s	user 0.000s	sys 0.005s
I20260709 12:21:22.518659 19156 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:22.522773 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 350227us
I20260709 12:21:22.464443 19244 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:21:22.510663 13033 catalog_manager.cc:5697] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:22.540763 13886 raft_consensus.cc:1240] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:21:22.544051 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:22.477922 19224 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:21:22.573097 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:22.540400 19127 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:21:22.559904 19106 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:22.650568 13233 debug-util.cc:398] Leaking SignalData structure 0x7b0800267800 after lost signal to thread 11919
W20260709 12:21:22.651845 13233 debug-util.cc:398] Leaking SignalData structure 0x7b08003264c0 after lost signal to thread 13069
W20260709 12:21:22.653234 13233 debug-util.cc:398] Leaking SignalData structure 0x7b080036e700 after lost signal to thread 13161
W20260709 12:21:22.661091 19255 log.cc:927] Time spent T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:21:22.564476 19196 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:22.669989 19196 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:22.674394 19153 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.674973 19153 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:22.677055 19153 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:22.677317 19160 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.677995 19160 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:22.680492 19160 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:22.681069 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:22.721225 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:22.723254 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:22.723605 19196 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:22.785557 13206 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:21:22.785941 13206 pending_rounds.cc:85] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 12
I20260709 12:21:22.786221 13206 pending_rounds.cc:107] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:21:22.786516 13206 raft_consensus.cc:2889] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:22.787899 13880 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:21:22.791111 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 264826us
I20260709 12:21:22.809957 19240 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:21:22.842233 19156 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:22.846662 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:22.847091 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:22.847783 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:22.848415 13233 debug-util.cc:398] Leaking SignalData structure 0x7b0800352f00 after lost signal to thread 13236
W20260709 12:21:22.848747 13233 debug-util.cc:398] Leaking SignalData structure 0x7b0800257220 after lost signal to thread 13237
I20260709 12:21:22.849622 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:21:22.849954 13233 debug-util.cc:398] Leaking SignalData structure 0x7b080041be00 after lost signal to thread 13310
W20260709 12:21:22.850251 13233 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5d40 after lost signal to thread 13311
I20260709 12:21:22.848269 13100 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:22.848595 13203 raft_consensus.cc:2410] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 22 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 12:21:22.851404 13233 debug-util.cc:398] Leaking SignalData structure 0x7b0800154940 after lost signal to thread 13911
I20260709 12:21:22.950809 13204 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
W20260709 12:21:22.951030 13233 debug-util.cc:398] Leaking SignalData structure 0x7b080018dc60 after lost signal to thread 13912
I20260709 12:21:22.951244 13204 pending_rounds.cc:85] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Aborting all ops after (but not including) 7
I20260709 12:21:22.951499 13204 pending_rounds.cc:107] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 12:21:22.951704 13204 raft_consensus.cc:2889] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:22.951999 13233 debug-util.cc:398] Leaking SignalData structure 0x7b08003fee60 after lost signal to thread 19148
I20260709 12:21:22.853055 13841 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:22.953208 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 100214us
I20260709 12:21:22.953332 19089 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:22.922207 13283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7285cfe46adb4975a532c3df36e5203e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:22.921881 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:22.936249 13033 catalog_manager.cc:5697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:22.853372 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:21:22.895927 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 368117us
W20260709 12:21:22.895519 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 411857us
I20260709 12:21:22.980695 13249 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:22.967873 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 374652us
I20260709 12:21:22.984702 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:22.985592 13205 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:22.955420 19078 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:22.928092 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:22.853379 18975 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:22.904469 18981 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.987253 19120 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:22.993978 13882 raft_consensus.cc:1240] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:22.895694 19064 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:22.865208 19106 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:22.931952 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:23.007135 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:22.855502 19183 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.137s
I20260709 12:21:23.024369 13840 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:23.027882 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:23.036751 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 53722.8us
I20260709 12:21:22.992573 19078 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:23.035759 19247 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.853576 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:23.057025 19195 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:21:23.030359 19160 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:23.036942 19059 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:23.038676 19177 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:23.030721 19193 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:23.011240 18981 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:23.057080 19149 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:23.037676 19197 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:21:23.102332 19193 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:23.132382 19193 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:23.102771 19177 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:23.140954 19177 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:23.141125 18981 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:23.145352 19078 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:23.085112 19247 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:23.167565 19247 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:23.185331 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 147599us
I20260709 12:21:23.187108 13249 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:23.194547 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 164850us
I20260709 12:21:23.196105 13284 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:21:23.198177 13840 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:23.193053 19195 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:23.195922 18981 consensus_queue.cc:1048] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:21:23.211406 19156 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:23.214370 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:23.240245 13249 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:23.251784 13249 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:23.255838 19247 consensus_queue.cc:1048] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:23.256569 19183 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.257216 19183 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:23.261840 13249 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:23.278004 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:23.278891 13137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:23.279731 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:23.280404 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:23.280699 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:23.281260 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:23.282460 13134 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:23.246088 19272 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:23.275812 19247 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:23.282125 19183 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:23.281502 19271 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:23.298138 19245 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:21:23.339043 13285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:23.340730 19177 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:23.346464 13880 raft_consensus.cc:1275] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:23.350298 18885 consensus_queue.cc:1059] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:23.352120 19126 raft_consensus.cc:3055] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:23.352553 19126 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:23.353389 19126 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:23.361229 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:23.363533 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:23.365262 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:23.365942 13210 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 17.
W20260709 12:21:23.369082 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 88133.5us
I20260709 12:21:23.361637 18885 consensus_queue.cc:1059] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:21:23.374243 18885 raft_consensus.cc:3055] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:23.374646 18885 raft_consensus.cc:740] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:21:23.376308 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 330035us
W20260709 12:21:23.382309 13177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.390362 13211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:23.398695 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:23.399066 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:23.400619 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:23.404686 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:23.412130 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:23.375509 18885 consensus_queue.cc:260] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:23.416265 19064 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:23.417328 19195 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:23.416045 19269 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:23.467307 19288 consensus_queue.cc:1048] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:21:23.492946 13100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 98411.3us
W20260709 12:21:23.510860 13176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.534917 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 120540us
W20260709 12:21:23.545552 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 119525us
I20260709 12:21:23.555328 19126 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:23.616227 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 189350us
W20260709 12:21:23.644567 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 238401us
I20260709 12:21:23.642710 13033 catalog_manager.cc:5697] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:21:23.651706 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 220391us
I20260709 12:21:23.666352 13103 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:23.677580 18885 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:23.691680 19291 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:23.738232 19210 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:21:23.742790 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 106973us
W20260709 12:21:23.764175 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 92683.7us
I20260709 12:21:23.764636 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:23.771996 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:23.775482 13252 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:23.739092 19210 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:23.780898 18981 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:23.779553 19064 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:23.805519 13033 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 11 to 12, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 12 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:23.793550 19292 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.809784 19292 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:23.812045 19292 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:23.812734 19228 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:23.813282 19228 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:23.814591 19210 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:23.797900 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 130207us
I20260709 12:21:23.817262 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:23.817921 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:23.822161 13033 catalog_manager.cc:5697] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.826671 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:23.796470 19299 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:23.815394 19228 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:23.852912 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:23.853569 13204 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 13.
I20260709 12:21:23.853690 19283 consensus_queue.cc:1059] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:23.855661 19258 raft_consensus.cc:3055] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:23.856060 19258 raft_consensus.cc:740] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:23.856851 19258 consensus_queue.cc:260] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:23.857725 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:23.858223 19258 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:23.860438 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:23.805546 19064 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:23.863183 19064 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:23.861821 13841 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:23.865470 19141 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:23.865857 19141 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.866206 19141 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:23.873646 19141 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:23.877570 13177 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:23.879181 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:23.879492 19141 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:23.879899 13210 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:23.883673 19283 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:23.888984 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:23.889007 13210 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 14.
I20260709 12:21:23.896296 13841 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:23.900265 13033 catalog_manager.cc:5697] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 11 to 13, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 13 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:23.901780 13033 catalog_manager.cc:5697] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 12, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 12 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:21:23.903120 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 76137.3us
I20260709 12:21:23.903527 13033 catalog_manager.cc:5697] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.905272 13033 catalog_manager.cc:5697] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b reported cstate change: config changed from index 6 to 9, term changed from 7 to 12, VOTER af3f42f0797349058724e0cb2e637d24 (127.11.163.1) evicted. New cstate: current_term: 12 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.911782 13033 catalog_manager.cc:5697] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 9 to 15, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 15 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.921350 13033 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 14 to 15, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 15 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:23.922916 13033 catalog_manager.cc:5697] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 10 to 13, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 13 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.910835 19153 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:23.935231 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:23.929955 13033 catalog_manager.cc:5697] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 15, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 15 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:23.937911 19287 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:23.987025 19153 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:23.988025 19153 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:23.990526 13033 catalog_manager.cc:5697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:23.991983 13033 catalog_manager.cc:5697] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:23.995400 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 57617.6us
I20260709 12:21:24.005585 19304 raft_consensus.cc:493] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:24.006211 19304 raft_consensus.cc:515] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:24.008500 19304 leader_election.cc:290] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:24.009049 19304 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:24.009528 19304 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:24.014861 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:24.016302 13029 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42070 (request call id 328) took 33281 ms (client timeout 15000 ms). Trace:
I20260709 12:21:23.994817 19306 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:24.027943 19306 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:24.029089 19304 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:24.030238 19306 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:24.030601 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:24.016785 13029 rpcz_store.cc:269] 0709 12:20:50.735342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.735836 (+   494us) service_pool.cc:224] Handling call
0709 12:21:24.016166 (+33280330us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:18.210162 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:18.210962 (+   800us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:18.211017 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:21:18.211041 (+    24us) tablet.cc:662] Decoding operations
0709 12:21:18.212409 (+  1368us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:18.212544 (+   135us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:18.212573 (+    29us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:21:18.319624 (+107051us) tablet.cc:701] Row locks acquired
0709 12:21:18.329063 (+  9439us) write_op.cc:260] PREPARE: finished
0709 12:21:18.347555 (+ 18492us) write_op.cc:270] Start()
0709 12:21:18.347756 (+   201us) write_op.cc:276] Timestamp: P: 1783599678341701 usec, L: 0
0709 12:21:18.347798 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:21:18.388807 (+ 41009us) log.cc:844] Serialized 4817 byte log entry
0709 12:21:19.044591 (+655784us) op_driver.cc:464] REPLICATION: finished
0709 12:21:19.053019 (+  8428us) write_op.cc:301] APPLY: starting
0709 12:21:19.053152 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:19.750884 (+697732us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:19.751001 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:19.965541 (+214540us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:19.965950 (+   409us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 12:21:19.966015 (+    65us) write_op.cc:312] APPLY: finished
0709 12:21:19.966455 (+   440us) log.cc:844] Serialized 113 byte log entry
0709 12:21:19.992367 (+ 25912us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:19.992570 (+   203us) write_op.cc:454] Released schema lock
0709 12:21:19.992669 (+    99us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:19.993324 (+   655us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:19.993369 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1489003,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":8038,"apply.run_cpu_time_us":23196,"apply.run_wall_time_us":940273,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54359,"num_ops":12,"prepare.queue_time_us":98999,"prepare.run_cpu_time_us":152522,"prepare.run_wall_time_us":708894,"raft.queue_time_us":32599,"raft.run_cpu_time_us":5301,"raft.run_wall_time_us":8273,"replication_time_us":696607,"spinlock_wait_cycles":2207872,"thread_start_us":560229,"threads_started":4,"wal-append.queue_time_us":517686,"wal-append.run_cpu_time_us":9914,"wal-append.run_wall_time_us":2056875}]]}
I20260709 12:21:24.033361 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:24.003782 13033 catalog_manager.cc:5697] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 11, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 11 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:24.057545 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a97da851674edaa6a93f32de934f5c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:24.052636 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:24.053437 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:24.068516 13033 catalog_manager.cc:5697] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 12 to 14, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 14 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.073405 13033 catalog_manager.cc:5697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 11 to 12, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 12 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:24.079641 13033 catalog_manager.cc:5697] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 9 to 15, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 15 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:24.086963 13033 catalog_manager.cc:5697] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:24.088387 13033 catalog_manager.cc:5697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 10 to 11, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 11 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.090090 13103 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:24.096426 13033 catalog_manager.cc:5697] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 12, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 12 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.098101 13033 catalog_manager.cc:5697] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 10 to 14, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 14 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:21:24.100100 19308 log.cc:927] Time spent T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:24.103808 19224 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:24.105741 13033 catalog_manager.cc:5697] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 9 to 16, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 16 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.056972 19064 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:24.111560 13103 leader_election.cc:304] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:24.112783 13103 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:24.113914 13279 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Rejecting Update request from peer af3f42f0797349058724e0cb2e637d24 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:24.114512 18975 raft_consensus.cc:2749] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:24.115234 19142 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:24.119679 19064 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:24.121313 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:24.136276 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:24.148765 13249 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:24.153568 19225 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:24.153707 19306 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:24.182169 19142 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:24.182605 19142 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:24.183401 19142 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:24.206923 19142 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:24.412847 19299 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:24.413458 19299 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:24.428937 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:24.429605 13212 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:24.430783 13252 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:24.431656 19225 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:24.432024 19225 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:24.432384 19225 raft_consensus.cc:3060] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:24.432967 19177 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:24.433525 19177 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:24.435568 19177 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:24.439224 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:24.440135 13212 raft_consensus.cc:2368] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14.
I20260709 12:21:24.444761 13252 leader_election.cc:400] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14.
I20260709 12:21:24.445120 13252 leader_election.cc:403] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:24.445875 19064 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:21:24.453029 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:24.454178 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:24.454994 13880 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:24.444890 19299 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:24.482520 19225 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:24.501736 13212 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:24.507176 19141 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:24.512661 19064 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605) with higher term. Message: Invalid argument: T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for earlier term 13. Current term is 14.
I20260709 12:21:24.514323 13280 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:21:24.516499 19141 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:24.530740 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:24.532178 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:24.532997 13885 raft_consensus.cc:2393] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 in current term 15: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:24.536942 19225 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:24.541731 13212 raft_consensus.cc:2468] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:24.543095 13252 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:24.545423 19225 raft_consensus.cc:2804] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:24.548784 19225 raft_consensus.cc:697] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:24.549708 19225 consensus_queue.cc:237] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:24.668048 19235 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.706151 19235 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:24.768375 13103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 58479.5us
I20260709 12:21:24.778564 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:24.789119 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:24.779740 19235 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:24.826799 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 46386.3us
I20260709 12:21:24.829011 13210 raft_consensus.cc:2410] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbc6af7757ec459ab451e47724fdf44b for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:21:24.833706 13841 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:24.847479 19141 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:24.908026 19334 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:24.986028 19153 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.987601 19153 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:24.992036 19153 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:24.974439 19334 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:24.995070 19334 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:24.997663 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:24.998049 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 90883.2us
I20260709 12:21:24.998322 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:24.999486 13885 raft_consensus.cc:2393] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 18: Already voted for candidate cbc6af7757ec459ab451e47724fdf44b in this term.
I20260709 12:21:24.998458 13206 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 18.
I20260709 12:21:25.002552 13103 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:25.006816 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:25.029313 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:25.030028 13206 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 18.
I20260709 12:21:25.012027 19334 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:25.034086 19334 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:25.034483 19334 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:25.052354 13885 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:21:25.040962 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 75936.3us
I20260709 12:21:25.054746 19225 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:21:25.073434 13206 raft_consensus.cc:1275] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:25.076525 19225 consensus_queue.cc:1048] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:25.079635 13033 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51922 (request call id 210) took 7265 ms. Trace:
W20260709 12:21:25.097241 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 78809.7us
I20260709 12:21:25.080046 13033 rpcz_store.cc:276] 0709 12:21:17.805214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.805423 (+   209us) service_pool.cc:224] Handling call
0709 12:21:25.069976 (+7264553us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:24.253652 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:24.254178 (+   526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:24.254214 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:21:24.254231 (+    17us) tablet.cc:662] Decoding operations
0709 12:21:24.284087 (+ 29856us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:24.284191 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:24.284226 (+    35us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:21:24.311835 (+ 27609us) tablet.cc:701] Row locks acquired
0709 12:21:24.312553 (+   718us) write_op.cc:260] PREPARE: finished
0709 12:21:24.315553 (+  3000us) write_op.cc:270] Start()
0709 12:21:24.317562 (+  2009us) write_op.cc:276] Timestamp: P: 1783599684315206 usec, L: 0
0709 12:21:24.318035 (+   473us) op_driver.cc:348] REPLICATION: starting
0709 12:21:24.327257 (+  9222us) log.cc:844] Serialized 9770 byte log entry
0709 12:21:24.369261 (+ 42004us) op_driver.cc:464] REPLICATION: finished
0709 12:21:24.411896 (+ 42635us) write_op.cc:301] APPLY: starting
0709 12:21:24.411991 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:24.523553 (+111562us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:24.523653 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:24.801390 (+277737us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:24.810207 (+  8817us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 12:21:24.810280 (+    73us) write_op.cc:312] APPLY: finished
0709 12:21:24.810955 (+   675us) log.cc:844] Serialized 220 byte log entry
0709 12:21:24.813914 (+  2959us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:24.814125 (+   211us) write_op.cc:454] Released schema lock
0709 12:21:24.814189 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:24.844020 (+ 29831us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:24.845800 (+  1780us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2018121,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":42359,"apply.run_cpu_time_us":37374,"apply.run_wall_time_us":412623,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108777,"num_ops":25,"prepare.queue_time_us":39082,"prepare.run_cpu_time_us":16463,"prepare.run_wall_time_us":88096,"raft.queue_time_us":16960,"raft.run_cpu_time_us":32905,"raft.run_wall_time_us":47832,"replication_time_us":51061,"spinlock_wait_cycles":2432,"thread_start_us":96423,"threads_started":4,"wal-append.queue_time_us":15790}]]}
I20260709 12:21:25.108351 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet b5031b82872c430cbd03772ba96480ff with delete_type TABLET_DATA_TOMBSTONED (TS af3f42f0797349058724e0cb2e637d24 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:42890
I20260709 12:21:25.124294 19334 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.125428 13131 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 18.
I20260709 12:21:25.128460 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:25.129390 19323 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:25.129791 19323 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.130118 19323 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:21:25.142063 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 118695us
I20260709 12:21:25.142843 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:25.140482 13030 catalog_manager.cc:5697] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 9 to 10, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 10 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.141320 19323 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.180897 19346 tablet_replica.cc:333] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:25.182040 19346 raft_consensus.cc:2243] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:25.183027 19346 pending_rounds.cc:70] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Trying to abort 1 pending ops.
I20260709 12:21:25.183313 19346 pending_rounds.cc:77] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Aborting op as it isn't in flight: id { term: 10 index: 8 } timestamp: 7305624214445215744 op_type: NO_OP noop_request { }
I20260709 12:21:25.194239 19346 raft_consensus.cc:2889] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:21:25.189802 13131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:25.194908 13131 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:25.194375 13030 catalog_manager.cc:5697] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 5 to 6, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 6 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:25.186026 19323 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:25.215515 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:25.216778 13880 raft_consensus.cc:2368] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 18. Current term is 19.
I20260709 12:21:25.200964 19346 raft_consensus.cc:2272] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:25.221810 19346 ts_tablet_manager.cc:1916] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:25.205102 13131 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 19.
I20260709 12:21:25.193696 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:25.216645 13030 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 6 to 7, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 7 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.230582 13208 raft_consensus.cc:3060] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:25.231933 13030 catalog_manager.cc:5697] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 7 to 8, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 8 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.204178 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:25.223315 13100 leader_election.cc:400] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 election: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 18. Current term is 19.
I20260709 12:21:25.235016 13100 leader_election.cc:403] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:21:25.202198 19334 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:25.242113 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 128456us
I20260709 12:21:25.241485 13838 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:25.243616 19347 raft_consensus.cc:2804] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:25.244405 19347 raft_consensus.cc:697] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 19 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:25.245273 19347 consensus_queue.cc:237] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.245838 13208 raft_consensus.cc:2468] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 19.
I20260709 12:21:25.242066 19329 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379) with higher term. Message: Invalid argument: T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 for earlier term 18. Current term is 19.
I20260709 12:21:25.289741 13134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:21:25.290377 13134 raft_consensus.cc:606] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 18 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:21:25.296103 13208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:21:25.296708 13208 raft_consensus.cc:606] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:25.297039 13208 raft_consensus.cc:614] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:25.316901 13885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:21:25.317605 13885 raft_consensus.cc:606] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:25.321967 13212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:21:25.322675 13212 raft_consensus.cc:606] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:25.323045 13212 raft_consensus.cc:614] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:25.335096 19329 raft_consensus.cc:993] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:21:25.335821 19142 raft_consensus.cc:1081] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 18 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:21:25.341485 13134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:21:25.342134 13134 raft_consensus.cc:606] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:25.349229 13134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:50024
I20260709 12:21:25.349851 13134 raft_consensus.cc:606] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:21:25.352346 13208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:21:25.353065 13208 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.353482 13208 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:25.359705 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:21:25.361719 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:25.370510 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:25.369076 13208 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.377554 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:25.378302 13134 raft_consensus.cc:3055] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:25.378655 13134 raft_consensus.cc:740] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:25.380072 13134 consensus_queue.cc:260] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.380271 13208 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 19 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:25.381520 13134 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:25.413267 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:25.413980 13885 raft_consensus.cc:3060] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:25.451675 13134 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 19.
I20260709 12:21:25.454717 13175 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:25.458521 19335 raft_consensus.cc:2804] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:25.459134 19335 raft_consensus.cc:697] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 19 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:25.459970 13885 raft_consensus.cc:2468] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 19.
I20260709 12:21:25.467118 19335 consensus_queue.cc:237] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.488489 19346 ts_tablet_manager.cc:1929] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 12:21:25.489696 19346 log.cc:1199] T b5031b82872c430cbd03772ba96480ff P af3f42f0797349058724e0cb2e637d24: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/wals/b5031b82872c430cbd03772ba96480ff
I20260709 12:21:25.496430 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet b5031b82872c430cbd03772ba96480ff (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:21:25.549458 19335 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:25.550130 19335 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:25.554893 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:25.555858 13280 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 18: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:25.556609 19335 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:25.558226 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:25.559595 13134 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 18.
I20260709 12:21:25.561085 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:25.561991 19127 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:25.562425 19127 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:25.562870 19127 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:25.567723 13033 catalog_manager.cc:5697] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 14 to 16, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 16 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.569412 13033 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.570966 13033 catalog_manager.cc:5697] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.572216 19127 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:25.594274 13033 catalog_manager.cc:5697] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.599058 13033 catalog_manager.cc:5697] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 11 to 20, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 20 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.601151 13033 catalog_manager.cc:5697] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 15 to 21, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 21 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.602210 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:25.613170 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:25.614054 13280 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a99436c294734e5cbc3657b2517cefca in current term 18: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:25.617488 13134 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 18.
I20260709 12:21:25.619570 13033 catalog_manager.cc:5697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.608114 19127 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:25.621091 19329 raft_consensus.cc:993] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:25.621702 18944 raft_consensus.cc:1081] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:25.624070 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:25.626318 19127 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:25.643568 19127 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:25.644737 19127 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:25.651280 13208 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:21:25.653318 19341 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:21:25.654392 13030 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42070 (request call id 327) took 56610 ms (client timeout 15000 ms). Trace:
I20260709 12:21:25.633984 13280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:38644
I20260709 12:21:25.655274 13280 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.655750 13280 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:25.621086 13033 catalog_manager.cc:5697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 15 to 18, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 18 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.658438 13033 catalog_manager.cc:5697] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 8 to 13, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 13 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.659904 13033 catalog_manager.cc:5697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.661466 13033 catalog_manager.cc:5697] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 12 to 14, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 14 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.664584 13033 catalog_manager.cc:5697] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 14 to 16, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 16 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.666301 13033 catalog_manager.cc:5697] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 13 to 14, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 14 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.667866 13033 catalog_manager.cc:5697] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:25.669256 13033 catalog_manager.cc:5697] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 5 to 14, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 14 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.669754 13280 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.676434 19142 raft_consensus.cc:993] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:21:25.677939 13134 raft_consensus.cc:1275] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:21:25.682906 19329 raft_consensus.cc:1081] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:21:25.692257 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:25.693002 13134 raft_consensus.cc:3055] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:25.693317 13134 raft_consensus.cc:740] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:25.697856 13212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
W20260709 12:21:25.654901 13030 rpcz_store.cc:269] 0709 12:20:29.043796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.088917 (+ 45121us) service_pool.cc:224] Handling call
0709 12:21:25.654242 (+56565325us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:25.323901 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:25.324504 (+   603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:25.324551 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:21:25.324576 (+    25us) tablet.cc:662] Decoding operations
0709 12:21:25.325293 (+   717us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:25.325390 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:25.325423 (+    33us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:21:25.325881 (+   458us) tablet.cc:701] Row locks acquired
0709 12:21:25.325901 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:21:25.326050 (+   149us) write_op.cc:270] Start()
0709 12:21:25.326174 (+   124us) write_op.cc:276] Timestamp: P: 1783599685326004 usec, L: 0
0709 12:21:25.326197 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:21:25.326912 (+   715us) log.cc:844] Serialized 1694 byte log entry
0709 12:21:25.458864 (+131952us) op_driver.cc:464] REPLICATION: finished
0709 12:21:25.497768 (+ 38904us) write_op.cc:301] APPLY: starting
0709 12:21:25.497865 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:25.504457 (+  6592us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:25.504561 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:25.524331 (+ 19770us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:25.524569 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:21:25.524626 (+    57us) write_op.cc:312] APPLY: finished
0709 12:21:25.524906 (+   280us) log.cc:844] Serialized 49 byte log entry
0709 12:21:25.525120 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:25.525258 (+   138us) write_op.cc:454] Released schema lock
0709 12:21:25.525312 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:25.525786 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:25.525821 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9734,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":38642,"apply.run_cpu_time_us":7196,"apply.run_wall_time_us":27975,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":52307,"prepare.run_cpu_time_us":3349,"prepare.run_wall_time_us":3350,"replication_time_us":132475,"thread_start_us":46688,"threads_started":2}]]}
I20260709 12:21:25.698635 13212 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:25.701066 13280 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:25.698729 13134 consensus_queue.cc:260] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.702498 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:25.703096 13885 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:25.686547 18966 consensus_queue.cc:1048] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:21:25.733037 13210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:46522
I20260709 12:21:25.733783 13210 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.734208 13210 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:25.746419 13134 raft_consensus.cc:3060] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:25.754143 19341 raft_consensus.cc:993] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: : Instructing follower b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:25.760504 13212 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:25.764453 13885 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:25.763751 13210 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.767249 13252 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:25.770020 13210 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:25.770324 19299 raft_consensus.cc:2804] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:25.770854 19299 raft_consensus.cc:697] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:25.772809 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:25.773465 13129 raft_consensus.cc:3055] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:25.773758 13129 raft_consensus.cc:740] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:25.775264 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:25.776536 13885 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:25.779867 13134 raft_consensus.cc:2468] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
I20260709 12:21:25.774533 13129 consensus_queue.cc:260] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.780736 19299 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.781319 13129 raft_consensus.cc:3060] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:25.776235 19347 raft_consensus.cc:1081] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Signalling peer b190224a708b4f068a6dda4006c3a133 to start an election
I20260709 12:21:25.785185 13885 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:21:25.786271 13175 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:25.791822 19335 raft_consensus.cc:2804] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:25.796157 19335 raft_consensus.cc:697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:25.796737 19328 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.797127 19335 consensus_queue.cc:237] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.797327 19328 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:25.804615 13280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3"
dest_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:42730
I20260709 12:21:25.805368 13280 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.805730 13280 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:25.807073 13129 raft_consensus.cc:2468] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:21:25.825373 13280 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.833575 19328 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:25.833987 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:25.835812 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:25.836524 13133 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 18.
I20260709 12:21:25.840407 13249 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:25.843361 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:25.843928 13134 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:25.847635 19356 log.cc:927] Time spent T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:21:25.854274 13134 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:25.855235 13249 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:25.856010 19328 raft_consensus.cc:2804] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:25.857491 19328 raft_consensus.cc:697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:25.858673 19328 consensus_queue.cc:237] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.861888 19299 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:25.862406 19299 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.866503 19299 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:25.876222 13280 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:25.910821 19299 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:25.921558 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:25.922226 13885 raft_consensus.cc:3055] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:25.922358 13880 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:21:25.922614 13885 raft_consensus.cc:740] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:25.923444 13885 consensus_queue.cc:260] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:25.924104 19127 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:25.924561 13885 raft_consensus.cc:3060] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:25.925678 13131 raft_consensus.cc:1275] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:21:25.928066 19336 consensus_queue.cc:1048] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:25.934527 13885 raft_consensus.cc:2468] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
W20260709 12:21:25.946748 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 67481.7us
I20260709 12:21:26.001859 19299 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:26.045926 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 95982.4us
I20260709 12:21:26.059974 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:26.111981 13134 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:21:26.127135 19359 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:26.174481 13279 raft_consensus.cc:1240] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Rejecting Update request from peer a99436c294734e5cbc3657b2517cefca for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:26.177130 19370 consensus_queue.cc:1059] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:26.178068 19370 raft_consensus.cc:3055] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:26.178418 19370 raft_consensus.cc:740] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:26.179282 19370 consensus_queue.cc:260] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:26.180751 19370 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:26.203299 13886 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:26.204943 19359 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:26.204362 13031 catalog_manager.cc:5697] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 9 to 12, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 12 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.207053 13031 catalog_manager.cc:5697] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.212658 13031 catalog_manager.cc:5697] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 6 to 9, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 9 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:26.220296 13134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24"
I20260709 12:21:26.235530 13129 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:26.243723 13249 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:26.245482 19367 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:21:26.252506 13129 raft_consensus.cc:1275] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:26.256635 19332 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:26.259509 19372 consensus_queue.cc:1048] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:26.306771 13031 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 7 to 9, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 9 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.311035 13880 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:26.312769 19328 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:26.335027 13886 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:26.345646 19380 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:21:26.386085 13210 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:26.387678 19328 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:21:26.412164 13083 auto_rebalancer.cc:629] Failed to schedule move for tablet 763333b6723c40cf8a4902d56603e45f: Illegal state: Replica af3f42f0797349058724e0cb2e637d24 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:26.489954 13129 raft_consensus.cc:1275] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:26.492708 19328 consensus_queue.cc:1048] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:26.504530 13033 catalog_manager.cc:5697] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 18 to 19, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 19 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:26.506295 13033 catalog_manager.cc:5697] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 10 to 11, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 11 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:26.524139 13033 catalog_manager.cc:5697] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 15 to 19, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 19 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.541047 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet b5031b82872c430cbd03772ba96480ff with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:42890
W20260709 12:21:26.541946 13031 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42062 (request call id 296) took 42560 ms (client timeout 15000 ms). Trace:
I20260709 12:21:26.577801 13035 catalog_manager.cc:5697] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 11 to 15, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 15 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.583655 13035 catalog_manager.cc:5697] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 10 to 13, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 13 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:26.587210 13035 catalog_manager.cc:5697] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 10 to 13, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 13 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.590977 13035 catalog_manager.cc:5697] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 10 to 11, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 11 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:26.595599 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet b5031b82872c430cbd03772ba96480ff (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
W20260709 12:21:26.542412 13031 rpcz_store.cc:269] 0709 12:20:43.995623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.999992 (+  4369us) service_pool.cc:224] Handling call
0709 12:20:46.080548 (+2080556us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5400002210. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d690b2 00007f70face2759 00007f70fac7aa76 00007f70fac4bd58 00007f70fad4a04e 00007f70f920b2a4 00007f70f920b232 00007f70f920b161 00007f70f920b0dc
0709 12:21:26.541873 (+40461325us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:26.387768 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:26.388316 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:26.388359 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:21:26.388374 (+    15us) tablet.cc:662] Decoding operations
0709 12:21:26.389002 (+   628us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:26.389079 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:26.389104 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:21:26.389510 (+   406us) tablet.cc:701] Row locks acquired
0709 12:21:26.389528 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:21:26.389677 (+   149us) write_op.cc:270] Start()
0709 12:21:26.389786 (+   109us) write_op.cc:276] Timestamp: P: 1783599686389636 usec, L: 0
0709 12:21:26.389806 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:21:26.390454 (+   648us) log.cc:844] Serialized 1694 byte log entry
0709 12:21:26.413384 (+ 22930us) op_driver.cc:464] REPLICATION: finished
0709 12:21:26.419563 (+  6179us) write_op.cc:301] APPLY: starting
0709 12:21:26.419647 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:26.429199 (+  9552us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:26.429282 (+    83us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:26.436326 (+  7044us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:26.436497 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:21:26.436560 (+    63us) write_op.cc:312] APPLY: finished
0709 12:21:26.463260 (+ 26700us) log.cc:844] Serialized 49 byte log entry
0709 12:21:26.464290 (+  1030us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:26.464436 (+   146us) write_op.cc:454] Released schema lock
0709 12:21:26.464498 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:26.468082 (+  3584us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:26.468112 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":211224,"reported_tablets":48,"spinlock_wait_cycles":29916928,"child_traces":[["op",{"apply.queue_time_us":1423,"apply.run_cpu_time_us":6675,"apply.run_wall_time_us":48496,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16744,"num_ops":4,"prepare.queue_time_us":73998,"prepare.run_cpu_time_us":2984,"prepare.run_wall_time_us":2985,"replication_time_us":23379,"thread_start_us":73670,"threads_started":1}]]}
W20260709 12:21:26.632949 13083 auto_rebalancer.cc:629] Failed to schedule move for tablet 7d4c4238ca2d414dbdb755c1217ef912: Illegal state: Replica a99436c294734e5cbc3657b2517cefca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:26.638366 13210 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:21:26.640967 13033 catalog_manager.cc:5697] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 14 to 15, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 15 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:26.639926 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:26.642788 13033 catalog_manager.cc:5697] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 11 to 12, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 12 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:26.666699 13279 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:21:26.671262 19359 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:21:26.682869 13175 consensus_peers.cc:597] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 09b7d0dede2b49f5ba99e11fa703541e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:26.696925 13129 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:21:26.698573 19370 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:26.732295 19336 raft_consensus.cc:2955] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:21:26.740304 13129 raft_consensus.cc:2955] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:21:26.748988 13279 raft_consensus.cc:2955] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:21:26.753104 13032 catalog_manager.cc:5697] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 13 to 16, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 16 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.754913 13032 catalog_manager.cc:5697] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 11 to 14, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 14 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:26.763934 13131 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:21:26.780630 13032 catalog_manager.cc:5697] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 8 to 14, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 14 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:26.782529 13032 catalog_manager.cc:5697] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:26.783934 13032 catalog_manager.cc:5697] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.786485 13032 catalog_manager.cc:5697] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 6 to 12, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 12 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.787955 13032 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:26.789599 13032 catalog_manager.cc:5697] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 8 to 13, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 13 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
W20260709 12:21:26.793390 13035 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42064 (request call id 323) took 36347 ms (client timeout 15000 ms). Trace:
I20260709 12:21:26.795993 13032 catalog_manager.cc:5697] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 12 to 16, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 16 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.810228 13032 catalog_manager.cc:5697] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
W20260709 12:21:26.793787 13035 rpcz_store.cc:269] 0709 12:20:50.446127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.446314 (+   187us) service_pool.cc:224] Handling call
0709 12:20:50.797692 (+351378us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b5400002210. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d690b2 00007f70face2759 00007f70fac7aa76 00007f70fac4bd58 00007f70fad4a04e 00007f70f920b2a4 00007f70f920b232 00007f70f920b161 00007f70f920b0dc
0709 12:21:26.793316 (+35995624us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:26.602766 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:26.603358 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:26.603388 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:21:26.603401 (+    13us) tablet.cc:662] Decoding operations
0709 12:21:26.607767 (+  4366us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:26.607849 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:26.607888 (+    39us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:21:26.609569 (+  1681us) tablet.cc:701] Row locks acquired
0709 12:21:26.609588 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:21:26.609715 (+   127us) write_op.cc:270] Start()
0709 12:21:26.609817 (+   102us) write_op.cc:276] Timestamp: P: 1783599686609671 usec, L: 0
0709 12:21:26.609833 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:21:26.610496 (+   663us) log.cc:844] Serialized 1694 byte log entry
0709 12:21:26.613672 (+  3176us) op_driver.cc:464] REPLICATION: finished
0709 12:21:26.615017 (+  1345us) write_op.cc:301] APPLY: starting
0709 12:21:26.615100 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:26.621421 (+  6321us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:26.621511 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:26.623849 (+  2338us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:26.624021 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:21:26.624062 (+    41us) write_op.cc:312] APPLY: finished
0709 12:21:26.624272 (+   210us) log.cc:844] Serialized 49 byte log entry
0709 12:21:26.628878 (+  4606us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:26.629003 (+   125us) write_op.cc:454] Released schema lock
0709 12:21:26.629047 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:26.629429 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:26.629461 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":135156,"reported_tablets":48,"spinlock_wait_cycles":69582080,"child_traces":[["op",{"apply.queue_time_us":1136,"apply.run_cpu_time_us":5938,"apply.run_wall_time_us":14351,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16744,"num_ops":4,"prepare.queue_time_us":289,"prepare.run_cpu_time_us":3213,"prepare.run_wall_time_us":8006,"replication_time_us":3701}]]}
I20260709 12:21:26.813910 13032 catalog_manager.cc:5697] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.816022 13032 catalog_manager.cc:5697] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 9 to 13, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 13 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:26.817725 13032 catalog_manager.cc:5697] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 10 to 12, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 12 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.822044 13032 catalog_manager.cc:5697] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:26.824409 13032 catalog_manager.cc:5697] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 11 to 12, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 12 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:26.828964 13100 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 -> Peer cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379): Couldn't send request to peer cbc6af7757ec459ab451e47724fdf44b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53ab219d48754e9b883a85ef2a514a1e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:26.839640 13279 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:26.840842 19376 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:26.850232 13886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:21:26.850867 13886 raft_consensus.cc:606] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Received request to transfer leadership to TS af3f42f0797349058724e0cb2e637d24
I20260709 12:21:26.862875 13210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
new_leader_uuid: "b190224a708b4f068a6dda4006c3a133"
 from {username='slave'} at 127.0.0.1:36352
I20260709 12:21:26.863153 13208 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:26.863533 13210 raft_consensus.cc:606] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Received request to transfer leadership to TS b190224a708b4f068a6dda4006c3a133
I20260709 12:21:26.863942 13210 raft_consensus.cc:614] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:26.865548 19142 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:26.871551 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:26.873956 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:26.874670 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:26.905503 19142 raft_consensus.cc:2955] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:21:26.914594 13210 raft_consensus.cc:2955] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
W20260709 12:21:26.981439 13032 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42070 (request call id 329) took 17506 ms (client timeout 15000 ms). Trace:
W20260709 12:21:26.982014 13032 rpcz_store.cc:269] 0709 12:21:09.475230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.475492 (+   262us) service_pool.cc:224] Handling call
0709 12:21:10.293619 (+818127us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b5400002210. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f1c28db1 00007f70f1d68b71 00007f70f1d690b2 00007f70face2759 00007f70fac7aa76 00007f70fac4bd58 00007f70fad4a04e 00007f70f920b2a4 00007f70f920b232 00007f70f920b161 00007f70f920b0dc
0709 12:21:26.981339 (+16687720us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:26.831582 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:26.832103 (+   521us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:26.832145 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:21:26.832173 (+    28us) tablet.cc:662] Decoding operations
0709 12:21:26.833403 (+  1230us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:26.833457 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:26.833480 (+    23us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:21:26.834455 (+   975us) tablet.cc:701] Row locks acquired
0709 12:21:26.834472 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:21:26.834604 (+   132us) write_op.cc:270] Start()
0709 12:21:26.834700 (+    96us) write_op.cc:276] Timestamp: P: 1783599686834561 usec, L: 0
0709 12:21:26.834714 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:21:26.835788 (+  1074us) log.cc:844] Serialized 5929 byte log entry
0709 12:21:26.837982 (+  2194us) op_driver.cc:464] REPLICATION: finished
0709 12:21:26.838435 (+   453us) write_op.cc:301] APPLY: starting
0709 12:21:26.838510 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:26.846019 (+  7509us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:26.846125 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:26.892404 (+ 46279us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:26.892692 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:21:26.892742 (+    50us) write_op.cc:312] APPLY: finished
0709 12:21:26.893133 (+   391us) log.cc:844] Serialized 139 byte log entry
0709 12:21:26.893320 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:26.893489 (+   169us) write_op.cc:454] Released schema lock
0709 12:21:26.893552 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:26.928498 (+ 34946us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:26.928533 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26356,"reported_tablets":47,"spinlock_wait_cycles":6342016,"child_traces":[["op",{"apply.queue_time_us":246,"apply.run_cpu_time_us":18983,"apply.run_wall_time_us":90002,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62790,"num_ops":15,"prepare.queue_time_us":126,"prepare.run_cpu_time_us":4143,"prepare.run_wall_time_us":4481,"replication_time_us":3158}]]}
I20260709 12:21:27.001240 13034 catalog_manager.cc:5697] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 7 to 10, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 10 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
W20260709 12:21:27.012063 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 77968.8us
I20260709 12:21:27.017297 13279 raft_consensus.cc:2955] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:21:27.165201 13028 catalog_manager.cc:5697] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.204700 13028 catalog_manager.cc:5697] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 10 to 13, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 13 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:27.209712 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet b5031b82872c430cbd03772ba96480ff with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:42890
W20260709 12:21:27.221747 13034 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42062 (request call id 297) took 19656 ms (client timeout 15000 ms). Trace:
W20260709 12:21:27.222297 13034 rpcz_store.cc:269] 0709 12:21:07.565056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.567676 (+  2620us) service_pool.cc:224] Handling call
0709 12:21:27.221674 (+19653998us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:27.060876 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:27.061388 (+   512us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:27.061422 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:21:27.061438 (+    16us) tablet.cc:662] Decoding operations
0709 12:21:27.061759 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:27.061814 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:27.061840 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:27.062016 (+   176us) tablet.cc:701] Row locks acquired
0709 12:21:27.062029 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:21:27.062159 (+   130us) write_op.cc:270] Start()
0709 12:21:27.062266 (+   107us) write_op.cc:276] Timestamp: P: 1783599687062117 usec, L: 0
0709 12:21:27.062290 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:21:27.062896 (+   606us) log.cc:844] Serialized 538 byte log entry
0709 12:21:27.064886 (+  1990us) op_driver.cc:464] REPLICATION: finished
0709 12:21:27.065427 (+   541us) write_op.cc:301] APPLY: starting
0709 12:21:27.065510 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:27.066304 (+   794us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:27.066397 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:27.067113 (+   716us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:27.067270 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:21:27.067320 (+    50us) write_op.cc:312] APPLY: finished
0709 12:21:27.067526 (+   206us) log.cc:844] Serialized 25 byte log entry
0709 12:21:27.067680 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:27.067764 (+    84us) write_op.cc:454] Released schema lock
0709 12:21:27.067806 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:27.068150 (+   344us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:27.068178 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16016,"reported_tablets":48,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":319,"apply.run_cpu_time_us":2699,"apply.run_wall_time_us":2700,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":1033,"prepare.run_cpu_time_us":2298,"prepare.run_wall_time_us":2299,"replication_time_us":2473}]]}
I20260709 12:21:27.234613 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet b5031b82872c430cbd03772ba96480ff (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:21:27.291642 19409 ts_tablet_manager.cc:933] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:27.306344 13028 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42064 (request call id 324) took 16013 ms (client timeout 15000 ms). Trace:
I20260709 12:21:27.307072 13029 catalog_manager.cc:5697] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 10 to 14, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 14 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:27.308665 19322 raft_consensus.cc:993] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: : Instructing follower af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:21:27.312168 19363 raft_consensus.cc:1081] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Signalling peer af3f42f0797349058724e0cb2e637d24 to start an election
I20260709 12:21:27.313977 13131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c"
dest_uuid: "af3f42f0797349058724e0cb2e637d24"
 from {username='slave'} at 127.0.0.1:60854
I20260709 12:21:27.313714 13029 catalog_manager.cc:5697] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 13 to 14, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 14 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:27.314568 13131 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:27.314962 13131 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:27.316272 13029 catalog_manager.cc:5697] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 17 to 19, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 19 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.318370 13029 catalog_manager.cc:5697] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 16 to 18, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 18 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:27.321533 13029 catalog_manager.cc:5697] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 12 to 14, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 14 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:27.322901 13029 catalog_manager.cc:5697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.324688 13029 catalog_manager.cc:5697] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.326630 13029 catalog_manager.cc:5697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 8 to 9, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 9 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.325348 13131 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:27.328262 13029 catalog_manager.cc:5697] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 12 to 15, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 15 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.331073 13029 catalog_manager.cc:5697] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 12 to 16, leader changed from b190224a708b4f068a6dda4006c3a133 (127.11.163.3) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 16 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:27.331966 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:27.332468 13284 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:27.331238 13131 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:27.333838 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:27.333482 13029 catalog_manager.cc:5697] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.334488 13886 raft_consensus.cc:3055] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:27.334802 13886 raft_consensus.cc:740] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:27.336540 13029 catalog_manager.cc:5697] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:27.337980 13029 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:27.319293 13028 rpcz_store.cc:269] 0709 12:21:11.296456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.310455 (+ 13999us) service_pool.cc:224] Handling call
0709 12:21:27.306247 (+15995792us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:27.221438 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:27.222274 (+   836us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:27.222327 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:21:27.222357 (+    30us) tablet.cc:662] Decoding operations
0709 12:21:27.222992 (+   635us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:27.223111 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:27.223158 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:21:27.223645 (+   487us) tablet.cc:701] Row locks acquired
0709 12:21:27.223674 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:21:27.223896 (+   222us) write_op.cc:270] Start()
0709 12:21:27.224065 (+   169us) write_op.cc:276] Timestamp: P: 1783599687223834 usec, L: 0
0709 12:21:27.224097 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:21:27.232470 (+  8373us) log.cc:844] Serialized 923 byte log entry
0709 12:21:27.235070 (+  2600us) op_driver.cc:464] REPLICATION: finished
0709 12:21:27.235564 (+   494us) write_op.cc:301] APPLY: starting
0709 12:21:27.235675 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:27.236952 (+  1277us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:27.237042 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:27.238286 (+  1244us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:27.238443 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:21:27.238493 (+    50us) write_op.cc:312] APPLY: finished
0709 12:21:27.238686 (+   193us) log.cc:844] Serialized 33 byte log entry
0709 12:21:27.238839 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:27.238922 (+    83us) write_op.cc:454] Released schema lock
0709 12:21:27.238964 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:27.251960 (+ 12996us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b54003633d4. stack: 00007f70f1d6e343 00007f70f1d6e240 00007f70f16fd1d4 00007f70fb43b304 00007f70fb43b299 00007f70f4df6571 00007f70f4e88e28 00007f70f88c3581 00007f70f88c2d58 00007f70f88c79f1 00007f70f88c79a9 00007f70f88c7939 00007f70f88c7901 00007f70f88c6b2d 0000000000388634 0000000000388479
0709 12:21:27.252172 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:27.252200 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":124035,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":307,"apply.run_cpu_time_us":3688,"apply.run_wall_time_us":5126,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8372,"num_ops":2,"prepare.queue_time_us":132,"prepare.run_cpu_time_us":6231,"prepare.run_wall_time_us":30748,"replication_time_us":10846,"spinlock_wait_cycles":17477888}]]}
I20260709 12:21:27.341032 13886 consensus_queue.cc:260] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:27.342020 13284 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:27.342150 13886 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:27.343581 13102 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:27.340523 13029 catalog_manager.cc:5697] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.344903 19403 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:27.345394 19403 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:27.346215 19403 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:27.350750 19409 tablet_copy_client.cc:323] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.2:34605
I20260709 12:21:27.351671 13886 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 15.
I20260709 12:21:27.354812 13221 tablet_copy_service.cc:140] P a99436c294734e5cbc3657b2517cefca: Received BeginTabletCopySession request for tablet 09b7d0dede2b49f5ba99e11fa703541e from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:36412)
I20260709 12:21:27.355360 13221 tablet_copy_service.cc:161] P a99436c294734e5cbc3657b2517cefca: Beginning new tablet copy session on tablet 09b7d0dede2b49f5ba99e11fa703541e from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:36412: session id = cbc6af7757ec459ab451e47724fdf44b-09b7d0dede2b49f5ba99e11fa703541e
I20260709 12:21:27.363976 19410 ts_tablet_manager.cc:933] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: Initiating tablet copy from peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:21:27.363940 13221 tablet_copy_source_session.cc:215] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:27.375129 19409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b7d0dede2b49f5ba99e11fa703541e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:27.385039 19410 tablet_copy_client.cc:323] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.163.1:35201
I20260709 12:21:27.387012 13147 tablet_copy_service.cc:140] P af3f42f0797349058724e0cb2e637d24: Received BeginTabletCopySession request for tablet 53ab219d48754e9b883a85ef2a514a1e from peer cbc6af7757ec459ab451e47724fdf44b ({username='slave'} at 127.0.0.1:60854)
I20260709 12:21:27.387670 13147 tablet_copy_service.cc:161] P af3f42f0797349058724e0cb2e637d24: Beginning new tablet copy session on tablet 53ab219d48754e9b883a85ef2a514a1e from peer cbc6af7757ec459ab451e47724fdf44b at {username='slave'} at 127.0.0.1:60854: session id = cbc6af7757ec459ab451e47724fdf44b-53ab219d48754e9b883a85ef2a514a1e
I20260709 12:21:27.399107 19409 tablet_copy_client.cc:806] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:27.399788 19409 tablet_copy_client.cc:670] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:27.425040 13147 tablet_copy_source_session.cc:215] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:27.425763 19409 tablet_copy_client.cc:538] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:27.441593 19410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ab219d48754e9b883a85ef2a514a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:27.490600 19409 tablet_bootstrap.cc:492] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:21:27.511930 19410 tablet_copy_client.cc:806] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:27.513242 19410 tablet_copy_client.cc:670] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:27.519557 19410 tablet_copy_client.cc:538] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:27.534252 13124 tablet_service.cc:1558] Processing DeleteTablet for tablet b5031b82872c430cbd03772ba96480ff with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:42890
I20260709 12:21:27.539377 13019 catalog_manager.cc:5028] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): tablet b5031b82872c430cbd03772ba96480ff (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:21:27.561694 13029 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42062 (request call id 298) took 3469 ms. Trace:
I20260709 12:21:27.572142 13029 rpcz_store.cc:276] 0709 12:21:24.091975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.092590 (+   615us) service_pool.cc:224] Handling call
0709 12:21:27.561600 (+3469010us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:27.364896 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:27.365425 (+   529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:27.365456 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:21:27.365472 (+    16us) tablet.cc:662] Decoding operations
0709 12:21:27.366701 (+  1229us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:27.366756 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:27.366782 (+    26us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:21:27.367836 (+  1054us) tablet.cc:701] Row locks acquired
0709 12:21:27.367855 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:21:27.367983 (+   128us) write_op.cc:270] Start()
0709 12:21:27.368094 (+   111us) write_op.cc:276] Timestamp: P: 1783599687367940 usec, L: 0
0709 12:21:27.368122 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:21:27.368809 (+   687us) log.cc:844] Serialized 5544 byte log entry
0709 12:21:27.371552 (+  2743us) op_driver.cc:464] REPLICATION: finished
0709 12:21:27.372005 (+   453us) write_op.cc:301] APPLY: starting
0709 12:21:27.372084 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:27.406432 (+ 34348us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:27.422916 (+ 16484us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:27.459933 (+ 37017us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:27.460176 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 12:21:27.460222 (+    46us) write_op.cc:312] APPLY: finished
0709 12:21:27.460766 (+   544us) log.cc:844] Serialized 129 byte log entry
0709 12:21:27.465001 (+  4235us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:27.465194 (+   193us) write_op.cc:454] Released schema lock
0709 12:21:27.465259 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:27.487740 (+ 22481us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:27.487780 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6112,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":248,"apply.run_cpu_time_us":18575,"apply.run_wall_time_us":115679,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58604,"num_ops":14,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":4217,"prepare.run_wall_time_us":6577,"replication_time_us":3290}]]}
I20260709 12:21:27.649772 19410 tablet_bootstrap.cc:492] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap starting.
I20260709 12:21:27.650142 19376 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:27.650768 19376 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:27.655056 19376 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:27.656787 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:27.657536 13210 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 19.
I20260709 12:21:27.658789 13103 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: 
I20260709 12:21:27.659561 19403 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:27.659678 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:27.659976 19403 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:27.660370 19403 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:27.660533 13284 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 19: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:27.666695 13029 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 10, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 17 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.688198 13029 catalog_manager.cc:5697] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 14 to 15, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 15 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.711383 19403 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:27.723785 19403 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:27.689963 13029 catalog_manager.cc:5697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 reported cstate change: term changed from 17 to 18, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 18 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:27.779821 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:27.781584 13280 raft_consensus.cc:2393] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate af3f42f0797349058724e0cb2e637d24 in current term 19: Already voted for candidate b190224a708b4f068a6dda4006c3a133 in this term.
I20260709 12:21:27.823588 13284 consensus_queue.cc:237] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:27.889824 13278 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:21:27.891693 19418 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:27.893585 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:27.928017 13029 catalog_manager.cc:5697] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 reported cstate change: config changed from index -1 to 11, NON_VOTER cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) added. New cstate: current_term: 16 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } } }
I20260709 12:21:27.984911 13885 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:27.998600 13134 raft_consensus.cc:1275] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:21:27.999796 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 78228.3us
I20260709 12:21:28.000476 13885 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:21:28.003342 19369 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:28.025079 19407 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:21:28.031734 19410 log.cc:927] Time spent T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 12:21:28.031200 13210 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3f42f0797349058724e0cb2e637d24 in term 19.
I20260709 12:21:28.025421 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:28.038079 19407 consensus_queue.cc:1048] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:21:28.068025 19299 raft_consensus.cc:2955] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 8 to 12, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:28.095865 13134 raft_consensus.cc:2955] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 8 to 12, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:28.105913 13103 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133
I20260709 12:21:28.107497 13027 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42070 (request call id 330) took 3460 ms. Trace:
I20260709 12:21:28.113379 19404 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:28.114082 19404 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 19 LEADER]: Becoming Leader. State: Replica: af3f42f0797349058724e0cb2e637d24, State: Running, Role: LEADER
I20260709 12:21:28.116997 19404 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:28.108202 13027 rpcz_store.cc:276] 0709 12:21:24.647368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.647613 (+   245us) service_pool.cc:224] Handling call
0709 12:21:28.107185 (+3459572us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163427,"reported_tablets":47}
I20260709 12:21:28.151547 13030 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42064 (request call id 325) took 1698 ms. Trace:
I20260709 12:21:28.152042 13030 rpcz_store.cc:276] 0709 12:21:26.452661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.453212 (+   551us) service_pool.cc:224] Handling call
0709 12:21:28.151316 (+1698104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38827,"reported_tablets":48}
W20260709 12:21:28.214721 19431 log.cc:927] Time spent T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 12:21:28.267040 19409 log.cc:927] Time spent T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:21:28.277288 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 79770.4us
I20260709 12:21:28.319893 19409 tablet_bootstrap.cc:492] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:28.334815 19409 tablet_bootstrap.cc:492] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:21:28.324997 19410 tablet_bootstrap.cc:492] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:28.334108 13885 raft_consensus.cc:2955] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 8 to 12, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:28.344837 19409 ts_tablet_manager.cc:1403] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.855s	user 0.047s	sys 0.035s
I20260709 12:21:28.364260 19410 tablet_bootstrap.cc:492] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: Bootstrap complete.
I20260709 12:21:28.382669 19410 ts_tablet_manager.cc:1403] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: Time spent bootstrapping tablet: real 0.733s	user 0.047s	sys 0.012s
I20260709 12:21:28.395730 19410 raft_consensus.cc:359] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:21:28.396793 19410 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:21:28.399789 19409 raft_consensus.cc:359] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:21:28.427663 19435 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.428396 19435 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:28.448427 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:28.410463 19409 raft_consensus.cc:740] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Initialized, Role: LEARNER
I20260709 12:21:28.451661 19435 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:28.494573 19410 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
W20260709 12:21:28.502107 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 49908.6us
I20260709 12:21:28.503932 13021 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f042aff5e3084d5e8bd6fcb5335160f5 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:28.506558 19409 consensus_queue.cc:260] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:21:28.519559 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:28.520753 13208 raft_consensus.cc:2410] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b190224a708b4f068a6dda4006c3a133 for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 12:21:28.531963 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:28.533039 19443 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:28.535200 19409 ts_tablet_manager.cc:1434] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.186s	user 0.008s	sys 0.000s
I20260709 12:21:28.537745 13221 tablet_copy_service.cc:342] P a99436c294734e5cbc3657b2517cefca: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-09b7d0dede2b49f5ba99e11fa703541e received from {username='slave'} at 127.0.0.1:36412
I20260709 12:21:28.538396 13221 tablet_copy_service.cc:434] P a99436c294734e5cbc3657b2517cefca: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-09b7d0dede2b49f5ba99e11fa703541e on tablet 09b7d0dede2b49f5ba99e11fa703541e with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:28.538866 19410 ts_tablet_manager.cc:1434] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: Time spent starting tablet: real 0.156s	user 0.011s	sys 0.000s
I20260709 12:21:28.546818 13147 tablet_copy_service.cc:342] P af3f42f0797349058724e0cb2e637d24: Request end of tablet copy session cbc6af7757ec459ab451e47724fdf44b-53ab219d48754e9b883a85ef2a514a1e received from {username='slave'} at 127.0.0.1:60854
I20260709 12:21:28.547411 13147 tablet_copy_service.cc:434] P af3f42f0797349058724e0cb2e637d24: ending tablet copy session cbc6af7757ec459ab451e47724fdf44b-53ab219d48754e9b883a85ef2a514a1e on tablet 53ab219d48754e9b883a85ef2a514a1e with peer cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:28.611981 13210 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:21:28.617345 19419 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:28.659119 13885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
mode: GRACEFUL
new_leader_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:47544
I20260709 12:21:28.660004 13885 raft_consensus.cc:606] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Received request to transfer leadership to TS a99436c294734e5cbc3657b2517cefca
I20260709 12:21:28.668124 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:21:28.670461 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:28.671133 13030 catalog_manager.cc:5697] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 8 to 12, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 15 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:28.683612 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:28.691951 13029 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42062 (request call id 299) took 1063 ms. Trace:
I20260709 12:21:28.741922 13284 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:21:28.744028 19419 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:28.692533 13029 rpcz_store.cc:276] 0709 12:21:27.628465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.628818 (+   353us) service_pool.cc:224] Handling call
0709 12:21:28.691876 (+1063058us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:28.098971 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:28.124443 (+ 25472us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:28.124498 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:21:28.124531 (+    33us) tablet.cc:662] Decoding operations
0709 12:21:28.125328 (+   797us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:28.125420 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:28.125448 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:21:28.126025 (+   577us) tablet.cc:701] Row locks acquired
0709 12:21:28.126087 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:21:28.126265 (+   178us) write_op.cc:270] Start()
0709 12:21:28.126413 (+   148us) write_op.cc:276] Timestamp: P: 1783599688126207 usec, L: 0
0709 12:21:28.126455 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:21:28.127099 (+   644us) log.cc:844] Serialized 1803 byte log entry
0709 12:21:28.217216 (+ 90117us) op_driver.cc:464] REPLICATION: finished
0709 12:21:28.484659 (+267443us) write_op.cc:301] APPLY: starting
0709 12:21:28.484776 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:28.517322 (+ 32546us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:28.517468 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:28.565802 (+ 48334us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:28.639855 (+ 74053us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:21:28.640676 (+   821us) write_op.cc:312] APPLY: finished
0709 12:21:28.641060 (+   384us) log.cc:844] Serialized 49 byte log entry
0709 12:21:28.641247 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:28.641358 (+   111us) write_op.cc:454] Released schema lock
0709 12:21:28.641421 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:28.656337 (+ 14916us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:28.656381 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":86309,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":267083,"apply.run_cpu_time_us":9274,"apply.run_wall_time_us":161527,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":160959,"prepare.run_cpu_time_us":4190,"prepare.run_wall_time_us":28589,"replication_time_us":90538,"thread_start_us":222778,"threads_started":2}]]}
I20260709 12:21:28.834674 13027 catalog_manager.cc:5697] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 18 to 19, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to af3f42f0797349058724e0cb2e637d24 (127.11.163.1). New cstate: current_term: 19 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } }
I20260709 12:21:28.920734 19440 raft_consensus.cc:993] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: : Instructing follower a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:21:28.921285 19440 raft_consensus.cc:1081] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Signalling peer a99436c294734e5cbc3657b2517cefca to start an election
I20260709 12:21:28.922955 13210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
 from {username='slave'} at 127.0.0.1:36412
I20260709 12:21:28.923617 13210 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:28.924054 13210 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:29.007539 13882 raft_consensus.cc:1217] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 12:21:29.018285 13210 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:29.103928 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 51351.7us
I20260709 12:21:29.166433 13210 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Requested vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:29.177021 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:29.177675 13278 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:29.186282 13278 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:29.189975 13177 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:29.192754 19458 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:29.193392 19458 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:29.194504 19458 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:29.207289 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:29.208372 13885 raft_consensus.cc:3055] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:29.208820 13885 raft_consensus.cc:740] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:29.210028 13885 consensus_queue.cc:260] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:29.235162 13885 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:29.313004 19455 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:29.313763 19455 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:29.255039 13882 raft_consensus.cc:1217] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 12:21:29.317266 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:29.341120 19455 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:29.357182 13885 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:29.369731 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet f042aff5e3084d5e8bd6fcb5335160f5 with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:40336
I20260709 12:21:29.376801 19464 tablet_replica.cc:333] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:29.390939 19464 raft_consensus.cc:2243] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:29.394273 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:29.376447 13030 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 14 to 15, leader changed from cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 15 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.408529 13175 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:29.410861 19464 raft_consensus.cc:2272] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:29.418416 19457 raft_consensus.cc:2706] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Received pre-election callback for term 16 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 12:21:29.431027 19464 ts_tablet_manager.cc:1916] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:29.432441 13133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af3f42f0797349058724e0cb2e637d24" is_pre_election: true
I20260709 12:21:29.475518 19464 ts_tablet_manager.cc:1929] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:21:29.476281 19464 log.cc:1199] T f042aff5e3084d5e8bd6fcb5335160f5 P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/f042aff5e3084d5e8bd6fcb5335160f5
I20260709 12:21:29.484440 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet f042aff5e3084d5e8bd6fcb5335160f5 (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
I20260709 12:21:29.492165 19456 raft_consensus.cc:1064] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:21:29.498347 19456 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:29.532991 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:29.546388 13886 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 17 LEARNER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:21:29.547143 13284 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:21:29.548703 19419 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:29.551906 19418 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:29.605901 13278 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:29.609082 19370 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:29.647593 13212 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Refusing update from remote peer af3f42f0797349058724e0cb2e637d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:21:29.649323 19460 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:29.716295 13882 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:21:29.729067 19370 raft_consensus.cc:1064] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: attempting to promote NON_VOTER cbc6af7757ec459ab451e47724fdf44b to VOTER
I20260709 12:21:29.731098 19422 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:29.741496 11916 tablet_server.cc:179] TabletServer@127.11.163.1:0 shutting down...
W20260709 12:21:29.753355 13175 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 12:21:29.761612 19370 consensus_queue.cc:237] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:29.831511 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 63984.7us
I20260709 12:21:29.841110 19456 raft_consensus.cc:2955] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:21:29.857043 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 103704us
W20260709 12:21:29.864226 13175 consensus_peers.cc:597] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:29.875788 13278 raft_consensus.cc:2955] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:21:29.947062 13175 consensus_peers.cc:597] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.042266 13175 consensus_peers.cc:597] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.072988 13175 consensus_peers.cc:597] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.171574 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 292662us
I20260709 12:21:30.173346 13280 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:21:30.210112 19455 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
W20260709 12:21:30.298959 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 249265us
I20260709 12:21:30.295497 13027 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 10 to 11, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "af3f42f0797349058724e0cb2e637d24" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:30.321699 13882 raft_consensus.cc:2955] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:30.383570 13206 raft_consensus.cc:2955] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:21:30.396898 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 320966us
W20260709 12:21:30.404671 13175 consensus_peers.cc:597] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.422891 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 113221us
I20260709 12:21:30.472173 13885 raft_consensus.cc:1275] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 LEARNER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:21:30.468586 13175 consensus_peers.cc:597] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.480944 13175 consensus_peers.cc:597] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.500402 13175 consensus_peers.cc:597] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.496384 13249 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.503675 13249 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.510777 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.505196 13175 consensus_peers.cc:597] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.569284 13249 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.607929 13249 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.612933 13838 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.615216 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 138803us
W20260709 12:21:30.615384 13249 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.616025 13249 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.618155 13249 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.619947 13249 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.626571 13175 consensus_peers.cc:597] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.623855 13838 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.633535 13838 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.642854 13838 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.643886 13838 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.644544 13838 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.645148 13838 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.646692 13838 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:30.650970 19336 consensus_queue.cc:1048] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:21:30.659633 13838 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.660377 13838 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.660970 13838 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.676514 13175 consensus_peers.cc:597] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.682605 13175 consensus_peers.cc:597] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:30.738793 19491 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:30.739411 19491 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:30.723667 19419 raft_consensus.cc:493] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:30.741834 19419 raft_consensus.cc:515] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:30.743162 19491 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:30.744021 19419 leader_election.cc:290] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:30.756381 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:30.766716 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:30.766983 19418 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:30.767692 19418 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:30.769909 19418 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:30.770587 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:30.784482 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6b513b5ce94426880fca53620e1f51" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:30.791004 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:30.792068 13019 catalog_manager.cc:4755] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): ChangeConfig:REMOVE_PEER RPC failed for tablet 53ab219d48754e9b883a85ef2a514a1e: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:30.797709 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd86be5bbd94b1aa09465a16ec1c5b3" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:30.815820 19370 raft_consensus.cc:2955] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:30.803826 13102 leader_election.cc:304] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:30.822088 19456 raft_consensus.cc:2749] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:30.825747 13102 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:30.827778 13103 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:30.828552 19418 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:30.829681 19456 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:30.838846 19490 raft_consensus.cc:493] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:30.839970 19490 raft_consensus.cc:515] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:30.839185 13887 raft_consensus.cc:2955] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:30.853792 19490 leader_election.cc:290] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:30.857352 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:30.834923 13279 raft_consensus.cc:2955] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:21:30.873131 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 76176.8us
I20260709 12:21:30.885129 19456 raft_consensus.cc:493] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:30.896620 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b675043435441bb980d9a219c4d3450" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:30.900473 19419 raft_consensus.cc:493] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:30.901170 19419 raft_consensus.cc:515] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:30.885824 19456 raft_consensus.cc:515] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:30.907843 13100 leader_election.cc:304] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:30.909173 19419 leader_election.cc:290] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:30.913300 19419 raft_consensus.cc:2749] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:30.914129 19460 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:30.914824 19460 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:30.917068 19460 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:30.919608 19460 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:30.920241 19460 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:30.923414 19460 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:30.928654 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:30.935387 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:30.931069 19456 leader_election.cc:290] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:30.948721 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:30.958091 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:30.959391 19376 raft_consensus.cc:493] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:30.959986 19376 raft_consensus.cc:515] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:30.960350 19456 raft_consensus.cc:493] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:30.962167 19376 leader_election.cc:290] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:30.964967 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7b93f2b99d4c27915adea1f987deff" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:30.956867 13030 catalog_manager.cc:5697] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 11 to 12, cbc6af7757ec459ab451e47724fdf44b (127.11.163.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:30.966280 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d6c326c49e497ab8d45ac2cf85f71f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:30.972569 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec9e4c4c40a4fd8a2fa03ecdfa63507" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:30.937760 19490 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:30.954200 19499 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:30.976881 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd867e44d047eeb41637598bf8d7fc" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:30.976297 13103 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:30.980544 19491 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:30.962862 19418 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:30.984258 13286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:30.985530 13102 leader_election.cc:304] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:30.987550 19418 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: NON_VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: true } }
I20260709 12:21:30.996519 19497 raft_consensus.cc:2749] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:30.962451 19456 raft_consensus.cc:515] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:30.997642 19460 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:30.992779 19490 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:31.010684 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904dfe40ae474e1689d6b8be4e1dba77" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:30.987906 19499 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.004937 19459 raft_consensus.cc:493] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:31.024782 19456 leader_election.cc:290] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.025750 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.028817 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.030908 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.018968 19419 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:31.032203 19419 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.032835 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.033766 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820b0db2b544a93ba81b2abe6292404" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.034399 19419 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.035346 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.044167 13103 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.004678 19460 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.049827 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b0e40c530c4ec4b4ac3137f7bbe1f2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.050614 19456 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:31.053608 13103 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.025724 19499 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.062958 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:31.058284 13102 leader_election.cc:304] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:31.029426 19459 raft_consensus.cc:515] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.050143 19490 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:31.065734 11916 tablet_replica.cc:333] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.068677 19456 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:31.082897 13102 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:31.087247 11916 raft_consensus.cc:2243] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.108651 11916 raft_consensus.cc:2272] T f369b73ff12847ccbbb00601fe431eb4 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.109370 19459 leader_election.cc:290] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.112402 19456 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:31.113233 11916 tablet_replica.cc:333] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.082628 19490 raft_consensus.cc:2749] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:31.082923 19499 raft_consensus.cc:493] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:31.113992 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.114450 19499 raft_consensus.cc:515] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.116689 19499 leader_election.cc:290] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.092998 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.119969 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.125058 19418 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:31.099670 19509 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:31.125838 19509 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.128201 19509 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.088586 19460 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.133462 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.112977 19456 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:31.136206 19456 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:31.137410 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.143216 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fdf45f6d794f90a80b05b5fe3f2316" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.144505 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3642b79a5a004395947fefe912c71406" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.146018 19459 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:31.146603 19459 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:31.148736 19459 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:31.151384 13100 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.153396 19460 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:31.154511 13100 leader_election.cc:304] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.155303 19456 raft_consensus.cc:2749] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:31.157536 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.157793 19456 raft_consensus.cc:493] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:31.158758 19456 raft_consensus.cc:515] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:31.160899 19456 leader_election.cc:290] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:31.166677 11916 raft_consensus.cc:2243] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:31.167984 13102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 85159.8us
I20260709 12:21:31.175899 13102 leader_election.cc:304] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:31.172113 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 85169.7us
I20260709 12:21:31.182982 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.175117 11916 raft_consensus.cc:2272] T d4a97da851674edaa6a93f32de934f5c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.168535 19459 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:31.191489 19459 raft_consensus.cc:2749] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:31.194717 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b4bbf33578469487ada15907f2483a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.197893 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.207504 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.209959 19459 raft_consensus.cc:493] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:31.210638 19459 raft_consensus.cc:515] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.212882 19459 leader_election.cc:290] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.213335 19499 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:31.213972 19499 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:31.216338 19499 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:31.217665 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.217759 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.222693 19509 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:31.223304 19509 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:31.224329 19459 raft_consensus.cc:493] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:31.225600 19509 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:31.227026 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.227106 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f042aff5e3084d5e8bd6fcb5335160f5" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.229784 19459 raft_consensus.cc:515] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.234935 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.230829 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937887e1967840639df25a74d4e57bfd" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.234889 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8fccf310364ac9887a867f78b35734" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.232391 11916 tablet_replica.cc:333] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.241882 11916 raft_consensus.cc:2243] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.245254 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.252895 19459 leader_election.cc:290] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.258126 19509 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:31.259157 19509 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:31.261540 19509 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:31.262704 11916 raft_consensus.cc:2272] T 8820b0db2b544a93ba81b2abe6292404 P af3f42f0797349058724e0cb2e637d24 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.266194 11916 tablet_replica.cc:333] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.277655 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.279155 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca13f9e740914dfbb5008f9905f1da76" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.289117 19509 raft_consensus.cc:493] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:31.310022 19456 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:31.310638 19456 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.311581 19418 raft_consensus.cc:493] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:31.312144 19418 raft_consensus.cc:515] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.312762 19456 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.289912 19499 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:31.300163 19460 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:31.314783 19499 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:31.315177 19460 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.310001 19509 raft_consensus.cc:515] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:31.317528 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.318074 19460 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.319053 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.319779 19509 leader_election.cc:290] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.314194 19418 leader_election.cc:290] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:31.320729 19499 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:31.322981 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.323951 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.329420 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.330111 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b25f727caf4a5598422d510a2e6868" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.333235 13100 leader_election.cc:304] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.323004 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:31.335139 19459 raft_consensus.cc:2749] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:31.336495 13103 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.337559 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c48a9952404409941f272f18f7aa28" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.340499 19459 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:31.333966 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:31.347507 11916 raft_consensus.cc:2243] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.348881 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a8c3577014cf6ba54f48ffedf7594" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.351127 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0277518ce1314a3c82f3ab5bad63bdc6" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.351751 11916 raft_consensus.cc:2272] T 3642b79a5a004395947fefe912c71406 P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.354028 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763333b6723c40cf8a4902d56603e45f" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.352609 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad86a9f99c849fa9efa50969bc43d9a" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.348939 13100 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.359732 19459 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:31.363804 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a264a18f24b6b9933300ddcde0f4e" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.367775 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.369414 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c37477a485ab4cbfbeddcf8f65632297" candidate_uuid: "af3f42f0797349058724e0cb2e637d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:31.357795 13102 leader_election.cc:304] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.384435 13102 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:31.385078 19459 raft_consensus.cc:2749] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:31.386112 11916 tablet_replica.cc:333] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.397264 11916 raft_consensus.cc:2243] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.399032 19459 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:31.404934 11916 raft_consensus.cc:2272] T 3c6b513b5ce94426880fca53620e1f51 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.411052 11916 tablet_replica.cc:333] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.401193 13102 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:31.419358 19459 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:31.421018 13102 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.421792 19459 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:31.425401 13102 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:31.426170 19459 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:31.427560 13102 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:31.434762 19459 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:31.436369 13102 leader_election.cc:304] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.434110 11916 raft_consensus.cc:2243] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.437361 19459 raft_consensus.cc:2749] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:31.438622 11916 raft_consensus.cc:2272] T 904dfe40ae474e1689d6b8be4e1dba77 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.446635 13102 leader_election.cc:304] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:31.448580 11916 tablet_replica.cc:333] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.449059 19459 raft_consensus.cc:2749] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:31.449995 13102 leader_election.cc:304] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.455329 19459 raft_consensus.cc:2749] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:31.458504 13102 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:31.459703 11916 raft_consensus.cc:2243] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.460777 19459 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:31.467764 13102 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:31.468711 11916 raft_consensus.cc:2272] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.469579 19459 raft_consensus.cc:2706] T 0277518ce1314a3c82f3ab5bad63bdc6 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Received pre-election callback for term 18 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 12:21:31.472841 11916 tablet_replica.cc:333] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.487558 11916 raft_consensus.cc:2243] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.473743 13102 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:31.488472 11916 raft_consensus.cc:2272] T ca13f9e740914dfbb5008f9905f1da76 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.512145 19459 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:31.512605 13102 leader_election.cc:304] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.516741 19459 raft_consensus.cc:2749] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:31.522668 13102 leader_election.cc:304] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:31.527068 11916 tablet_replica.cc:333] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.527531 19509 raft_consensus.cc:2749] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:31.528321 11916 raft_consensus.cc:2243] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.542647 13102 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af3f42f0797349058724e0cb2e637d24; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:31.545632 11916 raft_consensus.cc:2272] T 25bd867e44d047eeb41637598bf8d7fc P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.550806 19459 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:31.554853 11916 tablet_replica.cc:333] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.563046 11916 raft_consensus.cc:2243] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.591001 11916 raft_consensus.cc:2272] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.606407 11916 tablet_replica.cc:333] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.620220 11916 raft_consensus.cc:2243] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.624373 11916 raft_consensus.cc:2272] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P af3f42f0797349058724e0cb2e637d24 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.627923 11916 tablet_replica.cc:333] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.628810 11916 raft_consensus.cc:2243] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.629547 11916 raft_consensus.cc:2272] T 2f4a8424978a43d1ba67730ec2d91f76 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.636806 11916 tablet_replica.cc:333] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.637699 11916 raft_consensus.cc:2243] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.638909 11916 raft_consensus.cc:2272] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.645812 11916 tablet_replica.cc:333] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.646755 11916 raft_consensus.cc:2243] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.667933 11916 raft_consensus.cc:2272] T 9ad86a9f99c849fa9efa50969bc43d9a P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.681414 11916 tablet_replica.cc:333] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.682415 11916 raft_consensus.cc:2243] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.699679 11916 raft_consensus.cc:2272] T f9377aea669547028ee8449f654c60b7 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.717115 11916 tablet_replica.cc:333] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.718052 11916 raft_consensus.cc:2243] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.718715 11916 raft_consensus.cc:2272] T 1c7b93f2b99d4c27915adea1f987deff P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.727403 11916 tablet_replica.cc:333] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.738844 11916 raft_consensus.cc:2243] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.740664 11916 raft_consensus.cc:2272] T 763333b6723c40cf8a4902d56603e45f P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.760196 11916 tablet_replica.cc:333] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.761090 11916 raft_consensus.cc:2243] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.762215 11916 raft_consensus.cc:2272] T 7ef464caba794ab4955c661c56df278f P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.765036 11916 tablet_replica.cc:333] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.765931 11916 raft_consensus.cc:2243] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.778993 11916 raft_consensus.cc:2272] T 1622215fe6114b4b80c6430c2cbf33d0 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.782195 11916 tablet_replica.cc:333] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.791088 11916 raft_consensus.cc:2243] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.808341 11916 raft_consensus.cc:2272] T 06fdf45f6d794f90a80b05b5fe3f2316 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.811314 11916 tablet_replica.cc:333] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.812279 11916 raft_consensus.cc:2243] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.813364 11916 raft_consensus.cc:2272] T 44133e1a03bc4412a20badffb41bb55e P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.825589 11916 tablet_replica.cc:333] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.826443 11916 raft_consensus.cc:2243] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.827214 11916 raft_consensus.cc:2272] T e58a8c3577014cf6ba54f48ffedf7594 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.830289 11916 tablet_replica.cc:333] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.833390 11916 raft_consensus.cc:2243] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.881295 11916 raft_consensus.cc:2272] T a9b25f727caf4a5598422d510a2e6868 P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.884426 11916 tablet_replica.cc:333] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.885730 11916 raft_consensus.cc:2243] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.886471 11916 raft_consensus.cc:2272] T 79d6c326c49e497ab8d45ac2cf85f71f P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.890784 11916 tablet_replica.cc:333] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.891690 11916 raft_consensus.cc:2243] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.892853 11916 raft_consensus.cc:2272] T f2ad0088ea4e4b988f1c76b3260f2b55 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.895799 11916 tablet_replica.cc:333] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.903035 11916 raft_consensus.cc:2243] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.905409 11916 raft_consensus.cc:2272] T 7f8fccf310364ac9887a867f78b35734 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.915127 11916 tablet_replica.cc:333] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.916106 11916 raft_consensus.cc:2243] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.916894 11916 raft_consensus.cc:2272] T b2b4bbf33578469487ada15907f2483a P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.919772 11916 tablet_replica.cc:333] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.920746 11916 raft_consensus.cc:2243] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.921365 11916 raft_consensus.cc:2272] T 95ba4ee627684f4ea7e32e683e7bcd72 P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.924393 11916 tablet_replica.cc:333] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.925236 11916 raft_consensus.cc:2243] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.925858 11916 raft_consensus.cc:2272] T 6b675043435441bb980d9a219c4d3450 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.928737 11916 tablet_replica.cc:333] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.942745 11916 raft_consensus.cc:2243] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.944015 11916 raft_consensus.cc:2272] T 86b4311504b54b2c8d99d43a9b057e8f P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.947141 11916 tablet_replica.cc:333] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.948024 11916 raft_consensus.cc:2243] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.949405 11916 raft_consensus.cc:2272] T a3da01ae07634adb9184db323ba32a1c P af3f42f0797349058724e0cb2e637d24 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.958472 11916 tablet_replica.cc:333] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.959937 11916 raft_consensus.cc:2243] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.960636 11916 raft_consensus.cc:2272] T 6f2a264a18f24b6b9933300ddcde0f4e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.963591 11916 tablet_replica.cc:333] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.964424 11916 raft_consensus.cc:2243] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.965029 11916 raft_consensus.cc:2272] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P af3f42f0797349058724e0cb2e637d24 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.972074 11916 tablet_replica.cc:333] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.972977 11916 raft_consensus.cc:2243] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.973681 11916 raft_consensus.cc:2272] T 09b7d0dede2b49f5ba99e11fa703541e P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.976766 11916 tablet_replica.cc:333] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.977886 11916 raft_consensus.cc:2243] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.978495 11916 raft_consensus.cc:2272] T 51d5ddc60f3a4b948881a4efc95b8721 P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.981459 11916 tablet_replica.cc:333] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.982259 11916 raft_consensus.cc:2243] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.983651 11916 raft_consensus.cc:2272] T 2f7a6bb73699404e86b7d94b6633703c P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.992564 11916 tablet_replica.cc:333] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:31.993355 11916 raft_consensus.cc:2243] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.994123 11916 raft_consensus.cc:2272] T 937887e1967840639df25a74d4e57bfd P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.000893 11916 tablet_replica.cc:333] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:32.006042 11916 raft_consensus.cc:2243] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:32.008140 11916 raft_consensus.cc:2272] T 93c48a9952404409941f272f18f7aa28 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.021203 11916 tablet_replica.cc:333] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:32.022141 11916 raft_consensus.cc:2243] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:32.022768 11916 raft_consensus.cc:2272] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.025972 11916 tablet_replica.cc:333] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:32.026966 11916 raft_consensus.cc:2243] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:32.028475 11916 raft_consensus.cc:2272] T 53ab219d48754e9b883a85ef2a514a1e P af3f42f0797349058724e0cb2e637d24 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.031600 11916 tablet_replica.cc:333] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:32.032652 11916 raft_consensus.cc:2243] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:32.033340 11916 raft_consensus.cc:2272] T c37477a485ab4cbfbeddcf8f65632297 P af3f42f0797349058724e0cb2e637d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.045557 11916 tablet_replica.cc:333] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:32.046347 11916 raft_consensus.cc:2243] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:32.047483 11916 raft_consensus.cc:2272] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P af3f42f0797349058724e0cb2e637d24 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.058542 11916 tablet_replica.cc:333] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:32.065271 11916 raft_consensus.cc:2243] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:32.066256 11916 raft_consensus.cc:2272] T e1a3fa2c26ae4d9a8803582f91f9cff2 P af3f42f0797349058724e0cb2e637d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.069065 11916 tablet_replica.cc:333] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:32.069805 11916 raft_consensus.cc:2243] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:32.090659 11916 raft_consensus.cc:2272] T a2b8aac4336e49d4bc5ba21f80833bd5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.100010 11916 tablet_replica.cc:333] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:32.101187 11916 raft_consensus.cc:2243] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:32.102310 11916 raft_consensus.cc:2272] T 7d4c4238ca2d414dbdb755c1217ef912 P af3f42f0797349058724e0cb2e637d24 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.110641 11916 tablet_replica.cc:333] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:32.111310 11916 raft_consensus.cc:2243] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:32.111886 11916 raft_consensus.cc:2272] T 1505ff0869734d74a99b739df5b0530a P af3f42f0797349058724e0cb2e637d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.117060 11916 tablet_replica.cc:333] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24: stopping tablet replica
I20260709 12:21:32.117761 11916 raft_consensus.cc:2243] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:32.118460 11916 raft_consensus.cc:2272] T f042aff5e3084d5e8bd6fcb5335160f5 P af3f42f0797349058724e0cb2e637d24 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:32.127247 13019 catalog_manager.cc:4755] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): ChangeConfig:REMOVE_PEER RPC failed for tablet 53ab219d48754e9b883a85ef2a514a1e: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:32.155898 19510 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.181038 19510 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:32.191045 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:32.199800 19336 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.201144 19336 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:32.204010 19336 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:32.208689 13175 consensus_peers.cc:597] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.215358 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 48438us
I20260709 12:21:32.246964 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:32.247692 13887 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:32.253892 19510 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:32.293316 13838 leader_election.cc:336] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:32.293876 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:32.302057 19510 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:32.324200 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:32.327646 19495 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:32.328117 19495 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.328516 19495 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:32.335659 19495 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:32.339236 13175 leader_election.cc:336] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:32.344558 19495 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:32.364727 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:32.365355 13887 raft_consensus.cc:3060] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:32.375376 13887 raft_consensus.cc:2468] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
W20260709 12:21:32.378624 13175 consensus_peers.cc:597] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.382670 13175 consensus_peers.cc:597] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:32.393913 13175 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:32.394789 19495 raft_consensus.cc:2804] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:32.396458 19495 raft_consensus.cc:697] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:32.397490 19495 consensus_queue.cc:237] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:32.407943 13175 leader_election.cc:336] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:32.428452 13030 catalog_manager.cc:5697] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 15 to 16, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 16 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:32.458817 19495 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.459574 19495 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:32.464363 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:32.479054 19495 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:32.486106 13175 leader_election.cc:336] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:32.488083 13175 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:32.489461 19336 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:32.519997 13175 consensus_peers.cc:597] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.613528 13838 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.618520 13249 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.622700 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.633086 13175 consensus_peers.cc:597] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.636246 13175 consensus_peers.cc:597] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.636785 13175 consensus_peers.cc:597] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.657933 13838 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:32.671464 19513 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.672072 19513 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:32.673863 13175 consensus_peers.cc:597] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:32.676400 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:32.680473 13249 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.681084 13838 leader_election.cc:336] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:32.681902 19513 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:32.681576 13838 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:32.683593 19513 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:32.713260 13249 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.735214 13175 consensus_peers.cc:597] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:32.787176 19455 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.787775 19455 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:32.789986 19455 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:32.790565 13175 consensus_peers.cc:597] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:32.791510 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:32.799118 13175 leader_election.cc:336] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:32.799660 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:32.800524 19455 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:32.806124 19455 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.806886 19455 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:32.810015 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:32.811825 19455 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:32.812110 13249 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.816365 13175 consensus_peers.cc:597] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.820341 13175 leader_election.cc:336] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:32.820811 13175 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:32.821657 19455 raft_consensus.cc:2749] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:32.843031 13175 consensus_peers.cc:597] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:32.846302 13838 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:32.852219 13880 raft_consensus.cc:1275] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:32.853770 19495 consensus_queue.cc:1048] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:32.860466 19483 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.861112 19483 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:32.863219 19473 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.863976 19473 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:32.866242 19473 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:32.866778 19473 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.868193 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:32.868069 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:32.868911 13206 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 9.
I20260709 12:21:32.869490 19473 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:32.870735 13252 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:32.871785 19473 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:32.872356 19473 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.872866 19473 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:32.863327 19483 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:32.884938 19523 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:32.885510 19523 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.885941 19523 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:32.890908 13249 leader_election.cc:336] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:32.891479 13249 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:32.892390 13249 leader_election.cc:336] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:32.893039 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:32.893703 13208 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:32.894596 19483 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:32.894950 13252 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:32.895918 19483 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:32.896334 19483 raft_consensus.cc:493] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.896731 19483 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:32.905581 19473 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:32.911638 13838 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:32.912195 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:32.913115 13887 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
W20260709 12:21:32.913820 13249 leader_election.cc:336] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:32.917531 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:32.923228 19473 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:32.923686 19473 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.924059 19473 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:21:32.942196 13838 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:32.935793 13249 leader_election.cc:336] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:32.960716 19523 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:32.947162 19483 raft_consensus.cc:515] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:32.965034 19483 leader_election.cc:290] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:32.972764 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377aea669547028ee8449f654c60b7" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:32.973474 13206 raft_consensus.cc:3060] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:32.975481 19473 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:32.975909 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:32.976451 13208 raft_consensus.cc:3060] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:32.977602 19473 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:32.985003 13206 raft_consensus.cc:2468] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 17.
I20260709 12:21:32.963013 19523 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:32.987515 19495 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:32.991089 19495 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:32.993228 19495 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:32.995853 13252 leader_election.cc:304] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:32.997545 19524 raft_consensus.cc:2804] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:32.998102 19524 raft_consensus.cc:697] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 17 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:32.999086 19524 consensus_queue.cc:237] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:33.006188 13175 leader_election.cc:336] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:33.007963 13838 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:33.010332 13880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:33.032544 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:33.034044 13838 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:33.027083 13208 raft_consensus.cc:2468] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 10.
I20260709 12:21:33.040494 19455 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:33.058410 13252 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:33.059216 19473 raft_consensus.cc:2804] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:33.059768 19473 raft_consensus.cc:697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:33.060634 19473 consensus_queue.cc:237] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.067732 19524 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.068336 19524 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.069314 19483 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.069883 19483 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.072114 19483 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:33.073524 19455 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.074077 19524 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:33.074070 19455 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.077324 19455 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:33.076753 13030 catalog_manager.cc:5697] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 16 to 17, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 17 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:33.078630 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:33.079820 13281 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
I20260709 12:21:33.081333 13177 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:33.082690 19455 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:33.083084 19455 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.083510 19455 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:33.084343 19510 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.084960 19510 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.096119 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:33.097513 19487 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.098026 19510 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:33.098135 19487 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.100629 19487 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:33.102840 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:33.107901 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:33.118099 13841 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:33.119308 19510 raft_consensus.cc:2749] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:33.131183 19455 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:33.134413 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 160635us
W20260709 12:21:33.136106 13838 leader_election.cc:336] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:33.137087 13838 leader_election.cc:336] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.137527 13838 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:33.146517 19455 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:33.164440 19510 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:33.171813 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:33.170869 19487 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.172554 13206 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 19.
I20260709 12:21:33.172747 19487 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.174823 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1622215fe6114b4b80c6430c2cbf33d0" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:33.174849 19487 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:33.175459 13284 raft_consensus.cc:3060] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:33.176987 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
W20260709 12:21:33.181026 13249 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:33.181779 13249 leader_election.cc:336] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:33.182662 13249 leader_election.cc:336] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.188696 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:33.189404 19522 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:33.189808 19522 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.190189 19522 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:33.199134 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb24dc556e54ae2bb5b9d6900ea82f5" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:33.199791 13885 raft_consensus.cc:3060] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:33.205945 13284 raft_consensus.cc:2468] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:33.216144 13885 raft_consensus.cc:2468] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 17.
I20260709 12:21:33.220031 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:33.218174 19526 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:21:33.232139 13838 leader_election.cc:336] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.232802 13838 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:33.234335 13838 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:33.184161 19510 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.239940 19510 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.237833 19487 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:33.242425 19510 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:33.238237 13249 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:33.237075 19495 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.236567 13177 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:33.227087 19526 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.258948 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
W20260709 12:21:33.261262 13838 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:33.263341 19526 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:33.263979 19526 raft_consensus.cc:2804] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:33.264417 19526 raft_consensus.cc:697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 17 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:33.265288 19526 consensus_queue.cc:237] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.267841 19524 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.268348 19524 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.249127 19455 raft_consensus.cc:2804] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:33.270154 19455 raft_consensus.cc:697] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:33.270397 19524 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:33.271024 19455 consensus_queue.cc:237] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:33.274209 13838 leader_election.cc:336] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.276104 13030 catalog_manager.cc:5697] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 9 to 10, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 10 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:33.284518 19522 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.286780 19522 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 20 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:33.276978 13840 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:33.250345 19495 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.288439 19535 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:33.297418 19336 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.298117 19336 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:33.297113 13175 leader_election.cc:336] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.289634 19495 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:33.314435 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:33.316054 19336 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:33.315407 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 77237.4us
I20260709 12:21:33.328575 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:33.329427 13885 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 15.
W20260709 12:21:33.331944 13019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 77949.5us
I20260709 12:21:33.319738 19495 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.337440 19495 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.339653 19495 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:33.340821 19534 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.341426 19534 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.332345 19473 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.343897 19473 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.346603 19473 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:33.349604 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:33.350229 13284 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 15.
W20260709 12:21:33.350389 13838 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:33.352381 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:33.352963 13208 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 18.
I20260709 12:21:33.354071 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:33.354888 19510 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:33.355235 19510 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.355414 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:33.355623 19510 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:33.359089 19534 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:33.361816 13838 leader_election.cc:336] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.361976 13030 catalog_manager.cc:5697] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 16 to 17, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 17 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:33.369313 19510 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.375119 19473 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:33.376071 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:33.376449 19336 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
W20260709 12:21:33.432174 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 56180.4us
W20260709 12:21:33.376696 13249 leader_election.cc:336] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.432314 19336 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:33.433352 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 56675.7us
W20260709 12:21:33.433893 13249 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:33.434348 13249 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:33.434725 13249 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.434999 19336 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:33.400559 13019 catalog_manager.cc:4755] TS af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): ChangeConfig:REMOVE_PEER RPC failed for tablet 53ab219d48754e9b883a85ef2a514a1e: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.431807 19473 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.403353 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:33.436655 13210 raft_consensus.cc:3060] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:33.437335 19510 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:33.406225 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:33.406944 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:33.441129 13206 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 17.
I20260709 12:21:33.404008 13030 catalog_manager.cc:5697] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 15 to 16, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 16 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:33.435103 13249 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:33.380429 19526 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.443022 19526 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.445168 19526 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:33.436210 19473 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:33.448982 19537 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:33.449467 19537 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.449862 19537 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:33.451800 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:33.453060 13206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:33.453612 13206 raft_consensus.cc:3060] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:33.452421 13279 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 17.
I20260709 12:21:33.460071 19495 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.460623 19495 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.462687 19495 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:33.464659 13175 leader_election.cc:336] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:33.465555 13175 consensus_peers.cc:597] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:33.468667 13206 raft_consensus.cc:2468] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 19.
I20260709 12:21:33.468905 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:33.471570 19541 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:21:33.472304 13249 leader_election.cc:336] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:33.488725 13249 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:33.489231 13279 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 19.
W20260709 12:21:33.472761 13838 leader_election.cc:336] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.476589 13210 raft_consensus.cc:2468] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 20.
I20260709 12:21:33.495759 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:33.496444 13885 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 11.
I20260709 12:21:33.500577 13177 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:33.503893 13206 raft_consensus.cc:1275] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:21:33.504861 19543 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:33.505319 19543 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.505685 19543 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:33.508495 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:33.509177 13885 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 17.
W20260709 12:21:33.515187 13175 leader_election.cc:336] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.471181 19537 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.493198 13841 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:33.519934 19534 raft_consensus.cc:2804] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:33.520732 19534 raft_consensus.cc:697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 19 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:33.521786 19537 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:33.521689 19534 consensus_queue.cc:237] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.522923 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:33.523591 13281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44133e1a03bc4412a20badffb41bb55e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:33.514087 19543 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.523753 19537 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:33.524677 13175 leader_election.cc:336] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.477607 19473 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.526962 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da01ae07634adb9184db323ba32a1c" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:33.527536 13279 raft_consensus.cc:3060] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:33.524263 13281 raft_consensus.cc:3060] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:33.530208 13252 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:33.531684 19538 raft_consensus.cc:2804] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:21:33.532305 19538 raft_consensus.cc:697] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 20 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:33.531715 19526 consensus_queue.cc:1048] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:33.533310 19538 consensus_queue.cc:237] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.525945 19543 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:33.541446 13279 raft_consensus.cc:2468] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 20.
W20260709 12:21:33.517989 13249 leader_election.cc:336] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.542709 13177 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:21:33.543138 13249 leader_election.cc:336] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.544071 19543 raft_consensus.cc:2804] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:21:33.551164 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:33.551417 19543 raft_consensus.cc:697] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 20 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
W20260709 12:21:33.547127 11916 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 13158)
I20260709 12:21:33.547596 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:33.552899 13882 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
W20260709 12:21:33.553901 13249 leader_election.cc:336] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.545171 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:33.552026 19541 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:33.556125 13885 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 17.
I20260709 12:21:33.531111 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:33.558452 13175 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:33.559031 19545 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:33.565229 19545 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.565636 19545 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:33.566387 13175 leader_election.cc:336] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.567613 19537 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:33.568064 19537 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.568513 19537 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:33.548962 19473 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:33.554848 19543 consensus_queue.cc:237] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:33.573017 13249 leader_election.cc:336] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:33.576524 13249 leader_election.cc:336] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:33.567291 13175 leader_election.cc:336] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:33.578052 13175 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.585439 13029 catalog_manager.cc:5697] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 18 to 19, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 19 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:33.590116 19455 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.590667 19455 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.592649 19455 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:33.595197 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:33.595836 13279 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
I20260709 12:21:33.597872 13177 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
I20260709 12:21:33.598752 19544 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:33.599141 19544 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.599521 19544 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:21:33.604764 13249 leader_election.cc:336] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.582064 13030 catalog_manager.cc:5697] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 19 to 20, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 20 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:33.615965 13249 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:33.616976 13249 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:33.594684 19537 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.621297 19537 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:33.624204 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:33.624850 13279 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:33.564731 13281 raft_consensus.cc:2468] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 16.
W20260709 12:21:33.560437 13838 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:33.638073 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 77684.6us
W20260709 12:21:33.640379 13175 leader_election.cc:336] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:33.641041 13175 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.641502 19534 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.642124 19534 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.644246 19534 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:33.645954 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:33.646586 13208 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:33.647863 13841 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:33.652045 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:33.652700 13882 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:33.648811 19534 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:33.663765 19534 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.664657 19534 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:33.667080 13279 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 18.
W20260709 12:21:33.662393 13175 leader_election.cc:336] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:33.691053 13175 leader_election.cc:336] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.659688 13177 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:33.673403 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:33.693046 19538 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:33.693434 19538 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election (detected failure of leader af3f42f0797349058724e0cb2e637d24)
I20260709 12:21:33.693787 19538 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:33.700008 13249 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
W20260709 12:21:33.700456 13838 leader_election.cc:336] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.703444 19495 raft_consensus.cc:2804] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:33.678570 19534 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.661615 13882 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 18.
I20260709 12:21:33.679832 19545 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.715824 19545 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:33.681828 19544 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.682122 13029 catalog_manager.cc:5697] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 19 to 20, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 20 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:33.716442 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:33.717097 13210 raft_consensus.cc:3060] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:33.717785 19544 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:33.688215 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7a6bb73699404e86b7d94b6633703c" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:33.718458 13885 raft_consensus.cc:3060] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:33.724931 19473 raft_consensus.cc:2764] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:21:33.728931 13210 raft_consensus.cc:2468] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
I20260709 12:21:33.730278 13841 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:33.731923 19510 raft_consensus.cc:2804] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:33.732399 19510 raft_consensus.cc:697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:33.733232 19510 consensus_queue.cc:237] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.737740 19534 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:33.744030 13885 raft_consensus.cc:2468] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:33.747027 13206 raft_consensus.cc:1275] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:33.751206 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b4311504b54b2c8d99d43a9b057e8f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:33.751859 13882 raft_consensus.cc:3060] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:33.752200 13880 raft_consensus.cc:1275] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:21:33.736116 19538 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.762573 13882 raft_consensus.cc:2468] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 12.
I20260709 12:21:33.762706 13249 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:33.768663 19541 raft_consensus.cc:2804] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:33.769069 19538 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:33.769212 19541 raft_consensus.cc:697] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:33.770185 19473 consensus_queue.cc:1048] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:33.770211 19541 consensus_queue.cc:237] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:33.775103 13838 leader_election.cc:336] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.779821 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ad0088ea4e4b988f1c76b3260f2b55" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:33.780449 13886 raft_consensus.cc:3060] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:33.781356 13175 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:33.792716 19526 consensus_queue.cc:1048] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:33.793846 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4c4238ca2d414dbdb755c1217ef912" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:33.794194 13281 raft_consensus.cc:1275] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:33.794417 13284 raft_consensus.cc:3060] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:33.794958 13886 raft_consensus.cc:2468] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 14.
W20260709 12:21:33.799157 13249 leader_election.cc:336] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.801653 13284 raft_consensus.cc:2468] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a99436c294734e5cbc3657b2517cefca in term 17.
I20260709 12:21:33.803221 13249 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:33.806115 13175 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:33.807179 13177 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133; no voters: 
W20260709 12:21:33.809185 13175 leader_election.cc:336] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:33.809944 13175 leader_election.cc:336] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:33.806563 19544 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:33.813663 19552 raft_consensus.cc:2804] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:33.814184 19552 raft_consensus.cc:697] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:33.805516 19538 raft_consensus.cc:2804] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:33.815039 19538 raft_consensus.cc:697] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:33.815222 19455 consensus_queue.cc:1048] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:33.815858 19543 raft_consensus.cc:2804] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:33.816486 19543 raft_consensus.cc:697] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:33.815065 19552 consensus_queue.cc:237] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.817375 19543 consensus_queue.cc:237] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.815958 19538 consensus_queue.cc:237] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.792068 19495 raft_consensus.cc:697] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:33.844688 19495 consensus_queue.cc:237] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:33.826642 19544 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Becoming Leader. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:33.874215 19544 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:33.897956 13029 catalog_manager.cc:5697] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 15 to 16, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 16 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:33.936717 13206 raft_consensus.cc:1275] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:21:33.932384 13030 catalog_manager.cc:5697] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 15 to 16, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 16 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:33.949584 19556 consensus_queue.cc:1048] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
W20260709 12:21:33.968526 13249 consensus_peers.cc:597] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:34.019686 13175 consensus_peers.cc:597] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:34.041105 13249 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.053083 13203 raft_consensus.cc:1275] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:21:34.072497 19526 consensus_queue.cc:1048] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:34.127173 13030 catalog_manager.cc:5697] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 15 to 16, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 16 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.134930 13028 catalog_manager.cc:5697] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 13 to 14, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 14 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:34.151057 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 83142.1us
I20260709 12:21:34.164772 13286 raft_consensus.cc:1275] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:21:34.167647 19495 consensus_queue.cc:1048] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:21:34.177547 13838 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.193606 13887 raft_consensus.cc:1275] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 12:21:34.196768 13175 consensus_peers.cc:597] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.201481 19522 consensus_queue.cc:1048] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:21:34.206737 13249 consensus_peers.cc:597] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.227041 13028 catalog_manager.cc:5697] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 16 to 17, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 17 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.229130 13028 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 17 to 18, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 18 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.231388 13028 catalog_manager.cc:5697] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca reported cstate change: term changed from 11 to 12, leader changed from af3f42f0797349058724e0cb2e637d24 (127.11.163.1) to a99436c294734e5cbc3657b2517cefca (127.11.163.2). New cstate: current_term: 12 leader_uuid: "a99436c294734e5cbc3657b2517cefca" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:34.274416 13175 consensus_peers.cc:597] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:34.300909 13175 consensus_peers.cc:597] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.319767 13281 raft_consensus.cc:1275] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:21:34.323897 13208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40336
I20260709 12:21:34.324541 13208 raft_consensus.cc:606] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Received request to transfer leadership
I20260709 12:21:34.325268 19495 consensus_queue.cc:1048] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:34.332141 13882 raft_consensus.cc:1275] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:34.336328 13208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40336
I20260709 12:21:34.337013 13208 raft_consensus.cc:606] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Received request to transfer leadership
I20260709 12:21:34.342316 13208 raft_consensus.cc:1275] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:34.344699 19534 consensus_queue.cc:1048] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:34.356974 13279 raft_consensus.cc:1275] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:21:34.358883 19495 consensus_queue.cc:1048] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:34.370240 19566 consensus_queue.cc:1048] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:34.370995 13206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e"
dest_uuid: "a99436c294734e5cbc3657b2517cefca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40336
I20260709 12:21:34.371744 13206 raft_consensus.cc:606] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Received request to transfer leadership
W20260709 12:21:34.384318 13838 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:34.405258 13249 consensus_peers.cc:597] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:34.428200 13175 consensus_peers.cc:597] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.428823 13882 raft_consensus.cc:1275] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:21:34.429678 13083 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:21:34.430061 13083 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 53ab219d48754e9b883a85ef2a514a1e already in progress
W20260709 12:21:34.430403 13083 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 53ab219d48754e9b883a85ef2a514a1e already in progress
I20260709 12:21:34.452082 19524 consensus_queue.cc:1048] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:21:34.483619 13882 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:21:34.552783 11916 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 13158)
I20260709 12:21:34.562471 13284 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Refusing update from remote peer a99436c294734e5cbc3657b2517cefca: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:21:34.564230 19566 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:34.610731 19544 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:21:34.616452 13175 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:34.669898 13175 consensus_peers.cc:597] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:34.670392 13175 consensus_peers.cc:597] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:34.696643 19544 raft_consensus.cc:993] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: : Instructing follower cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:21:34.697175 19544 raft_consensus.cc:1081] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Signalling peer cbc6af7757ec459ab451e47724fdf44b to start an election
I20260709 12:21:34.700448 13886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e"
dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
 from {username='slave'} at 127.0.0.1:45928
I20260709 12:21:34.700994 13886 raft_consensus.cc:493] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:34.701342 13886 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:34.708906 13886 raft_consensus.cc:515] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:34.712492 13208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "a99436c294734e5cbc3657b2517cefca"
I20260709 12:21:34.713140 13208 raft_consensus.cc:3055] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:34.713472 13208 raft_consensus.cc:740] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a99436c294734e5cbc3657b2517cefca, State: Running, Role: LEADER
I20260709 12:21:34.714334 13208 consensus_queue.cc:260] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:34.715735 13208 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:21:34.721417 13838 leader_election.cc:336] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:34.729319 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab219d48754e9b883a85ef2a514a1e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:34.729984 13284 raft_consensus.cc:3060] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:34.741073 13886 leader_election.cc:290] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 election: Requested vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:34.742909 13284 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 19.
I20260709 12:21:34.745374 13208 raft_consensus.cc:2468] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 19.
I20260709 12:21:34.746738 13841 leader_election.cc:304] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24
I20260709 12:21:34.747617 19510 raft_consensus.cc:2804] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:34.748394 19510 raft_consensus.cc:697] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 19 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:34.752409 19510 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:34.753710 13249 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111) [suppressed 381 similar messages]
W20260709 12:21:34.762127 13175 consensus_peers.cc:597] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:34.776311 13175 consensus_peers.cc:597] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:34.777307 13029 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 18 to 19, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 19 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:34.815611 13838 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:34.907684 13249 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.006770 13175 consensus_peers.cc:597] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.012558 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.047084 13175 consensus_peers.cc:597] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.082335 13249 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.110332 13175 consensus_peers.cc:597] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.147162 13838 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:35.267781 13175 consensus_peers.cc:597] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.317404 13249 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.341413 13249 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:35.361673 13284 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:21:35.367784 13249 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:35.371275 13206 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:21:35.373335 19556 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:21:35.385339 13838 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:35.389811 19588 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:21:35.398361 13838 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.426750 13175 consensus_peers.cc:597] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.493127 13175 consensus_peers.cc:597] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.496047 13249 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.513258 13249 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.516122 13175 consensus_peers.cc:597] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:35.553272 11916 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 13158)
I20260709 12:21:35.571017 13886 consensus_queue.cc:237] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:35.593176 13838 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:35.605168 13279 raft_consensus.cc:1275] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:21:35.617442 13838 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.618173 13838 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:35.608347 19593 consensus_queue.cc:1048] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
W20260709 12:21:35.637176 13249 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.638543 13175 consensus_peers.cc:597] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:35.642146 19588 raft_consensus.cc:2955] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 11 to 14, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
I20260709 12:21:35.649915 13284 raft_consensus.cc:2955] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 11 to 14, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:21:35.684340 13838 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:35.696875 13019 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 53ab219d48754e9b883a85ef2a514a1e with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 12:21:35.697530 13027 catalog_manager.cc:5697] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 reported cstate change: config changed from index 11 to 14, VOTER a99436c294734e5cbc3657b2517cefca (127.11.163.2) evicted. New cstate: current_term: 19 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } } }
W20260709 12:21:35.722237 13175 consensus_peers.cc:597] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:35.728765 13838 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:35.785090 13198 tablet_service.cc:1558] Processing DeleteTablet for tablet 53ab219d48754e9b883a85ef2a514a1e with delete_type TABLET_DATA_TOMBSTONED (TS a99436c294734e5cbc3657b2517cefca not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:40336
I20260709 12:21:35.810357 19598 tablet_replica.cc:333] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:35.811558 19598 raft_consensus.cc:2243] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:35.812458 19598 raft_consensus.cc:2272] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.826413 19598 ts_tablet_manager.cc:1916] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:21:35.839879 13838 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:35.930732 19598 ts_tablet_manager.cc:1929] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 12:21:35.931311 19598 log.cc:1199] T 53ab219d48754e9b883a85ef2a514a1e P a99436c294734e5cbc3657b2517cefca: Deleting WAL directory at /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/wals/53ab219d48754e9b883a85ef2a514a1e
I20260709 12:21:35.933254 13022 catalog_manager.cc:5028] TS a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): tablet 53ab219d48754e9b883a85ef2a514a1e (table test-workload [id=824766a2954f4b6289d140094178de5c]) successfully deleted
W20260709 12:21:36.018385 13838 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:36.123035 13249 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.125331 13249 consensus_peers.cc:597] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.126489 13838 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:36.202447 13838 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:36.219791 13249 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.270665 13249 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.327484 13175 consensus_peers.cc:597] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.403183 13175 consensus_peers.cc:597] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.553828 11916 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:36.631574 13838 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.815711 13249 consensus_peers.cc:597] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.835052 13249 consensus_peers.cc:597] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.870122 13175 consensus_peers.cc:597] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.917763 13175 consensus_peers.cc:597] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:36.923002 13175 consensus_peers.cc:597] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.923693 13175 consensus_peers.cc:597] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.959587 13838 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:37.022368 13175 consensus_peers.cc:597] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.249300 13838 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.255698 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.320288 13175 consensus_peers.cc:597] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.393400 13175 consensus_peers.cc:597] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.416296 13249 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.554340 11916 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:37.652935 13175 consensus_peers.cc:597] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.672303 13175 consensus_peers.cc:597] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.700088 13838 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.715358 13838 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.754635 13249 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.795984 13249 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.798715 13175 consensus_peers.cc:597] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.822549 13838 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.848896 13249 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.881582 13175 consensus_peers.cc:597] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.895586 13249 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.903558 13249 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:37.912729 13838 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:37.944118 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 84126.7us
W20260709 12:21:37.970046 13249 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.167654 13838 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.229056 13838 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.282634 13175 consensus_peers.cc:597] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.293695 13249 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.293851 13175 consensus_peers.cc:597] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.337116 13175 consensus_peers.cc:597] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:38.344338 13175 consensus_peers.cc:597] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.364784 13175 consensus_peers.cc:597] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.399026 13249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 65971.6us
W20260709 12:21:38.530624 13838 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.554996 11916 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:38.598570 13838 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.685820 13249 consensus_peers.cc:597] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:38.704182 13249 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:38.644589 13838 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.706837 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 62288.9us
W20260709 12:21:38.738772 13838 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.761411 13249 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:38.830825 13838 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:38.989955 13249 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:38.994457 13175 consensus_peers.cc:597] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:39.054355 13175 consensus_peers.cc:597] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:39.128996 13838 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:39.238504 13175 consensus_peers.cc:597] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:39.251564 13249 consensus_peers.cc:597] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:39.268779 13249 consensus_peers.cc:597] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:39.344460 13838 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:39.380502 13175 consensus_peers.cc:597] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:39.447417 13838 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:39.447592 13175 consensus_peers.cc:597] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:39.480396 13175 consensus_peers.cc:597] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:39.555613 11916 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:39.643042 13175 consensus_peers.cc:597] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:39.741629 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:39.773619 13175 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111) [suppressed 464 similar messages]
W20260709 12:21:39.847244 13175 consensus_peers.cc:597] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:39.912050 13175 consensus_peers.cc:597] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.017107 13838 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.067955 13249 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.148154 13249 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.183161 13838 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.207554 13175 consensus_peers.cc:597] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.241144 13249 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.247495 13838 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:40.252395 13175 consensus_peers.cc:597] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.357367 13249 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.362953 13838 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.363636 13175 consensus_peers.cc:597] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.388216 13249 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.395879 13175 consensus_peers.cc:597] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.401743 13175 consensus_peers.cc:597] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.437418 13838 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.450282 13249 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.508594 13249 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.556352 11916 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:40.637527 13838 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:40.985114 13838 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:41.013096 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 231282us
W20260709 12:21:41.023625 13249 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:41.040035 13249 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:41.040907 13838 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:41.068542 13838 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:41.102597 13249 consensus_peers.cc:597] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:41.157387 13175 consensus_peers.cc:597] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:41.197460 13838 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:41.208194 13175 consensus_peers.cc:597] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:41.209568 13175 consensus_peers.cc:597] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:41.213214 13175 consensus_peers.cc:597] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:41.222231 13249 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:41.507633 13838 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:41.557792 11916 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:41.568475 13249 consensus_peers.cc:597] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:41.582751 13175 consensus_peers.cc:597] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:41.638278 13175 consensus_peers.cc:597] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:41.645365 13838 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:41.648981 13249 consensus_peers.cc:597] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:41.675661 13249 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:41.702423 13175 consensus_peers.cc:597] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:41.854629 13175 consensus_peers.cc:597] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.015039 13838 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:42.053560 13175 consensus_peers.cc:597] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.056598 13838 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.100631 13175 consensus_peers.cc:597] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:42.198793 13175 consensus_peers.cc:597] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.231294 13175 consensus_peers.cc:597] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.523500 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.533697 13175 consensus_peers.cc:597] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:42.558267 11916 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:42.577756 13249 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.587036 13175 consensus_peers.cc:597] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.587687 13838 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.639583 13175 consensus_peers.cc:597] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.651214 13249 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.691716 13175 consensus_peers.cc:597] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.741842 13838 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:42.744364 13838 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.758246 13175 consensus_peers.cc:597] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.782083 13838 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.829272 13249 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.854307 13249 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.906337 13249 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.907670 13838 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:42.919952 13175 consensus_peers.cc:597] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.034250 13249 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.108636 13249 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.149333 13252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:34605, user_credentials={real_user=slave}} blocked reactor thread for 50692us
W20260709 12:21:43.269491 13838 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.296386 13838 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.442086 13175 consensus_peers.cc:597] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.454350 13175 consensus_peers.cc:597] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.481479 13838 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.558811 11916 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:43.551133 13175 consensus_peers.cc:597] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.572862 13249 consensus_peers.cc:597] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:43.681617 13249 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.680184 13838 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.698939 13249 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:43.735759 13175 consensus_peers.cc:597] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:43.776479 13249 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:43.917114 13838 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:43.947594 13838 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:43.955330 13838 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:44.018993 13249 consensus_peers.cc:597] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:44.039983 13175 consensus_peers.cc:597] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:44.075273 13175 consensus_peers.cc:597] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:44.094231 13175 consensus_peers.cc:597] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:44.175544 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 76165.4us
W20260709 12:21:44.222700 13175 consensus_peers.cc:597] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:44.285638 13249 consensus_peers.cc:597] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:44.344482 13175 consensus_peers.cc:597] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:44.439100 13838 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:44.465955 13249 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:44.498946 13838 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:44.528959 13175 consensus_peers.cc:597] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:44.544895 13175 consensus_peers.cc:597] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:44.559316 11916 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:44.778764 13249 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111) [suppressed 464 similar messages]
W20260709 12:21:44.882225 13175 consensus_peers.cc:597] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:44.916050 13249 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:45.559947 11916 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:45.905707 13838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.002s	sys 0.003s
W20260709 12:21:45.906186 13838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.002s	sys 0.003s
W20260709 12:21:45.944324 13841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.008s	sys 0.008s
W20260709 12:21:45.944705 13841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.008s	sys 0.008s
I20260709 12:21:45.949692 19647 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:45.950614 19647 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:45.953610 19647 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:45.955060 19650 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:45.955715 19650 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:45.958174 19650 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:45.959950 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 52741.2us
I20260709 12:21:45.968739 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f369b73ff12847ccbbb00601fe431eb4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:46.030283 19668 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:46.030895 19668 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:46.034922 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:46.040536 13210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8df593339524328b819bd096f86f17d" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:46.043731 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:46.044723 19646 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:46.044729 19668 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:46.045904 13249 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.047878 13249 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.048538 13249 leader_election.cc:336] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:46.059517 13838 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.060077 13838 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.063696 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:46.070554 19665 raft_consensus.cc:493] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:46.070169 19659 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:46.071247 19665 raft_consensus.cc:515] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:46.071749 19659 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:46.074123 19661 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:46.075045 19659 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:46.079093 19659 raft_consensus.cc:493] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:46.079635 19659 raft_consensus.cc:515] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:46.080940 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef464caba794ab4955c661c56df278f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:46.081980 19659 leader_election.cc:290] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:46.082775 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:46.074738 19661 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:46.087343 19661 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:46.091457 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:46.093274 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c1b9e8f954a65a5d7d3ebdd5ba5e9" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:46.073812 19665 leader_election.cc:290] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:46.110718 19659 raft_consensus.cc:493] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:46.111454 19659 raft_consensus.cc:515] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:46.116451 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4a8424978a43d1ba67730ec2d91f76" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:46.118301 19659 leader_election.cc:290] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:46.121621 19659 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:46.122298 19659 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:46.132822 13282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:46.147773 19659 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:46.194373 13838 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:46.198352 13838 leader_election.cc:336] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:46.201681 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:46.211150 19668 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:46.217087 13838 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:46.242319 13203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d5ddc60f3a4b948881a4efc95b8721" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a99436c294734e5cbc3657b2517cefca" is_pre_election: true
I20260709 12:21:46.244215 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5372f0f4e82241658d5d891336a8b6d4" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:46.248261 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96956ab507b74b29b91a4c067585d07f" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:46.271485 13175 consensus_peers.cc:597] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:46.276623 13249 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.282033 13175 consensus_peers.cc:597] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.282606 13175 consensus_peers.cc:597] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.282997 13175 consensus_peers.cc:597] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.281320 13838 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.287631 13249 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:46.289983 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e2a455a56d445bb7942e9f0b3f7f49" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:46.434942 13175 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:46.449018 13252 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:46.457804 19649 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:46.462216 19655 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:46.463650 13175 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:46.467653 13249 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.492740 13249 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:46.506050 19665 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:46.454169 13838 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.515381 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:35201, user_credentials={real_user=slave}} blocked reactor thread for 61263.2us
W20260709 12:21:46.516474 13838 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.507411 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 43846.6us
I20260709 12:21:46.521551 13175 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:46.533730 19665 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:46.560602 11916 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:46.584357 13838 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.608225 13175 leader_election.cc:336] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:46.608807 13175 leader_election.cc:304] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:46.609831 19665 raft_consensus.cc:2749] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:21:46.611867 13175 leader_election.cc:336] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:46.612329 13175 leader_election.cc:304] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:46.614065 13175 leader_election.cc:336] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:46.614519 13175 leader_election.cc:304] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:46.614878 19665 raft_consensus.cc:2749] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:46.615324 19655 raft_consensus.cc:2749] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:46.674939 13838 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:46.684249 13249 consensus_peers.cc:597] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:46.719609 13175 consensus_peers.cc:597] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.767215 13908 debug-util.cc:398] Leaking SignalData structure 0x7b080038abe0 after lost signal to thread 11919
W20260709 12:21:46.768474 13908 debug-util.cc:398] Leaking SignalData structure 0x7b08003a83a0 after lost signal to thread 13069
W20260709 12:21:46.769876 13908 debug-util.cc:398] Leaking SignalData structure 0x7b0800381000 after lost signal to thread 13236
W20260709 12:21:46.771059 13908 debug-util.cc:398] Leaking SignalData structure 0x7b08000c98e0 after lost signal to thread 13310
W20260709 12:21:46.772652 13908 debug-util.cc:398] Leaking SignalData structure 0x7b080034dc80 after lost signal to thread 13911
W20260709 12:21:46.812850 13249 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.834462 13175 consensus_peers.cc:597] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.908666 13838 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:46.929171 13249 consensus_peers.cc:597] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:46.971644 13838 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:47.033440 13249 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:47.046041 13838 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:47.124986 13249 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:47.148401 13175 consensus_peers.cc:597] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:47.184949 13175 consensus_peers.cc:597] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:47.193523 13838 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:47.336879 13175 consensus_peers.cc:597] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:47.379940 13249 consensus_peers.cc:597] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:47.392589 13838 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:47.414609 13175 consensus_peers.cc:597] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:47.417498 13175 consensus_peers.cc:597] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:47.478832 13175 consensus_peers.cc:597] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:47.561141 11916 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:47.583832 13175 consensus_peers.cc:597] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:47.591869 13175 consensus_peers.cc:597] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:47.707199 13175 consensus_peers.cc:597] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:47.811939 13249 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:47.833433 13175 consensus_peers.cc:597] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:47.867306 13175 consensus_peers.cc:597] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:47.985558 13249 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.100567 13175 consensus_peers.cc:597] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.155292 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.243989 13175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:37379, user_credentials={real_user=slave}} blocked reactor thread for 49103us
W20260709 12:21:48.305872 13175 consensus_peers.cc:597] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.411644 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 63030.6us
W20260709 12:21:48.412748 13175 consensus_peers.cc:597] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.431639 13175 consensus_peers.cc:597] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:48.458578 13838 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.477419 13175 consensus_peers.cc:597] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.504969 13249 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.542735 13838 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.557765 13249 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.562623 11916 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 13158)
W20260709 12:21:48.623034 13249 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.656131 13838 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.660051 13838 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:48.706615 13249 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.813833 13838 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.825413 13249 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.911680 13838 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.958173 13838 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:48.991104 13838 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:49.066921 13249 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:49.128378 13175 consensus_peers.cc:597] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:49.231655 13838 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:49.245133 13249 consensus_peers.cc:597] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:49.339123 13249 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:49.371996 13249 consensus_peers.cc:597] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:49.427701 13249 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:49.466965 13175 consensus_peers.cc:597] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:49.541213 13838 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:49.574132 13838 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:49.587352 13838 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:49.605012 13249 consensus_peers.cc:597] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:49.663715 13249 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:49.674453 13175 consensus_peers.cc:597] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:49.682085 13175 consensus_peers.cc:597] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:49.784675 13175 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111) [suppressed 403 similar messages]
W20260709 12:21:49.820618 13175 consensus_peers.cc:597] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:49.866276 13175 consensus_peers.cc:597] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:49.879880 13175 consensus_peers.cc:597] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:49.939631 13177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 53629.1us
W20260709 12:21:49.959777 13175 consensus_peers.cc:597] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:49.980974 13175 consensus_peers.cc:597] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:49.991699 13175 consensus_peers.cc:597] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:50.128973 13838 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:50.138780 11916 tablet_server.cc:196] TabletServer@127.11.163.1:0 shutdown complete.
W20260709 12:21:50.143078 13838 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:50.177871 13175 consensus_peers.cc:597] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:50.242153 13175 consensus_peers.cc:597] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:50.375191 13175 consensus_peers.cc:597] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:50.388818 11916 tablet_server.cc:179] TabletServer@127.11.163.2:0 shutting down...
W20260709 12:21:50.412292 13841 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.433435 13249 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:50.438814 13252 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.450820 13249 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:50.463172 13841 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.514142 13175 consensus_peers.cc:597] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:50.536248 13841 consensus_peers.cc:597] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.541736 13252 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.546278 13252 consensus_peers.cc:597] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.615600 13252 consensus_peers.cc:597] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.616346 13252 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.705215 13841 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.708348 13841 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.735842 13841 consensus_peers.cc:597] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.774259 13252 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.775326 13841 consensus_peers.cc:597] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:50.809571 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:50.818279 11916 tablet_replica.cc:333] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:50.823489 11916 raft_consensus.cc:2243] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:50.828451 11916 raft_consensus.cc:2272] T f369b73ff12847ccbbb00601fe431eb4 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:50.834213 13841 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:50.837013 11916 tablet_replica.cc:333] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
W20260709 12:21:50.849745 13252 consensus_peers.cc:597] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.855082 13252 consensus_peers.cc:597] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.858532 13252 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.865406 13252 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.869323 13252 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:50.877909 11916 raft_consensus.cc:2243] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:50.883031 11916 raft_consensus.cc:2272] T d4a97da851674edaa6a93f32de934f5c P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:50.894691 13838 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:50.909827 11916 tablet_replica.cc:333] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:50.911113 11916 raft_consensus.cc:2243] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:21:50.912503 11916 raft_consensus.cc:2272] T 8820b0db2b544a93ba81b2abe6292404 P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:50.921893 13252 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.923491 13252 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.925256 13252 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.947861 13252 consensus_peers.cc:597] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.948539 13252 consensus_peers.cc:597] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:50.950021 11916 tablet_replica.cc:333] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:50.951112 11916 raft_consensus.cc:2243] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:50.951905 11916 raft_consensus.cc:2272] T 3c6b513b5ce94426880fca53620e1f51 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:50.955030 11916 tablet_replica.cc:333] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
W20260709 12:21:50.958704 13838 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:50.963472 13841 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:50.966907 13249 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:50.975389 11916 raft_consensus.cc:2243] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:50.976161 11916 raft_consensus.cc:2272] T 3642b79a5a004395947fefe912c71406 P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:50.976645 13249 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:50.986894 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:50.999962 11916 tablet_replica.cc:333] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.013821 11916 raft_consensus.cc:2243] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.016891 11916 raft_consensus.cc:2272] T 7f8fccf310364ac9887a867f78b35734 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:51.026053 13249 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:51.027968 13175 consensus_peers.cc:597] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:51.028412 11916 tablet_replica.cc:333] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.040882 11916 raft_consensus.cc:2243] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.042062 11916 raft_consensus.cc:2272] T 1c7b93f2b99d4c27915adea1f987deff P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.046591 11916 tablet_replica.cc:333] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.047446 11916 raft_consensus.cc:2243] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.048561 11916 raft_consensus.cc:2272] T 2f4a8424978a43d1ba67730ec2d91f76 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.051883 11916 tablet_replica.cc:333] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.056704 11916 raft_consensus.cc:2243] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.060268 11916 raft_consensus.cc:2272] T 75e2a455a56d445bb7942e9f0b3f7f49 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.069876 11916 tablet_replica.cc:333] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.071000 11916 raft_consensus.cc:2243] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.077550 11916 raft_consensus.cc:2272] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P a99436c294734e5cbc3657b2517cefca [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:51.086623 13175 consensus_peers.cc:597] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:51.095930 13249 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:51.086838 11916 tablet_replica.cc:333] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.100467 11916 raft_consensus.cc:2243] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:21:51.111835 13175 consensus_peers.cc:597] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:51.115347 11916 raft_consensus.cc:2272] T e58a8c3577014cf6ba54f48ffedf7594 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.127331 11916 tablet_replica.cc:333] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
W20260709 12:21:51.135154 13249 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:51.135695 11916 raft_consensus.cc:2243] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.206207 11916 raft_consensus.cc:2272] T f9377aea669547028ee8449f654c60b7 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.216434 11916 tablet_replica.cc:333] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.217506 11916 raft_consensus.cc:2243] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.219416 11916 raft_consensus.cc:2272] T 5372f0f4e82241658d5d891336a8b6d4 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.230131 11916 tablet_replica.cc:333] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
W20260709 12:21:51.231354 13838 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:51.242547 11916 raft_consensus.cc:2243] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.249740 11916 raft_consensus.cc:2272] T a9b25f727caf4a5598422d510a2e6868 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.252925 11916 tablet_replica.cc:333] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.272435 11916 raft_consensus.cc:2243] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.273738 11916 raft_consensus.cc:2272] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:51.278898 13838 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:51.281896 11916 tablet_replica.cc:333] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.282804 11916 raft_consensus.cc:2243] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.290966 11916 raft_consensus.cc:2272] T 5fc9abc16270419796fe8ad939321769 P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.293819 11916 tablet_replica.cc:333] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.308156 11916 raft_consensus.cc:2243] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.309448 11916 raft_consensus.cc:2272] T 06fdf45f6d794f90a80b05b5fe3f2316 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.324147 11916 tablet_replica.cc:333] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.325078 11916 raft_consensus.cc:2243] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:21:51.326650 13838 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:51.343884 11916 raft_consensus.cc:2272] T 44133e1a03bc4412a20badffb41bb55e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.347159 11916 tablet_replica.cc:333] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.348030 11916 raft_consensus.cc:2243] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.352361 11916 raft_consensus.cc:2272] T 763333b6723c40cf8a4902d56603e45f P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:51.355373 13838 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:51.364836 11916 tablet_replica.cc:333] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.380189 11916 raft_consensus.cc:2243] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.385998 11916 raft_consensus.cc:2272] T 7ef464caba794ab4955c661c56df278f P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.402297 11916 tablet_replica.cc:333] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.415009 11916 raft_consensus.cc:2243] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.417438 11916 raft_consensus.cc:2272] T 1622215fe6114b4b80c6430c2cbf33d0 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.420783 19689 raft_consensus.cc:493] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:51.423808 19689 raft_consensus.cc:515] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:51.426921 19689 leader_election.cc:290] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:51.428153 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:51.430227 11916 tablet_replica.cc:333] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.431118 11916 raft_consensus.cc:2243] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.432255 11916 raft_consensus.cc:2272] T 4c6b052993424c29a7d49943db353a08 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.446712 11916 tablet_replica.cc:333] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.465476 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f45cc6bc2f488697756a90edeec54e" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:51.469689 19688 raft_consensus.cc:493] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:51.471997 11916 raft_consensus.cc:2243] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.472278 19688 raft_consensus.cc:515] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:51.472841 11916 raft_consensus.cc:2272] T 96956ab507b74b29b91a4c067585d07f P a99436c294734e5cbc3657b2517cefca [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.475353 19688 leader_election.cc:290] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:51.470376 19689 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:51.478256 19689 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:51.481663 19689 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:51.482568 13175 leader_election.cc:336] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:51.476569 11916 tablet_replica.cc:333] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.483997 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:51.484467 11916 raft_consensus.cc:2243] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.485203 11916 raft_consensus.cc:2272] T ca13f9e740914dfbb5008f9905f1da76 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.494573 11916 tablet_replica.cc:333] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.495476 13175 leader_election.cc:304] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:51.508000 11916 raft_consensus.cc:2243] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.509320 11916 raft_consensus.cc:2272] T 25bd867e44d047eeb41637598bf8d7fc P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.511263 19689 raft_consensus.cc:2749] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:51.515703 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8aac4336e49d4bc5ba21f80833bd5" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:51.516216 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac590852a8a4f4ea0a35528a7ae147d" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:51.520226 11916 tablet_replica.cc:333] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.523192 11916 raft_consensus.cc:2243] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.530714 11916 raft_consensus.cc:2272] T c8df593339524328b819bd096f86f17d P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.533401 13175 leader_election.cc:304] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:51.534276 19688 raft_consensus.cc:2749] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:51.535647 13175 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:51.536430 19688 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:51.548481 11916 tablet_replica.cc:333] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.556110 11916 raft_consensus.cc:2243] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.556974 11916 raft_consensus.cc:2272] T 79d6c326c49e497ab8d45ac2cf85f71f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.567484 11916 tablet_replica.cc:333] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.568317 11916 raft_consensus.cc:2243] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.569155 11916 raft_consensus.cc:2272] T 62f45cc6bc2f488697756a90edeec54e P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.569921 19688 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:51.572356 19688 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:51.573339 19689 raft_consensus.cc:493] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:51.573844 19689 raft_consensus.cc:515] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:51.575757 19689 leader_election.cc:290] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:51.577744 13887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:51.578725 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a3fa2c26ae4d9a8803582f91f9cff2" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:51.578902 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ba4ee627684f4ea7e32e683e7bcd72" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:51.575161 19688 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:51.584942 11916 tablet_replica.cc:333] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.589499 11916 raft_consensus.cc:2243] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.595948 11916 raft_consensus.cc:2272] T 7285cfe46adb4975a532c3df36e5203e P a99436c294734e5cbc3657b2517cefca [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.589963 13175 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
W20260709 12:21:51.600193 13175 leader_election.cc:336] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:51.600919 19688 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:51.601112 13175 leader_election.cc:336] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:51.601612 13175 leader_election.cc:304] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:51.602212 11916 tablet_replica.cc:333] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.602375 19688 raft_consensus.cc:2749] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:51.603108 11916 raft_consensus.cc:2243] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.603821 11916 raft_consensus.cc:2272] T 95ba4ee627684f4ea7e32e683e7bcd72 P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.612308 19688 raft_consensus.cc:493] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:51.612851 19688 raft_consensus.cc:515] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:51.614945 19688 leader_election.cc:290] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:51.616425 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf69f9fcd1a4ec4a5526f84e6d06eba" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:51.624751 13175 leader_election.cc:336] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:51.625211 13175 leader_election.cc:304] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:51.625769 11916 tablet_replica.cc:333] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.626173 19688 raft_consensus.cc:2749] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:51.626633 11916 raft_consensus.cc:2243] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.633687 11916 raft_consensus.cc:2272] T 6b675043435441bb980d9a219c4d3450 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.636559 11916 tablet_replica.cc:333] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.645843 11916 raft_consensus.cc:2243] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.650952 11916 raft_consensus.cc:2272] T 51d5ddc60f3a4b948881a4efc95b8721 P a99436c294734e5cbc3657b2517cefca [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.663605 11916 tablet_replica.cc:333] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.665298 11916 raft_consensus.cc:2243] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.668624 11916 raft_consensus.cc:2272] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P a99436c294734e5cbc3657b2517cefca [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.678275 11916 tablet_replica.cc:333] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.685554 11916 raft_consensus.cc:2243] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.688935 11916 raft_consensus.cc:2272] T 09b7d0dede2b49f5ba99e11fa703541e P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.694667 19688 raft_consensus.cc:493] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:51.695173 19688 raft_consensus.cc:515] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:51.697240 19688 leader_election.cc:290] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:51.698501 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:51.700899 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5031b82872c430cbd03772ba96480ff" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:51.700883 11916 tablet_replica.cc:333] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.704649 13175 leader_election.cc:304] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:51.706234 19681 raft_consensus.cc:2749] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:51.703328 11916 raft_consensus.cc:2243] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.713939 11916 raft_consensus.cc:2272] T 86b4311504b54b2c8d99d43a9b057e8f P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:51.721251 13249 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:51.721889 11916 tablet_replica.cc:333] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.728085 11916 raft_consensus.cc:2243] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.729276 11916 raft_consensus.cc:2272] T a3da01ae07634adb9184db323ba32a1c P a99436c294734e5cbc3657b2517cefca [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.739943 11916 tablet_replica.cc:333] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.757853 11916 raft_consensus.cc:2243] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.765533 11916 raft_consensus.cc:2272] T e1a3fa2c26ae4d9a8803582f91f9cff2 P a99436c294734e5cbc3657b2517cefca [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.769721 11916 tablet_replica.cc:333] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
W20260709 12:21:51.774694 13249 consensus_peers.cc:597] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:51.783376 11916 raft_consensus.cc:2243] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.784703 11916 raft_consensus.cc:2272] T bac590852a8a4f4ea0a35528a7ae147d P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.793828 11916 tablet_replica.cc:333] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.796655 11916 raft_consensus.cc:2243] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.797869 11916 raft_consensus.cc:2272] T c37477a485ab4cbfbeddcf8f65632297 P a99436c294734e5cbc3657b2517cefca [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.815150 11916 tablet_replica.cc:333] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.816375 11916 raft_consensus.cc:2243] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.818022 11916 raft_consensus.cc:2272] T b5031b82872c430cbd03772ba96480ff P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.823192 11916 tablet_replica.cc:333] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.828227 11916 raft_consensus.cc:2243] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.830307 11916 raft_consensus.cc:2272] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P a99436c294734e5cbc3657b2517cefca [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:51.838980 13249 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:51.845223 11916 tablet_replica.cc:333] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.850661 11916 raft_consensus.cc:2243] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:21:51.863291 13249 consensus_peers.cc:597] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:51.864617 11916 raft_consensus.cc:2272] T 8719253f6e514245b49fd2d6cf3d0ad4 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.874878 11916 tablet_replica.cc:333] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.881858 11916 raft_consensus.cc:2243] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.885881 19681 raft_consensus.cc:493] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cbc6af7757ec459ab451e47724fdf44b)
I20260709 12:21:51.891692 11916 raft_consensus.cc:2272] T 0277518ce1314a3c82f3ab5bad63bdc6 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.890928 19681 raft_consensus.cc:515] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:51.895510 11916 tablet_replica.cc:333] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.896903 19681 leader_election.cc:290] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:51.899222 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1505ff0869734d74a99b739df5b0530a" candidate_uuid: "a99436c294734e5cbc3657b2517cefca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:51.902635 13249 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:51.903349 13175 leader_election.cc:336] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:51.903842 13175 leader_election.cc:304] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99436c294734e5cbc3657b2517cefca; no voters: af3f42f0797349058724e0cb2e637d24, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:51.905200 19681 raft_consensus.cc:2749] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:51.899340 11916 raft_consensus.cc:2243] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.906695 11916 raft_consensus.cc:2272] T a2b8aac4336e49d4bc5ba21f80833bd5 P a99436c294734e5cbc3657b2517cefca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.926709 11916 tablet_replica.cc:333] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.927561 11916 raft_consensus.cc:2243] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:51.928850 11916 raft_consensus.cc:2272] T 7d4c4238ca2d414dbdb755c1217ef912 P a99436c294734e5cbc3657b2517cefca [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.933388 11916 tablet_replica.cc:333] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca: stopping tablet replica
I20260709 12:21:51.934060 11916 raft_consensus.cc:2243] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.937156 11916 raft_consensus.cc:2272] T 1505ff0869734d74a99b739df5b0530a P a99436c294734e5cbc3657b2517cefca [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:52.031836 13249 consensus_peers.cc:597] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:52.040335 19686 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.041054 19686 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:52.044756 19686 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:52.048606 13841 leader_election.cc:336] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:52.067891 19685 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.068526 19685 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:52.070779 19685 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:52.077456 13252 leader_election.cc:336] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:21:52.078615 13249 leader_election.cc:336] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.079043 13249 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.080333 19692 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:52.112397 19686 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.112958 19686 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:52.115124 19686 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:52.121467 13841 leader_election.cc:336] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:21:52.139149 13249 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:52.312119 19686 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.312719 19686 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:52.315102 19686 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:52.323747 13841 leader_election.cc:336] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:52.347167 19692 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.347735 19692 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:52.352159 13841 connection.cc:573] client connection to 127.11.163.2:34605 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:21:52.358363 13252 leader_election.cc:336] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.369284 19692 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:52.374732 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:52.377094 13249 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, cbc6af7757ec459ab451e47724fdf44b
I20260709 12:21:52.380959 19692 raft_consensus.cc:2749] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:52.393251 19692 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.393903 19692 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:52.396407 19692 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:52.401165 13249 leader_election.cc:336] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:52.415974 13252 leader_election.cc:336] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.419649 13252 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.420495 19685 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:52.423485 19686 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.424153 19686 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:52.426743 19686 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:52.431543 13841 leader_election.cc:336] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.448982 19692 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.450019 19692 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:52.454380 19692 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:52.473989 13249 leader_election.cc:336] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.474557 19686 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.475854 19686 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:52.479353 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:52.480039 13284 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 15.
I20260709 12:21:52.481297 13840 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:52.482132 19643 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:52.482476 19643 raft_consensus.cc:493] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.482792 19643 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:52.491613 19686 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:52.496872 13252 leader_election.cc:336] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.499018 13252 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.507794 19692 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:52.491274 19643 raft_consensus.cc:515] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:52.520676 19643 leader_election.cc:290] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:52.524645 13841 leader_election.cc:336] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.527526 13284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e9975f4caa4eb7be07cf7ee3aed8b3" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133"
I20260709 12:21:52.528193 13284 raft_consensus.cc:3060] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:52.553268 13284 raft_consensus.cc:2468] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6af7757ec459ab451e47724fdf44b in term 16.
W20260709 12:21:52.554100 13841 leader_election.cc:336] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.558615 13840 leader_election.cc:304] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:52.560014 19697 raft_consensus.cc:2804] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:52.560606 19697 raft_consensus.cc:697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Becoming Leader. State: Replica: cbc6af7757ec459ab451e47724fdf44b, State: Running, Role: LEADER
I20260709 12:21:52.561830 19697 consensus_queue.cc:237] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:52.566493 13838 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:52.567080 13838 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:52.576867 19692 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.577575 19692 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:52.586328 13252 leader_election.cc:336] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:52.588266 13838 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:52.593070 13838 leader_election.cc:336] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.593533 19685 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.596271 19685 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:52.599205 19685 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:52.593596 19692 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:52.603910 13838 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:52.609656 13252 leader_election.cc:336] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.611800 19686 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:21:52.613368 13838 leader_election.cc:336] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.616752 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.623896 19686 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:21:52.624954 13838 leader_election.cc:336] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.626278 13838 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:52.625762 13249 leader_election.cc:336] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.627132 13249 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.627681 19686 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:52.629792 19692 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:52.628342 13838 leader_election.cc:336] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.630836 13838 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.635275 19686 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:52.644351 13249 leader_election.cc:336] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.644904 13249 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.650009 19692 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:52.651415 13029 catalog_manager.cc:5697] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b reported cstate change: term changed from 15 to 16, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to cbc6af7757ec459ab451e47724fdf44b (127.11.163.4). New cstate: current_term: 16 leader_uuid: "cbc6af7757ec459ab451e47724fdf44b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:52.673548 13838 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:52.706363 19691 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.706930 19691 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:52.709046 19691 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:52.718598 19686 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.719334 19686 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:52.722973 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:52.723737 19686 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:52.725805 13841 leader_election.cc:336] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:52.726240 13249 leader_election.cc:336] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.726253 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:52.728418 19697 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:52.730970 13252 leader_election.cc:336] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.734328 19691 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.734856 19691 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:52.731492 13252 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.736940 19691 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:52.737128 19685 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:52.740943 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:52.741551 13886 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 12.
I20260709 12:21:52.744477 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
W20260709 12:21:52.751062 13252 leader_election.cc:336] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.752703 19685 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:52.753890 19685 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.754374 19685 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:52.753299 13249 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:52.778327 19692 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.778961 19692 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:52.781672 19692 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:52.792825 13252 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.763041 19685 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:52.797286 19685 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:52.801617 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6b052993424c29a7d49943db353a08" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
W20260709 12:21:52.805858 13249 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.807709 13886 raft_consensus.cc:3060] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:52.807993 13249 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.810521 19692 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:21:52.812711 13252 leader_election.cc:336] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:52.813359 13252 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:52.815212 13886 raft_consensus.cc:2468] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 13.
I20260709 12:21:52.822649 13249 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:52.827136 19685 raft_consensus.cc:2804] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:52.828009 19685 raft_consensus.cc:697] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:52.829232 19685 consensus_queue.cc:237] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:52.833346 19697 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.834003 19697 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:52.836279 19697 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:52.846532 13841 leader_election.cc:336] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:52.847388 13838 leader_election.cc:336] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.848892 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.849745 19697 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:52.852483 13029 catalog_manager.cc:5697] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 12 to 13, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 13 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:52.882185 13252 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.898770 13252 consensus_peers.cc:597] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:52.899622 19685 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.900197 19685 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:52.902303 19685 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:52.906986 13249 leader_election.cc:336] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:52.913763 13252 leader_election.cc:336] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.914312 13252 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.915071 19685 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:52.935572 13252 consensus_peers.cc:597] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:52.948515 19685 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.949071 19685 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:52.961171 13841 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.962045 13249 leader_election.cc:336] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:52.965325 13252 leader_election.cc:336] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.966145 13252 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.951357 19685 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:52.966960 19692 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:52.970500 19692 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.971028 19692 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:52.973352 19692 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:52.973929 19697 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:52.974603 19697 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:52.978400 13249 leader_election.cc:336] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:52.983078 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:52.986358 19697 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:52.986901 13841 consensus_peers.cc:597] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:52.987020 13252 leader_election.cc:336] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.987704 13252 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:52.989451 19692 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:52.996028 13841 leader_election.cc:336] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:52.996698 13841 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:53.001448 13252 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:53.000855 19697 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:53.004102 13252 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.010826 13252 consensus_peers.cc:597] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.061656 13841 consensus_peers.cc:597] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:53.076889 19697 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:53.077548 19697 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:53.079559 19697 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:53.082599 13280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "cbc6af7757ec459ab451e47724fdf44b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b190224a708b4f068a6dda4006c3a133" is_pre_election: true
I20260709 12:21:53.091472 13280 raft_consensus.cc:1275] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Refusing update from remote peer cbc6af7757ec459ab451e47724fdf44b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:53.115370 19686 consensus_queue.cc:1048] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:21:53.113308 13252 consensus_peers.cc:597] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.122752 13841 leader_election.cc:336] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:53.130100 13841 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
W20260709 12:21:53.139919 13841 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:53.140461 19697 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:53.146728 19697 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:53.147389 19697 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:53.150223 13249 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:53.168185 19697 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:53.161136 19692 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:53.175696 19692 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:53.178356 19692 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:53.160498 13841 consensus_peers.cc:597] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.173159 13252 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.181903 13252 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:53.190083 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:53.190798 13886 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:53.195765 19685 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:53.196491 19685 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:53.198657 19685 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:53.200078 13252 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:53.206465 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
I20260709 12:21:53.207197 13886 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
W20260709 12:21:53.203673 13841 leader_election.cc:336] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:53.228816 13252 leader_election.cc:336] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:53.244006 13249 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: 
I20260709 12:21:53.247673 19692 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:53.248088 19692 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:53.248471 19692 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:53.257815 19692 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:53.281384 19692 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 election: Requested vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
W20260709 12:21:53.284181 13249 leader_election.cc:336] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:53.299400 13841 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:53.300034 13249 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:53.302485 19685 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:53.301633 13252 leader_election.cc:336] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:53.311787 19685 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:53.312450 19685 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:53.314657 19685 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:53.330330 13886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8719253f6e514245b49fd2d6cf3d0ad4" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b"
I20260709 12:21:53.330921 13886 raft_consensus.cc:3060] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:53.338353 13886 raft_consensus.cc:2468] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 17.
W20260709 12:21:53.341408 13841 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.332907 13252 consensus_peers.cc:597] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.346959 13252 leader_election.cc:336] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:53.353802 13252 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.354260 13252 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.354857 13252 leader_election.cc:336] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:53.356809 13249 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b190224a708b4f068a6dda4006c3a133, cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca
I20260709 12:21:53.357583 19685 raft_consensus.cc:2804] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:53.358060 19685 raft_consensus.cc:697] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 17 LEADER]: Becoming Leader. State: Replica: b190224a708b4f068a6dda4006c3a133, State: Running, Role: LEADER
I20260709 12:21:53.358870 19685 consensus_queue.cc:237] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:53.373764 13252 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.371071 13249 leader_election.cc:336] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:53.376643 13249 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
W20260709 12:21:53.383569 13841 consensus_peers.cc:597] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.394573 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:53.396335 19685 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:53.396456 13029 catalog_manager.cc:5697] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 reported cstate change: term changed from 16 to 17, leader changed from a99436c294734e5cbc3657b2517cefca (127.11.163.2) to b190224a708b4f068a6dda4006c3a133 (127.11.163.3). New cstate: current_term: 17 leader_uuid: "b190224a708b4f068a6dda4006c3a133" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:53.410786 13252 consensus_peers.cc:597] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:53.440603 13252 consensus_peers.cc:597] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:53.445263 13886 raft_consensus.cc:1275] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 12:21:53.451632 13249 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:53.455711 19685 consensus_queue.cc:1048] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:21:53.471065 13841 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.514777 13841 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:53.542061 13249 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:53.574853 13249 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:53.624701 13249 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:53.683503 19685 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:53.684026 19685 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:53.686178 19685 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:53.701561 13252 leader_election.cc:336] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:53.713096 13249 leader_election.cc:336] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:53.713584 13249 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:53.714277 19691 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:53.803694 13249 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:53.855767 13886 raft_consensus.cc:1275] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Refusing update from remote peer b190224a708b4f068a6dda4006c3a133: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:21:53.859411 19691 consensus_queue.cc:1048] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:21:53.884066 13838 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:53.886230 13838 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:53.889007 13838 leader_election.cc:336] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:53.889508 13838 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:53.890283 19697 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:53.891044 13252 consensus_peers.cc:597] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:53.891649 13838 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:53.897758 13838 leader_election.cc:336] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:53.901456 13840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:35631, user_credentials={real_user=slave}} blocked reactor thread for 59815.8us
I20260709 12:21:54.028861 19692 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.029484 19692 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:54.046912 13252 leader_election.cc:336] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:54.031723 19692 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.049213 13249 leader_election.cc:336] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:54.049666 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.051034 19685 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:54.123415 13838 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:54.153194 19713 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.153846 19713 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:54.156002 19713 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.164441 13841 leader_election.cc:336] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:54.165277 13838 leader_election.cc:336] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:54.165763 13838 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.167450 19713 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:54.176599 13249 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:54.215168 19713 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.215797 19713 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:54.217903 19713 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.224303 13838 leader_election.cc:336] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:54.228811 13841 leader_election.cc:336] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:54.229285 13841 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.231652 19697 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:54.282493 13249 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:54.284067 13838 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:54.339489 13249 consensus_peers.cc:597] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:54.357023 19713 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.357662 19713 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:54.359752 19713 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:54.366847 19713 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.369885 19713 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:54.369352 13249 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:54.368865 13841 leader_election.cc:336] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:54.372148 13838 leader_election.cc:336] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:54.374624 13838 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.375602 19686 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:54.382544 19713 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.394309 13838 leader_election.cc:336] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:54.396461 13841 leader_election.cc:336] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:54.397460 13841 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.402184 19692 raft_consensus.cc:493] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.402760 19692 raft_consensus.cc:515] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:54.412317 13249 leader_election.cc:336] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:54.413823 13252 leader_election.cc:336] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:54.414240 13252 leader_election.cc:304] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.415151 19691 raft_consensus.cc:2749] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:54.418839 19692 leader_election.cc:290] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:54.424013 19713 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:21:54.439414 13838 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:54.474257 13249 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:54.529819 19691 raft_consensus.cc:493] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.530424 19691 raft_consensus.cc:515] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:54.541915 19691 leader_election.cc:290] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.550978 13249 leader_election.cc:336] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:54.552302 13252 leader_election.cc:336] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:54.553918 13252 leader_election.cc:304] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.554723 19691 raft_consensus.cc:2749] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:54.576607 13838 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:54.586243 13249 consensus_peers.cc:597] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:54.590225 19715 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.590791 19715 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:54.593031 19715 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.602661 13252 leader_election.cc:336] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:54.605230 13249 leader_election.cc:336] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:54.605718 13249 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.606762 19691 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:54.667251 19686 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.667863 19686 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:54.669981 19686 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:54.676028 19715 raft_consensus.cc:493] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.676640 19715 raft_consensus.cc:515] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:54.678984 19715 leader_election.cc:290] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.686123 13252 leader_election.cc:336] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:54.682797 13841 leader_election.cc:336] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:54.689234 13249 leader_election.cc:336] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:54.689994 13838 leader_election.cc:336] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:54.690245 13249 leader_election.cc:304] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.690941 13838 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.691638 19715 raft_consensus.cc:493] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.694247 19715 raft_consensus.cc:515] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:54.692235 19691 raft_consensus.cc:2749] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:54.696382 19713 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:54.700961 19715 leader_election.cc:290] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.714483 13252 leader_election.cc:336] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:54.715559 13249 leader_election.cc:336] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:54.716109 13249 leader_election.cc:304] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.717406 19715 raft_consensus.cc:2749] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:54.718302 19715 raft_consensus.cc:493] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.722980 19715 raft_consensus.cc:515] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:54.725591 19715 leader_election.cc:290] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.748104 13252 leader_election.cc:336] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:54.757711 13249 consensus_peers.cc:597] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:54.760630 13249 leader_election.cc:336] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:54.763073 13249 leader_election.cc:304] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.764472 19715 raft_consensus.cc:2749] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:54.771849 13838 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:54.800336 13841 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111) [suppressed 627 similar messages]
I20260709 12:21:54.808832 19691 raft_consensus.cc:493] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.809492 19691 raft_consensus.cc:515] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:54.812685 19691 leader_election.cc:290] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.825397 13252 leader_election.cc:336] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:54.827858 13249 leader_election.cc:336] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:54.833206 13249 leader_election.cc:304] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.838977 19715 raft_consensus.cc:2749] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:54.856851 13838 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:54.897081 19685 raft_consensus.cc:493] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.897747 19685 raft_consensus.cc:515] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
W20260709 12:21:54.916579 13252 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:54.919705 19685 leader_election.cc:290] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.934194 13249 leader_election.cc:336] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:54.934808 13249 leader_election.cc:304] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.935650 19715 raft_consensus.cc:2749] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:54.939776 19715 raft_consensus.cc:493] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:54.940369 19715 raft_consensus.cc:515] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:54.942785 19715 leader_election.cc:290] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:54.960041 13249 leader_election.cc:336] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:54.960850 13252 leader_election.cc:336] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:54.961349 13252 leader_election.cc:304] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:54.967154 19715 raft_consensus.cc:2749] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:54.968629 13838 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:55.053893 13252 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:55.167109 19715 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:55.167891 19715 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:55.181329 13252 consensus_peers.cc:597] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.182265 13249 leader_election.cc:336] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:55.184361 19715 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), cbc6af7757ec459ab451e47724fdf44b (127.11.163.4:37379)
I20260709 12:21:55.186868 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b7d0dede2b49f5ba99e11fa703541e" candidate_uuid: "b190224a708b4f068a6dda4006c3a133" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cbc6af7757ec459ab451e47724fdf44b" is_pre_election: true
W20260709 12:21:55.192131 13252 leader_election.cc:336] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:55.192986 13252 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:55.193024 13882 raft_consensus.cc:2468] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b190224a708b4f068a6dda4006c3a133 in term 16.
I20260709 12:21:55.195369 19715 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:55.266680 13841 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.375743 13841 consensus_peers.cc:597] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:55.423415 13249 consensus_peers.cc:597] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:55.436412 13838 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:55.775861 19721 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:55.779986 19721 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:55.789831 19721 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:55.787096 13249 consensus_peers.cc:597] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:55.798343 13249 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:55.801662 13249 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:55.819082 13252 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.823683 13252 consensus_peers.cc:597] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.820657 13841 consensus_peers.cc:597] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.826820 13841 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.827356 13841 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.827885 13841 consensus_peers.cc:597] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.828991 13252 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.830348 13252 consensus_peers.cc:597] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.833087 13249 consensus_peers.cc:597] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:55.833921 13838 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:55.839529 13838 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:55.843693 13841 leader_election.cc:336] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:55.845818 13841 consensus_peers.cc:597] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.851408 13249 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:55.852893 13252 consensus_peers.cc:597] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.856664 13252 consensus_peers.cc:597] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.853305 13838 leader_election.cc:336] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:55.858999 13838 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:55.859838 19721 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:55.854001 13841 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.863479 13252 consensus_peers.cc:597] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.864048 13252 consensus_peers.cc:597] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.867076 13838 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:55.870286 13252 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.870855 13252 consensus_peers.cc:597] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.871387 13252 consensus_peers.cc:597] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.874665 13252 consensus_peers.cc:597] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:55.877123 13841 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:55.909791 13841 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:55.953020 19721 raft_consensus.cc:493] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:55.953615 19721 raft_consensus.cc:515] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:55.957492 19721 leader_election.cc:290] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:55.976534 13838 leader_election.cc:336] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:55.987805 13252 consensus_peers.cc:597] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:56.005205 13841 leader_election.cc:336] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:56.008188 13841 leader_election.cc:304] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:56.009137 19721 raft_consensus.cc:2749] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:56.040217 19721 raft_consensus.cc:493] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:56.040917 19721 raft_consensus.cc:515] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:56.043357 19721 leader_election.cc:290] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:56.072501 13838 leader_election.cc:336] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:56.089264 13841 leader_election.cc:336] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:56.092518 13841 leader_election.cc:304] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:56.093405 19721 raft_consensus.cc:2749] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:21:56.198956 13252 consensus_peers.cc:597] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:56.246618 13252 consensus_peers.cc:597] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:56.273885 13838 consensus_peers.cc:597] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:56.279392 13838 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:56.287499 13249 consensus_peers.cc:597] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:56.333329 13249 consensus_peers.cc:597] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:56.387642 13252 consensus_peers.cc:597] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:56.402227 13838 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:56.423825 11916 tablet_server.cc:196] TabletServer@127.11.163.2:0 shutdown complete.
W20260709 12:21:56.447149 13307 debug-util.cc:398] Leaking SignalData structure 0x7b08001bc8e0 after lost signal to thread 11919
W20260709 12:21:56.448391 13307 debug-util.cc:398] Leaking SignalData structure 0x7b08003733c0 after lost signal to thread 13069
W20260709 12:21:56.449759 13307 debug-util.cc:398] Leaking SignalData structure 0x7b080018a580 after lost signal to thread 13310
W20260709 12:21:56.450975 13307 debug-util.cc:398] Leaking SignalData structure 0x7b080029bd60 after lost signal to thread 13911
I20260709 12:21:56.616732 11916 tablet_server.cc:179] TabletServer@127.11.163.3:0 shutting down...
W20260709 12:21:56.648483 13840 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:56.657594 13840 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.660312 19715 raft_consensus.cc:493] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:56.660879 19715 raft_consensus.cc:515] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:56.662891 19715 leader_election.cc:290] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:56.669548 13252 leader_election.cc:336] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:56.672266 13249 leader_election.cc:336] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:56.672789 13249 leader_election.cc:304] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:56.672843 19715 raft_consensus.cc:493] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:56.673621 19718 raft_consensus.cc:2749] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:56.673549 19715 raft_consensus.cc:515] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:56.675580 19715 leader_election.cc:290] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:56.683555 13252 leader_election.cc:336] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:56.684590 13249 leader_election.cc:336] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:56.685055 13249 leader_election.cc:304] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:56.685758 19715 raft_consensus.cc:2749] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:56.711707 13840 consensus_peers.cc:597] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:56.727857 13840 consensus_peers.cc:597] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.728461 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:56.731419 11916 tablet_replica.cc:333] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
W20260709 12:21:56.747583 13840 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.749707 11916 raft_consensus.cc:2243] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.750793 11916 raft_consensus.cc:2272] T 3c6b513b5ce94426880fca53620e1f51 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.753122 11916 tablet_replica.cc:333] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.753743 11916 raft_consensus.cc:2243] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.754607 11916 raft_consensus.cc:2272] T d4a97da851674edaa6a93f32de934f5c P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.766793 11916 tablet_replica.cc:333] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
W20260709 12:21:56.767207 13840 consensus_peers.cc:597] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.767655 11916 raft_consensus.cc:2243] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.768767 11916 raft_consensus.cc:2272] T 7f8fccf310364ac9887a867f78b35734 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:56.774207 13838 consensus_peers.cc:597] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:56.776768 11916 tablet_replica.cc:333] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.777462 11916 raft_consensus.cc:2243] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.778066 11916 raft_consensus.cc:2272] T 0277518ce1314a3c82f3ab5bad63bdc6 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.780402 11916 tablet_replica.cc:333] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.781010 11916 raft_consensus.cc:2243] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.781585 11916 raft_consensus.cc:2272] T 904dfe40ae474e1689d6b8be4e1dba77 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.783676 11916 tablet_replica.cc:333] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.784262 11916 raft_consensus.cc:2243] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.785207 11916 raft_consensus.cc:2272] T 2f4a8424978a43d1ba67730ec2d91f76 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.787117 11916 tablet_replica.cc:333] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.787765 11916 raft_consensus.cc:2243] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.788573 11916 raft_consensus.cc:2272] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.790577 11916 tablet_replica.cc:333] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.791152 11916 raft_consensus.cc:2243] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.791718 11916 raft_consensus.cc:2272] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.791687 19721 raft_consensus.cc:493] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:56.792440 19721 raft_consensus.cc:515] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:56.794610 19721 leader_election.cc:290] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:56.795564 11916 tablet_replica.cc:333] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.796486 11916 raft_consensus.cc:2243] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.797283 11916 raft_consensus.cc:2272] T 93c48a9952404409941f272f18f7aa28 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.800782 11916 tablet_replica.cc:333] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
W20260709 12:21:56.800803 13838 leader_election.cc:336] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:56.801673 11916 raft_consensus.cc:2243] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.811154 11916 raft_consensus.cc:2272] T 8a2c1b9e8f954a65a5d7d3ebdd5ba5e9 P b190224a708b4f068a6dda4006c3a133 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.813939 11916 tablet_replica.cc:333] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
W20260709 12:21:56.814252 13841 leader_election.cc:336] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:56.814738 13841 leader_election.cc:304] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:56.814949 11916 raft_consensus.cc:2243] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.817348 19721 raft_consensus.cc:2749] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:56.816376 11916 raft_consensus.cc:2272] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:56.819790 13840 consensus_peers.cc:597] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.821101 11916 tablet_replica.cc:333] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.821746 11916 raft_consensus.cc:2243] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.822592 11916 raft_consensus.cc:2272] T 9ad86a9f99c849fa9efa50969bc43d9a P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.824769 11916 tablet_replica.cc:333] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.825554 11916 raft_consensus.cc:2243] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.826860 11916 raft_consensus.cc:2272] T f9377aea669547028ee8449f654c60b7 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.833707 11916 tablet_replica.cc:333] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.836465 11916 raft_consensus.cc:2243] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.837559 11916 raft_consensus.cc:2272] T 75e2a455a56d445bb7942e9f0b3f7f49 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.840106 11916 tablet_replica.cc:333] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.840849 11916 raft_consensus.cc:2243] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.841363 11916 raft_consensus.cc:2272] T 763333b6723c40cf8a4902d56603e45f P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:56.844595 13840 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.852037 19716 raft_consensus.cc:493] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:56.852581 19716 raft_consensus.cc:515] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } }
I20260709 12:21:56.854620 19716 leader_election.cc:290] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:56.861831 13252 leader_election.cc:336] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:56.863173 13840 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.863149 11916 tablet_replica.cc:333] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.864563 11916 raft_consensus.cc:2243] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.865774 11916 raft_consensus.cc:2272] T 7ef464caba794ab4955c661c56df278f P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:56.865916 13249 leader_election.cc:336] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:56.866451 13249 leader_election.cc:304] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b190224a708b4f068a6dda4006c3a133; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:56.867190 19716 raft_consensus.cc:2749] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:56.870224 11916 tablet_replica.cc:333] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.871605 11916 raft_consensus.cc:2243] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.873111 11916 raft_consensus.cc:2272] T 1622215fe6114b4b80c6430c2cbf33d0 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.877748 11916 tablet_replica.cc:333] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.878566 11916 raft_consensus.cc:2243] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.879664 11916 raft_consensus.cc:2272] T 5372f0f4e82241658d5d891336a8b6d4 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.881595 11916 tablet_replica.cc:333] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.882164 11916 raft_consensus.cc:2243] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.883880 11916 raft_consensus.cc:2272] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.887332 11916 tablet_replica.cc:333] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.887955 11916 raft_consensus.cc:2243] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.888612 11916 raft_consensus.cc:2272] T 44133e1a03bc4412a20badffb41bb55e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.890473 11916 tablet_replica.cc:333] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.891037 11916 raft_consensus.cc:2243] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.891532 11916 raft_consensus.cc:2272] T 5fc9abc16270419796fe8ad939321769 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.893422 11916 tablet_replica.cc:333] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.893961 11916 raft_consensus.cc:2243] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.894896 11916 raft_consensus.cc:2272] T 96956ab507b74b29b91a4c067585d07f P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.896760 11916 tablet_replica.cc:333] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.898437 11916 raft_consensus.cc:2243] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.899806 11916 raft_consensus.cc:2272] T c8df593339524328b819bd096f86f17d P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.902341 11916 tablet_replica.cc:333] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.903083 11916 raft_consensus.cc:2243] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.904114 11916 raft_consensus.cc:2272] T ca13f9e740914dfbb5008f9905f1da76 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.906646 11916 tablet_replica.cc:333] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.907397 11916 raft_consensus.cc:2243] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.908214 11916 raft_consensus.cc:2272] T 25bd867e44d047eeb41637598bf8d7fc P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.911037 11916 tablet_replica.cc:333] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.911890 11916 raft_consensus.cc:2243] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.913199 11916 raft_consensus.cc:2272] T 53ab219d48754e9b883a85ef2a514a1e P b190224a708b4f068a6dda4006c3a133 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.915877 11916 tablet_replica.cc:333] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.916512 11916 raft_consensus.cc:2243] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.917105 11916 raft_consensus.cc:2272] T c37477a485ab4cbfbeddcf8f65632297 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.919097 11916 tablet_replica.cc:333] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.919842 11916 raft_consensus.cc:2243] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.920877 11916 raft_consensus.cc:2272] T 8719253f6e514245b49fd2d6cf3d0ad4 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.922710 19721 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:56.923270 19721 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:56.924947 11916 tablet_replica.cc:333] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.925485 19721 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:56.926054 11916 raft_consensus.cc:2243] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.927284 11916 raft_consensus.cc:2272] T b5031b82872c430cbd03772ba96480ff P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.930656 11916 tablet_replica.cc:333] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.931527 11916 raft_consensus.cc:2243] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.932247 11916 raft_consensus.cc:2272] T e58a8c3577014cf6ba54f48ffedf7594 P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:56.932593 13838 leader_election.cc:336] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:56.935089 11916 tablet_replica.cc:333] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.935959 11916 raft_consensus.cc:2243] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:21:56.936013 13841 leader_election.cc:336] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:56.936630 13841 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:56.937098 11916 raft_consensus.cc:2272] T 79d6c326c49e497ab8d45ac2cf85f71f P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.937357 19721 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:56.939610 11916 tablet_replica.cc:333] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.940228 11916 raft_consensus.cc:2243] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.940759 11916 raft_consensus.cc:2272] T 62f45cc6bc2f488697756a90edeec54e P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.942986 11916 tablet_replica.cc:333] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.943737 11916 raft_consensus.cc:2243] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.944821 11916 raft_consensus.cc:2272] T f2ad0088ea4e4b988f1c76b3260f2b55 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.947402 11916 tablet_replica.cc:333] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.948096 11916 raft_consensus.cc:2243] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.949088 11916 raft_consensus.cc:2272] T 7285cfe46adb4975a532c3df36e5203e P b190224a708b4f068a6dda4006c3a133 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.951485 11916 tablet_replica.cc:333] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.952245 11916 raft_consensus.cc:2243] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.952888 11916 raft_consensus.cc:2272] T 6f2a264a18f24b6b9933300ddcde0f4e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.955613 11916 tablet_replica.cc:333] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.956341 11916 raft_consensus.cc:2243] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.957456 11916 raft_consensus.cc:2272] T 09b7d0dede2b49f5ba99e11fa703541e P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.959969 11916 tablet_replica.cc:333] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.960690 11916 raft_consensus.cc:2243] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:56.960708 13249 consensus_peers.cc:597] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:56.961485 11916 raft_consensus.cc:2272] T 7d4c4238ca2d414dbdb755c1217ef912 P b190224a708b4f068a6dda4006c3a133 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.964155 11916 tablet_replica.cc:333] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.964891 11916 raft_consensus.cc:2243] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.967398 11916 raft_consensus.cc:2272] T 4c6b052993424c29a7d49943db353a08 P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.969906 11916 tablet_replica.cc:333] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.970664 11916 raft_consensus.cc:2243] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.971766 11916 raft_consensus.cc:2272] T f042aff5e3084d5e8bd6fcb5335160f5 P b190224a708b4f068a6dda4006c3a133 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.974385 11916 tablet_replica.cc:333] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.975142 11916 raft_consensus.cc:2243] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.975703 11916 raft_consensus.cc:2272] T 51d5ddc60f3a4b948881a4efc95b8721 P b190224a708b4f068a6dda4006c3a133 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:56.976935 13840 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.978237 11916 tablet_replica.cc:333] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.979049 11916 raft_consensus.cc:2243] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.980240 11916 raft_consensus.cc:2272] T 2f7a6bb73699404e86b7d94b6633703c P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.982955 11916 tablet_replica.cc:333] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.983690 11916 raft_consensus.cc:2243] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.984325 11916 raft_consensus.cc:2272] T a3da01ae07634adb9184db323ba32a1c P b190224a708b4f068a6dda4006c3a133 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:56.985354 13840 consensus_peers.cc:597] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:56.989995 11916 tablet_replica.cc:333] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.990787 11916 raft_consensus.cc:2243] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.991365 11916 raft_consensus.cc:2272] T b2b4bbf33578469487ada15907f2483a P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.993934 11916 tablet_replica.cc:333] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.994616 11916 raft_consensus.cc:2243] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:56.995626 11916 raft_consensus.cc:2272] T 95ba4ee627684f4ea7e32e683e7bcd72 P b190224a708b4f068a6dda4006c3a133 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.998303 11916 tablet_replica.cc:333] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:56.999001 11916 raft_consensus.cc:2243] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.000056 11916 raft_consensus.cc:2272] T bac590852a8a4f4ea0a35528a7ae147d P b190224a708b4f068a6dda4006c3a133 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:57.002283 13838 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:57.002622 11916 tablet_replica.cc:333] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:57.003232 11916 raft_consensus.cc:2243] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.003803 11916 raft_consensus.cc:2272] T 937887e1967840639df25a74d4e57bfd P b190224a708b4f068a6dda4006c3a133 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.005793 11916 tablet_replica.cc:333] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133: stopping tablet replica
I20260709 12:21:57.006279 11916 raft_consensus.cc:2243] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.007277 11916 raft_consensus.cc:2272] T e1a3fa2c26ae4d9a8803582f91f9cff2 P b190224a708b4f068a6dda4006c3a133 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:57.121812 13840 consensus_peers.cc:597] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b -> Peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Couldn't send request to peer b190224a708b4f068a6dda4006c3a133. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:57.319088 13838 consensus_peers.cc:597] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:57.363996 13838 consensus_peers.cc:597] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:57.413698 13838 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:57.474018 13838 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:57.681182 13841 consensus_peers.cc:597] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:57.727170 19726 raft_consensus.cc:493] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:57.727728 19726 raft_consensus.cc:515] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } attrs { replace: true } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:57.731438 19726 leader_election.cc:290] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:57.741894 13841 leader_election.cc:336] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:57.743480 13840 leader_election.cc:336] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:21:57.745493 13840 leader_election.cc:304] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:57.746414 19726 raft_consensus.cc:2749] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:57.755518 19726 raft_consensus.cc:493] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:57.756043 19726 raft_consensus.cc:515] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:57.757527 13838 leader_election.cc:336] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:57.758294 19726 leader_election.cc:290] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
W20260709 12:21:57.764289 13841 leader_election.cc:336] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:57.764900 13838 leader_election.cc:336] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:57.765317 13838 leader_election.cc:304] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:57.765949 19726 raft_consensus.cc:2749] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:21:57.836037 13838 consensus_peers.cc:597] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:57.848208 13841 consensus_peers.cc:597] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:57.993358 13838 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:58.037536 19726 raft_consensus.cc:493] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.038126 19726 raft_consensus.cc:515] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.040385 19726 leader_election.cc:290] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:58.047318 13841 leader_election.cc:336] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:58.049464 13840 leader_election.cc:336] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:21:58.049875 13840 leader_election.cc:304] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.050585 19726 raft_consensus.cc:2749] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:58.060580 19726 raft_consensus.cc:493] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.061101 19726 raft_consensus.cc:515] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.063225 19726 leader_election.cc:290] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:58.067556 13841 leader_election.cc:336] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:58.068017 13840 leader_election.cc:336] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:21:58.068501 13840 leader_election.cc:304] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.069178 19726 raft_consensus.cc:2749] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:58.086722 19721 raft_consensus.cc:493] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.087263 19721 raft_consensus.cc:515] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.089417 19721 leader_election.cc:290] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:58.093560 13838 leader_election.cc:336] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:58.095139 13840 leader_election.cc:336] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:21:58.095600 13840 leader_election.cc:304] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.096305 19721 raft_consensus.cc:2749] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:58.108939 11916 tablet_server.cc:196] TabletServer@127.11.163.3:0 shutdown complete.
W20260709 12:21:58.119505 13838 consensus_peers.cc:597] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:58.128115 19721 raft_consensus.cc:493] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.128715 19721 raft_consensus.cc:515] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:58.135509 13838 leader_election.cc:336] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:58.136075 13840 leader_election.cc:336] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:21:58.136528 13840 leader_election.cc:304] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.137297 19726 raft_consensus.cc:2749] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:58.137387 19721 leader_election.cc:290] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:58.158669 13841 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:58.179735 19726 raft_consensus.cc:493] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.180335 19726 raft_consensus.cc:515] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.185353 19726 leader_election.cc:290] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:58.188072 13841 leader_election.cc:336] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:58.189188 13840 leader_election.cc:336] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:21:58.189639 13840 leader_election.cc:304] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.190389 19726 raft_consensus.cc:2749] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:58.198531 19726 raft_consensus.cc:493] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.199133 19726 raft_consensus.cc:515] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.201560 19726 leader_election.cc:290] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:58.206547 13838 leader_election.cc:336] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:58.207057 13840 leader_election.cc:336] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:21:58.207542 13840 leader_election.cc:304] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.208297 19726 raft_consensus.cc:2749] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:58.221213 11916 tablet_server.cc:179] TabletServer@127.11.163.4:0 shutting down...
I20260709 12:21:58.225780 19726 raft_consensus.cc:493] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.226413 19726 raft_consensus.cc:515] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:58.226761 13841 consensus_peers.cc:597] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:58.228662 19726 leader_election.cc:290] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:58.233269 13841 leader_election.cc:336] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
W20260709 12:21:58.233912 13840 leader_election.cc:336] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:21:58.234304 13840 leader_election.cc:304] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.234915 19726 raft_consensus.cc:2749] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:58.248345 19726 raft_consensus.cc:493] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.248921 19726 raft_consensus.cc:515] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.251016 19726 leader_election.cc:290] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:58.256669 13840 leader_election.cc:336] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
W20260709 12:21:58.261718 13841 leader_election.cc:336] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:58.262807 13841 leader_election.cc:304] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.264070 19721 raft_consensus.cc:2749] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:58.271207 13841 consensus_peers.cc:597] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:58.317302 19721 raft_consensus.cc:493] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:58.319914 19726 raft_consensus.cc:493] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.319187 19721 raft_consensus.cc:515] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.320900 19726 raft_consensus.cc:515] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.325941 19721 leader_election.cc:290] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:58.326783 19726 leader_election.cc:290] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:58.333845 13840 leader_election.cc:336] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
W20260709 12:21:58.336941 13841 leader_election.cc:336] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:58.348124 19726 raft_consensus.cc:493] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.349010 19726 raft_consensus.cc:515] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
W20260709 12:21:58.351590 13838 leader_election.cc:336] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:58.352099 13838 leader_election.cc:304] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.352841 19726 leader_election.cc:290] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:58.352933 19721 raft_consensus.cc:2749] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:58.354267 13838 leader_election.cc:336] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:58.354691 13838 leader_election.cc:304] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:58.355403 19721 raft_consensus.cc:2749] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:58.356243 13840 leader_election.cc:336] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:21:58.357496 19721 raft_consensus.cc:493] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:21:58.358274 13841 leader_election.cc:336] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:58.358683 13841 leader_election.cc:304] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.358345 19721 raft_consensus.cc:515] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.359599 19726 raft_consensus.cc:2749] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:58.361346 19721 leader_election.cc:290] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:58.365625 13838 leader_election.cc:336] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:58.368331 13840 leader_election.cc:336] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:21:58.370033 19721 raft_consensus.cc:493] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
W20260709 12:21:58.370232 13841 leader_election.cc:336] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:58.370713 13841 leader_election.cc:304] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.370986 19721 raft_consensus.cc:515] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.371640 19729 raft_consensus.cc:2749] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:58.373323 19721 leader_election.cc:290] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
W20260709 12:21:58.377801 13840 leader_election.cc:336] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
W20260709 12:21:58.379868 13841 leader_election.cc:336] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:58.380333 13841 leader_election.cc:304] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.381119 19721 raft_consensus.cc:2749] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:58.386379 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:58.387595 19721 raft_consensus.cc:493] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.388188 11916 tablet_replica.cc:333] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.388623 19721 raft_consensus.cc:515] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.389919 11916 raft_consensus.cc:2243] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.391088 11916 raft_consensus.cc:2272] T 06fdf45f6d794f90a80b05b5fe3f2316 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.392350 19721 leader_election.cc:290] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605), b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631)
I20260709 12:21:58.395323 11916 tablet_replica.cc:333] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
W20260709 12:21:58.396449 13841 consensus_peers.cc:597] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:58.396474 13840 leader_election.cc:336] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:21:58.397715 11916 raft_consensus.cc:2243] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.398465 11916 raft_consensus.cc:2272] T 86b4311504b54b2c8d99d43a9b057e8f P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:58.399713 13841 leader_election.cc:336] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:58.400252 13841 leader_election.cc:304] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.401119 19721 raft_consensus.cc:2749] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:58.402756 11916 tablet_replica.cc:333] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.403937 11916 raft_consensus.cc:2243] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.405193 11916 raft_consensus.cc:2272] T e1a3fa2c26ae4d9a8803582f91f9cff2 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.408852 11916 tablet_replica.cc:333] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.409967 11916 raft_consensus.cc:2243] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.413861 11916 raft_consensus.cc:2272] T 53ab219d48754e9b883a85ef2a514a1e P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.418365 11916 tablet_replica.cc:333] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.419250 11916 raft_consensus.cc:2243] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.422012 11916 raft_consensus.cc:2272] T 9cf69f9fcd1a4ec4a5526f84e6d06eba P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:58.424633 13841 consensus_peers.cc:597] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:58.425741 19721 raft_consensus.cc:493] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b190224a708b4f068a6dda4006c3a133)
I20260709 12:21:58.425913 11916 tablet_replica.cc:333] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.426595 19721 raft_consensus.cc:515] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b190224a708b4f068a6dda4006c3a133" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 35631 } } peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.427138 11916 raft_consensus.cc:2243] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.428224 11916 raft_consensus.cc:2272] T 6fd86be5bbd94b1aa09465a16ec1c5b3 P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.431607 19721 leader_election.cc:290] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631), af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201)
I20260709 12:21:58.431975 11916 tablet_replica.cc:333] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.433225 11916 raft_consensus.cc:2243] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.435770 11916 raft_consensus.cc:2272] T 3642b79a5a004395947fefe912c71406 P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:58.435817 13840 leader_election.cc:336] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
W20260709 12:21:58.436896 13838 leader_election.cc:336] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
I20260709 12:21:58.437384 13838 leader_election.cc:304] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: af3f42f0797349058724e0cb2e637d24, b190224a708b4f068a6dda4006c3a133
I20260709 12:21:58.438202 19729 raft_consensus.cc:2749] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:58.439306 11916 tablet_replica.cc:333] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
W20260709 12:21:58.440172 13838 consensus_peers.cc:597] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:58.440398 11916 raft_consensus.cc:2243] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.441823 11916 raft_consensus.cc:2272] T 93c48a9952404409941f272f18f7aa28 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.444888 11916 tablet_replica.cc:333] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.445591 11916 raft_consensus.cc:2243] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.446753 11916 raft_consensus.cc:2272] T 96956ab507b74b29b91a4c067585d07f P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:58.448686 13841 consensus_peers.cc:597] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b -> Peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Couldn't send request to peer a99436c294734e5cbc3657b2517cefca. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:58.450276 11916 tablet_replica.cc:333] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.451009 11916 raft_consensus.cc:2243] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.451808 11916 raft_consensus.cc:2272] T f2ad0088ea4e4b988f1c76b3260f2b55 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.455271 11916 tablet_replica.cc:333] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.456284 11916 raft_consensus.cc:2243] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.458674 11916 raft_consensus.cc:2272] T b2b4bbf33578469487ada15907f2483a P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.459973 19729 raft_consensus.cc:493] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a99436c294734e5cbc3657b2517cefca)
I20260709 12:21:58.460736 19729 raft_consensus.cc:515] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "af3f42f0797349058724e0cb2e637d24" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 35201 } } peers { permanent_uuid: "a99436c294734e5cbc3657b2517cefca" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34605 } } peers { permanent_uuid: "cbc6af7757ec459ab451e47724fdf44b" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 37379 } attrs { promote: false } }
I20260709 12:21:58.462340 11916 tablet_replica.cc:333] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.463245 11916 raft_consensus.cc:2243] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.463420 19729 leader_election.cc:290] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201), a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605)
I20260709 12:21:58.464118 11916 raft_consensus.cc:2272] T 3fb24dc556e54ae2bb5b9d6900ea82f5 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:58.465286 13838 consensus_peers.cc:597] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b -> Peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Couldn't send request to peer af3f42f0797349058724e0cb2e637d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:58.467964 13838 leader_election.cc:336] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer af3f42f0797349058724e0cb2e637d24 (127.11.163.1:35201): Network error: Client connection negotiation failed: client connection to 127.11.163.1:35201: connect: Connection refused (error 111)
W20260709 12:21:58.468462 13841 leader_election.cc:336] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a99436c294734e5cbc3657b2517cefca (127.11.163.2:34605): Network error: Client connection negotiation failed: client connection to 127.11.163.2:34605: connect: Connection refused (error 111)
I20260709 12:21:58.468885 11916 tablet_replica.cc:333] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.468937 13841 leader_election.cc:304] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbc6af7757ec459ab451e47724fdf44b; no voters: a99436c294734e5cbc3657b2517cefca, af3f42f0797349058724e0cb2e637d24
I20260709 12:21:58.470057 19721 raft_consensus.cc:2749] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:58.470273 11916 raft_consensus.cc:2243] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.472115 11916 raft_consensus.cc:2272] T 09b7d0dede2b49f5ba99e11fa703541e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.477098 11916 tablet_replica.cc:333] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.478174 11916 raft_consensus.cc:2243] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.480242 11916 raft_consensus.cc:2272] T 904dfe40ae474e1689d6b8be4e1dba77 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.483801 11916 tablet_replica.cc:333] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.484668 11916 raft_consensus.cc:2243] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.485677 11916 raft_consensus.cc:2272] T f4b0e40c530c4ec4b4ac3137f7bbe1f2 P cbc6af7757ec459ab451e47724fdf44b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.489763 11916 tablet_replica.cc:333] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.490600 11916 raft_consensus.cc:2243] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.491552 11916 raft_consensus.cc:2272] T f369b73ff12847ccbbb00601fe431eb4 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.495378 11916 tablet_replica.cc:333] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.496461 11916 raft_consensus.cc:2243] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.497396 11916 raft_consensus.cc:2272] T 5372f0f4e82241658d5d891336a8b6d4 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.501044 11916 tablet_replica.cc:333] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.502113 11916 raft_consensus.cc:2243] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.503201 11916 raft_consensus.cc:2272] T 2f7a6bb73699404e86b7d94b6633703c P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.506590 11916 tablet_replica.cc:333] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.507416 11916 raft_consensus.cc:2243] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.509050 11916 raft_consensus.cc:2272] T 6b675043435441bb980d9a219c4d3450 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.512396 11916 tablet_replica.cc:333] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.513346 11916 raft_consensus.cc:2243] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.514223 11916 raft_consensus.cc:2272] T 1c7b93f2b99d4c27915adea1f987deff P cbc6af7757ec459ab451e47724fdf44b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.517728 11916 tablet_replica.cc:333] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.518643 11916 raft_consensus.cc:2243] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.519381 11916 raft_consensus.cc:2272] T bac590852a8a4f4ea0a35528a7ae147d P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.523204 11916 tablet_replica.cc:333] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.524147 11916 raft_consensus.cc:2243] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.525115 11916 raft_consensus.cc:2272] T 8820b0db2b544a93ba81b2abe6292404 P cbc6af7757ec459ab451e47724fdf44b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.528903 11916 tablet_replica.cc:333] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.529750 11916 raft_consensus.cc:2243] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.531329 11916 raft_consensus.cc:2272] T 9ad86a9f99c849fa9efa50969bc43d9a P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.534622 11916 tablet_replica.cc:333] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.535457 11916 raft_consensus.cc:2243] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.537429 11916 raft_consensus.cc:2272] T b5031b82872c430cbd03772ba96480ff P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.540766 11916 tablet_replica.cc:333] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.541527 11916 raft_consensus.cc:2243] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.543287 11916 raft_consensus.cc:2272] T 5fc9abc16270419796fe8ad939321769 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.546772 11916 tablet_replica.cc:333] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.547633 11916 raft_consensus.cc:2243] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.549751 11916 raft_consensus.cc:2272] T a2b8aac4336e49d4bc5ba21f80833bd5 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.553169 11916 tablet_replica.cc:333] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.553910 11916 raft_consensus.cc:2243] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.555644 11916 raft_consensus.cc:2272] T 35e9975f4caa4eb7be07cf7ee3aed8b3 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.558836 11916 tablet_replica.cc:333] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.559693 11916 raft_consensus.cc:2243] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.560706 11916 raft_consensus.cc:2272] T 8719253f6e514245b49fd2d6cf3d0ad4 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.564114 11916 tablet_replica.cc:333] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.564831 11916 raft_consensus.cc:2243] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.566594 11916 raft_consensus.cc:2272] T 6f2a264a18f24b6b9933300ddcde0f4e P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.569722 11916 tablet_replica.cc:333] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.570540 11916 raft_consensus.cc:2243] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.572433 11916 raft_consensus.cc:2272] T 937887e1967840639df25a74d4e57bfd P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.576090 11916 tablet_replica.cc:333] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.577883 11916 raft_consensus.cc:2243] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.579365 11916 raft_consensus.cc:2272] T 2ec9e4c4c40a4fd8a2fa03ecdfa63507 P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.582333 11916 tablet_replica.cc:333] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.583128 11916 raft_consensus.cc:2243] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.584136 11916 raft_consensus.cc:2272] T 75e2a455a56d445bb7942e9f0b3f7f49 P cbc6af7757ec459ab451e47724fdf44b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.587306 11916 tablet_replica.cc:333] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.588042 11916 raft_consensus.cc:2243] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.588934 11916 raft_consensus.cc:2272] T 4c6b052993424c29a7d49943db353a08 P cbc6af7757ec459ab451e47724fdf44b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.591892 11916 tablet_replica.cc:333] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.592657 11916 raft_consensus.cc:2243] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.593439 11916 raft_consensus.cc:2272] T c8df593339524328b819bd096f86f17d P cbc6af7757ec459ab451e47724fdf44b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.596364 11916 tablet_replica.cc:333] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.597115 11916 raft_consensus.cc:2243] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.597914 11916 raft_consensus.cc:2272] T 7285cfe46adb4975a532c3df36e5203e P cbc6af7757ec459ab451e47724fdf44b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.601059 11916 tablet_replica.cc:333] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.601729 11916 raft_consensus.cc:2243] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.603149 11916 raft_consensus.cc:2272] T 62f45cc6bc2f488697756a90edeec54e P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.605960 11916 tablet_replica.cc:333] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.606624 11916 raft_consensus.cc:2243] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:58.608515 11916 raft_consensus.cc:2272] T f042aff5e3084d5e8bd6fcb5335160f5 P cbc6af7757ec459ab451e47724fdf44b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.611129 11916 tablet_replica.cc:333] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.611708 11916 raft_consensus.cc:2243] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.612840 11916 raft_consensus.cc:2272] T 1505ff0869734d74a99b739df5b0530a P cbc6af7757ec459ab451e47724fdf44b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:58.615343 11916 tablet_replica.cc:333] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b: stopping tablet replica
I20260709 12:21:58.615878 11916 raft_consensus.cc:2243] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:58.617025 11916 raft_consensus.cc:2272] T a9b25f727caf4a5598422d510a2e6868 P cbc6af7757ec459ab451e47724fdf44b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:59.014405 11916 tablet_server.cc:196] TabletServer@127.11.163.4:0 shutdown complete.
I20260709 12:21:59.099833 11916 master.cc:562] Master@127.11.163.62:33937 shutting down...
W20260709 12:21:59.140636 13083 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:21:59.141011 13083 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:21:59.141263 13083 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:22:02.817198 13066 debug-util.cc:398] Leaking SignalData structure 0x7b080000b5e0 after lost signal to thread 11919
W20260709 12:22:02.817832 13066 debug-util.cc:398] Leaking SignalData structure 0x7b080027c400 after lost signal to thread 13069
W20260709 12:22:21.471706 13021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111) [suppressed 418 similar messages]
W20260709 12:22:21.475612 13021 catalog_manager.cc:4755] TS b190224a708b4f068a6dda4006c3a133 (127.11.163.3:35631): ChangeConfig:REMOVE_PEER RPC failed for tablet e1a3fa2c26ae4d9a8803582f91f9cff2: Network error: Client connection negotiation failed: client connection to 127.11.163.3:35631: connect: Connection refused (error 111)
I20260709 12:22:25.714205 11916 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:25.715374 11916 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.715843 11916 tablet_replica.cc:333] T 00000000000000000000000000000000 P 98cf96dd74f448d18b23072207e1dc85: stopping tablet replica
I20260709 12:22:25.917214 11916 master.cc:584] Master@127.11.163.62:33937 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (243779 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:22:26.038869 11916 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.163.62:41995
I20260709 12:22:26.040558 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:26.046439 19734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.046690 19735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.049374 19737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.050604 11916 server_base.cc:1061] running on GCE node
I20260709 12:22:26.053784 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:26.053980 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:26.054181 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599746054146 us; error 0 us; skew 500 ppm
I20260709 12:22:26.054759 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:26.057253 11916 webserver.cc:533] Webserver started at http://127.11.163.62:35455/ using document root <none> and password file <none>
I20260709 12:22:26.057785 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:26.057974 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:26.058256 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:26.059706 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/master-0-root/instance:
uuid: "1b7f3e2962e245da985b7f1114066e8f"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-z9f9"
I20260709 12:22:26.064395 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:22:26.067899 19742 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.068662 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:22:26.069018 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/master-0-root
uuid: "1b7f3e2962e245da985b7f1114066e8f"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-z9f9"
I20260709 12:22:26.069268 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:26.089655 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:26.090996 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:26.132129 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.62:41995
I20260709 12:22:26.132257 19793 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.62:41995 every 8 connection(s)
I20260709 12:22:26.136618 19794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:26.149887 19794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f: Bootstrap starting.
I20260709 12:22:26.155355 19794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:26.160173 19794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f: No bootstrap required, opened a new log
I20260709 12:22:26.162474 19794 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b7f3e2962e245da985b7f1114066e8f" member_type: VOTER }
I20260709 12:22:26.162994 19794 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:26.163249 19794 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b7f3e2962e245da985b7f1114066e8f, State: Initialized, Role: FOLLOWER
I20260709 12:22:26.163902 19794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b7f3e2962e245da985b7f1114066e8f" member_type: VOTER }
I20260709 12:22:26.164373 19794 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:26.164599 19794 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:26.164903 19794 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.169790 19794 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b7f3e2962e245da985b7f1114066e8f" member_type: VOTER }
I20260709 12:22:26.170349 19794 leader_election.cc:304] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b7f3e2962e245da985b7f1114066e8f; no voters: 
I20260709 12:22:26.171696 19794 leader_election.cc:290] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:26.172101 19797 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:26.173683 19797 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [term 1 LEADER]: Becoming Leader. State: Replica: 1b7f3e2962e245da985b7f1114066e8f, State: Running, Role: LEADER
I20260709 12:22:26.174465 19797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b7f3e2962e245da985b7f1114066e8f" member_type: VOTER }
I20260709 12:22:26.174677 19794 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:26.185266 19799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b7f3e2962e245da985b7f1114066e8f. Latest consensus state: current_term: 1 leader_uuid: "1b7f3e2962e245da985b7f1114066e8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b7f3e2962e245da985b7f1114066e8f" member_type: VOTER } }
I20260709 12:22:26.185456 19798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b7f3e2962e245da985b7f1114066e8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b7f3e2962e245da985b7f1114066e8f" member_type: VOTER } }
I20260709 12:22:26.185847 19799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:26.186093 19798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:26.188158 19808 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:26.195669 19808 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:26.196732 11916 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:26.205204 19808 catalog_manager.cc:1383] Generated new cluster ID: c125b25ed1ae4fa28b5744d7fda88bee
I20260709 12:22:26.205559 19808 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:26.221060 19808 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:26.222487 19808 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:26.235359 19808 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f: Generated new TSK 0
I20260709 12:22:26.236079 19808 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:26.264096 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:26.271744 19816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.270504 19815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.272974 19818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.274482 11916 server_base.cc:1061] running on GCE node
I20260709 12:22:26.277010 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:26.277200 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:26.277416 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599746277375 us; error 0 us; skew 500 ppm
I20260709 12:22:26.278045 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:26.280683 11916 webserver.cc:533] Webserver started at http://127.11.163.1:34089/ using document root <none> and password file <none>
I20260709 12:22:26.281170 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:26.281373 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:26.281633 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:26.282821 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/instance:
uuid: "0521760b9b9046b6a1dfd0886aa228f5"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-z9f9"
I20260709 12:22:26.287597 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:26.291231 19823 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.292088 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:26.292433 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-0-root
uuid: "0521760b9b9046b6a1dfd0886aa228f5"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-z9f9"
I20260709 12:22:26.292724 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:26.302975 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:26.304299 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:26.305908 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:26.308409 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:26.308643 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.308890 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:26.309083 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.352578 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.1:39037
I20260709 12:22:26.352759 19885 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.1:39037 every 8 connection(s)
I20260709 12:22:26.357686 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:26.366847 19890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.368114 19891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.370116 19893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.372704 11916 server_base.cc:1061] running on GCE node
I20260709 12:22:26.374571 19886 heartbeater.cc:344] Connected to a master server at 127.11.163.62:41995
I20260709 12:22:26.375087 19886 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:26.376009 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:26.376382 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:26.376024 19886 heartbeater.cc:507] Master 127.11.163.62:41995 requested a full tablet report, sending...
I20260709 12:22:26.376631 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599746376610 us; error 0 us; skew 500 ppm
I20260709 12:22:26.377377 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:26.379418 19759 ts_manager.cc:194] Registered new tserver with Master: 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:26.380620 11916 webserver.cc:533] Webserver started at http://127.11.163.2:35765/ using document root <none> and password file <none>
I20260709 12:22:26.381363 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:26.381605 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:26.381901 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:26.382133 19759 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37614
I20260709 12:22:26.383777 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/instance:
uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-z9f9"
I20260709 12:22:26.388574 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:22:26.392329 19898 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.393307 11916 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:26.393680 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-1-root
uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-z9f9"
I20260709 12:22:26.394035 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:26.419593 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:26.420923 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:26.422443 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:26.425088 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:26.425338 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.425597 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:26.425817 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.471828 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.2:36799
I20260709 12:22:26.471930 19960 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.2:36799 every 8 connection(s)
I20260709 12:22:26.477398 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:26.486986 19965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.487897 19964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.491339 19967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.492648 19961 heartbeater.cc:344] Connected to a master server at 127.11.163.62:41995
I20260709 12:22:26.493201 19961 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:26.494161 11916 server_base.cc:1061] running on GCE node
I20260709 12:22:26.494340 19961 heartbeater.cc:507] Master 127.11.163.62:41995 requested a full tablet report, sending...
I20260709 12:22:26.495347 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:26.495689 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:26.496142 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599746496118 us; error 0 us; skew 500 ppm
I20260709 12:22:26.497107 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:26.497059 19759 ts_manager.cc:194] Registered new tserver with Master: 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:26.499358 19759 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37630
I20260709 12:22:26.500458 11916 webserver.cc:533] Webserver started at http://127.11.163.3:37175/ using document root <none> and password file <none>
I20260709 12:22:26.501271 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:26.501541 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:26.501914 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:26.503400 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/instance:
uuid: "86ad94e539f24675ba7226e7371cec9b"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-z9f9"
I20260709 12:22:26.508432 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:22:26.512216 19972 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.513108 11916 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:22:26.513478 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-2-root
uuid: "86ad94e539f24675ba7226e7371cec9b"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-z9f9"
I20260709 12:22:26.513800 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:26.536703 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:26.538128 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:26.539862 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:26.542285 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:26.542490 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.542824 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:26.542986 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.588788 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.3:42705
I20260709 12:22:26.588987 20034 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.3:42705 every 8 connection(s)
I20260709 12:22:26.594245 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:26.601783 20038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.602521 20039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.605127 11916 server_base.cc:1061] running on GCE node
W20260709 12:22:26.605796 20042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.607048 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:26.607491 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:26.607512 20035 heartbeater.cc:344] Connected to a master server at 127.11.163.62:41995
I20260709 12:22:26.607844 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599746607825 us; error 0 us; skew 500 ppm
I20260709 12:22:26.608143 20035 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:26.608750 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:26.609055 20035 heartbeater.cc:507] Master 127.11.163.62:41995 requested a full tablet report, sending...
I20260709 12:22:26.611795 19759 ts_manager.cc:194] Registered new tserver with Master: 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:26.612010 11916 webserver.cc:533] Webserver started at http://127.11.163.4:41535/ using document root <none> and password file <none>
I20260709 12:22:26.612769 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:26.613034 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:26.613391 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:26.613904 19759 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37632
I20260709 12:22:26.615202 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-3-root/instance:
uuid: "eafc6cb9dfb7468581367b29682ec024"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-z9f9"
I20260709 12:22:26.620242 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:22:26.624068 20046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.624862 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:26.625216 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-3-root
uuid: "eafc6cb9dfb7468581367b29682ec024"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-z9f9"
I20260709 12:22:26.625507 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:26.635812 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:26.637049 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:26.638557 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:26.640884 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:26.641134 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.641388 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:26.641569 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:26.684502 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.4:45345
I20260709 12:22:26.684592 20108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.4:45345 every 8 connection(s)
I20260709 12:22:26.699361 20109 heartbeater.cc:344] Connected to a master server at 127.11.163.62:41995
I20260709 12:22:26.699779 20109 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:26.700397 20109 heartbeater.cc:507] Master 127.11.163.62:41995 requested a full tablet report, sending...
I20260709 12:22:26.702287 19759 ts_manager.cc:194] Registered new tserver with Master: eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:26.702842 11916 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015109165s
I20260709 12:22:26.704022 19759 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37640
I20260709 12:22:26.732581 19759 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37642:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:22:26.994874 20000 tablet_service.cc:1511] Processing CreateTablet for tablet 0df0d91742ce445ba27b3b21ed1b1692 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:26.996805 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df0d91742ce445ba27b3b21ed1b1692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.004434 19926 tablet_service.cc:1511] Processing CreateTablet for tablet 0df0d91742ce445ba27b3b21ed1b1692 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:27.006394 19926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df0d91742ce445ba27b3b21ed1b1692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.019850 19995 tablet_service.cc:1511] Processing CreateTablet for tablet b26bba3e147042a9bc03b848a9e13780 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:27.021494 19995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b26bba3e147042a9bc03b848a9e13780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.007997 19925 tablet_service.cc:1511] Processing CreateTablet for tablet b3d5cc1a80804da78ba578ecc962897f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:27.009506 19999 tablet_service.cc:1511] Processing CreateTablet for tablet e552c7773ca94ad597485fb7683e0ec2 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:27.024328 19925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d5cc1a80804da78ba578ecc962897f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.024514 19999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e552c7773ca94ad597485fb7683e0ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.028483 20074 tablet_service.cc:1511] Processing CreateTablet for tablet b3d5cc1a80804da78ba578ecc962897f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:27.028841 19850 tablet_service.cc:1511] Processing CreateTablet for tablet b3d5cc1a80804da78ba578ecc962897f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:27.030093 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d5cc1a80804da78ba578ecc962897f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.030440 19850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d5cc1a80804da78ba578ecc962897f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.032008 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 4498a59f91364174bc407d6d3adb80dd (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:27.033509 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4498a59f91364174bc407d6d3adb80dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.033229 19849 tablet_service.cc:1511] Processing CreateTablet for tablet e552c7773ca94ad597485fb7683e0ec2 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:27.037279 19847 tablet_service.cc:1511] Processing CreateTablet for tablet 5e23ef51791b4a54986be21fcd6b36b1 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:27.011915 19923 tablet_service.cc:1511] Processing CreateTablet for tablet 21c9eef48cb44a5c90e59f965bf16d75 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:27.040319 19923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c9eef48cb44a5c90e59f965bf16d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.041167 20071 tablet_service.cc:1511] Processing CreateTablet for tablet 5e23ef51791b4a54986be21fcd6b36b1 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:27.041250 19845 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3b7cf591de4141825ccc578837bdb3 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:27.042752 20071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e23ef51791b4a54986be21fcd6b36b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.044950 19848 tablet_service.cc:1511] Processing CreateTablet for tablet 21c9eef48cb44a5c90e59f965bf16d75 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:27.012332 19998 tablet_service.cc:1511] Processing CreateTablet for tablet 4498a59f91364174bc407d6d3adb80dd (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:27.047825 19998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4498a59f91364174bc407d6d3adb80dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.048823 19846 tablet_service.cc:1511] Processing CreateTablet for tablet 4169ab4a7eee4ce587af1e7350f8629e (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:27.049329 20070 tablet_service.cc:1511] Processing CreateTablet for tablet 4169ab4a7eee4ce587af1e7350f8629e (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:27.050833 20070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4169ab4a7eee4ce587af1e7350f8629e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.051391 19851 tablet_service.cc:1511] Processing CreateTablet for tablet 0df0d91742ce445ba27b3b21ed1b1692 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:27.052668 20069 tablet_service.cc:1511] Processing CreateTablet for tablet b26bba3e147042a9bc03b848a9e13780 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:27.014768 19997 tablet_service.cc:1511] Processing CreateTablet for tablet 21c9eef48cb44a5c90e59f965bf16d75 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:27.054098 20069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b26bba3e147042a9bc03b848a9e13780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.054376 19997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c9eef48cb44a5c90e59f965bf16d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.015717 19921 tablet_service.cc:1511] Processing CreateTablet for tablet b26bba3e147042a9bc03b848a9e13780 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:27.056469 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b26bba3e147042a9bc03b848a9e13780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.017294 19996 tablet_service.cc:1511] Processing CreateTablet for tablet 4169ab4a7eee4ce587af1e7350f8629e (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:27.060469 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4169ab4a7eee4ce587af1e7350f8629e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.017591 19920 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3b7cf591de4141825ccc578837bdb3 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:27.064466 19920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3b7cf591de4141825ccc578837bdb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.029697 20073 tablet_service.cc:1511] Processing CreateTablet for tablet e552c7773ca94ad597485fb7683e0ec2 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:27.068681 20073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e552c7773ca94ad597485fb7683e0ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.009953 19924 tablet_service.cc:1511] Processing CreateTablet for tablet 4498a59f91364174bc407d6d3adb80dd (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:27.072504 19924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4498a59f91364174bc407d6d3adb80dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.013783 19922 tablet_service.cc:1511] Processing CreateTablet for tablet 5e23ef51791b4a54986be21fcd6b36b1 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:27.076704 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e23ef51791b4a54986be21fcd6b36b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.035281 19849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e552c7773ca94ad597485fb7683e0ec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.105265 19994 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3b7cf591de4141825ccc578837bdb3 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:27.107966 19994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3b7cf591de4141825ccc578837bdb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.130164 19846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4169ab4a7eee4ce587af1e7350f8629e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.157994 20068 tablet_service.cc:1511] Processing CreateTablet for tablet f9721080ec054fdebd8303f5a8cc8b70 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:27.159583 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9721080ec054fdebd8303f5a8cc8b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.167255 19993 tablet_service.cc:1511] Processing CreateTablet for tablet d5b6778cad39436ab0a260f86049592f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:22:27.168896 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b6778cad39436ab0a260f86049592f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.177000 20127 tablet_bootstrap.cc:492] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
W20260709 12:22:27.188025 19806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:27.188766 19843 tablet_service.cc:1511] Processing CreateTablet for tablet d5b6778cad39436ab0a260f86049592f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:22:27.190264 19918 tablet_service.cc:1511] Processing CreateTablet for tablet f153ead7b64c4983b271c2c190b7d2fc (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:27.191356 19919 tablet_service.cc:1511] Processing CreateTablet for tablet f9721080ec054fdebd8303f5a8cc8b70 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:27.192852 19919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9721080ec054fdebd8303f5a8cc8b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.182819 19844 tablet_service.cc:1511] Processing CreateTablet for tablet f9721080ec054fdebd8303f5a8cc8b70 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:27.197472 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df0d91742ce445ba27b3b21ed1b1692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.200053 19918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f153ead7b64c4983b271c2c190b7d2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.203810 20000 tablet_service.cc:1511] Processing CreateTablet for tablet f153ead7b64c4983b271c2c190b7d2fc (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:27.205178 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f153ead7b64c4983b271c2c190b7d2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.213160 19847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e23ef51791b4a54986be21fcd6b36b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.215469 19845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3b7cf591de4141825ccc578837bdb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.217067 19844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9721080ec054fdebd8303f5a8cc8b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.218289 19848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c9eef48cb44a5c90e59f965bf16d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.231704 19843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b6778cad39436ab0a260f86049592f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.231966 19842 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb16fbe1d984b77949f632328ba99fb (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:27.233458 19842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb16fbe1d984b77949f632328ba99fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.239476 20128 tablet_bootstrap.cc:492] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:27.254419 20072 tablet_service.cc:1511] Processing CreateTablet for tablet f153ead7b64c4983b271c2c190b7d2fc (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:27.262790 20074 tablet_service.cc:1511] Processing CreateTablet for tablet d5b6778cad39436ab0a260f86049592f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:22:27.276496 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b6778cad39436ab0a260f86049592f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.263384 20127 tablet_bootstrap.cc:654] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.277411 19993 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb16fbe1d984b77949f632328ba99fb (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:27.278995 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb16fbe1d984b77949f632328ba99fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.277360 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f153ead7b64c4983b271c2c190b7d2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.296154 20129 tablet_bootstrap.cc:492] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:27.297538 19922 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb16fbe1d984b77949f632328ba99fb (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:27.299013 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb16fbe1d984b77949f632328ba99fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.309605 20068 tablet_service.cc:1511] Processing CreateTablet for tablet d318a253a656405f809d73600a4fab9b (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:22:27.311127 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d318a253a656405f809d73600a4fab9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.324018 20128 tablet_bootstrap.cc:654] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.319344 20129 tablet_bootstrap.cc:654] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.335222 20127 tablet_bootstrap.cc:492] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:27.338227 20130 tablet_bootstrap.cc:492] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:27.339650 20127 ts_tablet_manager.cc:1403] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.163s	user 0.011s	sys 0.010s
I20260709 12:22:27.351836 19843 tablet_service.cc:1511] Processing CreateTablet for tablet d318a253a656405f809d73600a4fab9b (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:22:27.357435 19921 tablet_service.cc:1511] Processing CreateTablet for tablet d318a253a656405f809d73600a4fab9b (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:22:27.360811 19843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d318a253a656405f809d73600a4fab9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.361440 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d318a253a656405f809d73600a4fab9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.365399 20128 tablet_bootstrap.cc:492] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:27.366029 20128 ts_tablet_manager.cc:1403] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.127s	user 0.005s	sys 0.012s
I20260709 12:22:27.369670 20128 raft_consensus.cc:359] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:27.370527 20128 raft_consensus.cc:385] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.371029 19996 tablet_service.cc:1511] Processing CreateTablet for tablet 371a360baa8343b796acd184956f785e (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:27.372130 20127 raft_consensus.cc:359] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:27.373010 20127 raft_consensus.cc:385] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.373348 20127 raft_consensus.cc:740] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.370883 20128 raft_consensus.cc:740] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.374408 20127 consensus_queue.cc:260] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:27.377025 20128 consensus_queue.cc:260] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:27.378523 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 371a360baa8343b796acd184956f785e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.388928 19886 heartbeater.cc:499] Master 127.11.163.62:41995 was elected leader, sending a full tablet report...
I20260709 12:22:27.392758 20068 tablet_service.cc:1511] Processing CreateTablet for tablet 371a360baa8343b796acd184956f785e (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:27.394331 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 371a360baa8343b796acd184956f785e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.394812 20130 tablet_bootstrap.cc:654] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.395751 19919 tablet_service.cc:1511] Processing CreateTablet for tablet bd522cd408c24f868f5c1c4ab9d026b6 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:27.397277 19919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd522cd408c24f868f5c1c4ab9d026b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.403162 19843 tablet_service.cc:1511] Processing CreateTablet for tablet 371a360baa8343b796acd184956f785e (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:27.409904 19994 tablet_service.cc:1511] Processing CreateTablet for tablet bd522cd408c24f868f5c1c4ab9d026b6 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:27.411994 19994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd522cd408c24f868f5c1c4ab9d026b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.415390 20074 tablet_service.cc:1511] Processing CreateTablet for tablet bd522cd408c24f868f5c1c4ab9d026b6 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:27.416843 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd522cd408c24f868f5c1c4ab9d026b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.410611 19843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 371a360baa8343b796acd184956f785e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.423717 20035 heartbeater.cc:499] Master 127.11.163.62:41995 was elected leader, sending a full tablet report...
I20260709 12:22:27.426302 19842 tablet_service.cc:1511] Processing CreateTablet for tablet 94dee1529a574c56ad2cb367867c20b7 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:27.429059 19924 tablet_service.cc:1511] Processing CreateTablet for tablet 94dee1529a574c56ad2cb367867c20b7 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:27.430490 19924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94dee1529a574c56ad2cb367867c20b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.419615 20129 tablet_bootstrap.cc:492] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:27.445005 20000 tablet_service.cc:1511] Processing CreateTablet for tablet 94dee1529a574c56ad2cb367867c20b7 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:27.446480 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94dee1529a574c56ad2cb367867c20b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.450655 19961 heartbeater.cc:499] Master 127.11.163.62:41995 was elected leader, sending a full tablet report...
I20260709 12:22:27.449280 20129 ts_tablet_manager.cc:1403] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.154s	user 0.010s	sys 0.016s
I20260709 12:22:27.462512 19842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94dee1529a574c56ad2cb367867c20b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.466080 20129 raft_consensus.cc:359] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:27.467549 20135 raft_consensus.cc:493] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.468436 20135 raft_consensus.cc:515] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:27.472585 20135 leader_election.cc:290] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:27.487054 20127 ts_tablet_manager.cc:1434] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.127s	user 0.005s	sys 0.017s
I20260709 12:22:27.488420 20127 tablet_bootstrap.cc:492] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:27.489835 20068 tablet_service.cc:1511] Processing CreateTablet for tablet 10bb95b2a5614ee7b33bf343c88fdf34 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:27.491345 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10bb95b2a5614ee7b33bf343c88fdf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.502449 20128 ts_tablet_manager.cc:1434] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.136s	user 0.013s	sys 0.033s
I20260709 12:22:27.467181 20129 raft_consensus.cc:385] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.503623 20128 tablet_bootstrap.cc:492] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:27.503737 20129 raft_consensus.cc:740] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.504706 20129 consensus_queue.cc:260] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:27.509871 20130 tablet_bootstrap.cc:492] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:27.510519 20130 ts_tablet_manager.cc:1403] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.031s
I20260709 12:22:27.513984 20130 raft_consensus.cc:359] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:27.514851 20130 raft_consensus.cc:385] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.514945 20128 tablet_bootstrap.cc:654] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.515244 20130 raft_consensus.cc:740] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.516494 20130 consensus_queue.cc:260] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:27.526216 19851 tablet_service.cc:1511] Processing CreateTablet for tablet 10bb95b2a5614ee7b33bf343c88fdf34 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:27.528333 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10bb95b2a5614ee7b33bf343c88fdf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.528633 19921 tablet_service.cc:1511] Processing CreateTablet for tablet 10bb95b2a5614ee7b33bf343c88fdf34 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:27.530158 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10bb95b2a5614ee7b33bf343c88fdf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.532666 19996 tablet_service.cc:1511] Processing CreateTablet for tablet f18a0228a3d644a5a20f80ded25c4edd (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:27.532851 20068 tablet_service.cc:1511] Processing CreateTablet for tablet f18a0228a3d644a5a20f80ded25c4edd (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:27.534147 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18a0228a3d644a5a20f80ded25c4edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.534147 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18a0228a3d644a5a20f80ded25c4edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.534957 19844 tablet_service.cc:1511] Processing CreateTablet for tablet f18a0228a3d644a5a20f80ded25c4edd (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:27.546363 19844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18a0228a3d644a5a20f80ded25c4edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.537125 19922 tablet_service.cc:1511] Processing CreateTablet for tablet 2956c270268242f88a839bc03d3d5d62 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:27.539366 20109 heartbeater.cc:499] Master 127.11.163.62:41995 was elected leader, sending a full tablet report...
I20260709 12:22:27.539858 20139 raft_consensus.cc:493] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.552772 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2956c270268242f88a839bc03d3d5d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.558602 20127 tablet_bootstrap.cc:654] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.568593 20129 ts_tablet_manager.cc:1434] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.002s
I20260709 12:22:27.569881 20129 tablet_bootstrap.cc:492] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:27.554904 20139 raft_consensus.cc:515] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:27.596180 20000 tablet_service.cc:1511] Processing CreateTablet for tablet 2956c270268242f88a839bc03d3d5d62 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:27.597700 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2956c270268242f88a839bc03d3d5d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.609517 20127 tablet_bootstrap.cc:492] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:27.610375 20127 ts_tablet_manager.cc:1403] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.122s	user 0.019s	sys 0.011s
I20260709 12:22:27.615051 20127 raft_consensus.cc:359] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
W20260709 12:22:27.615648 20036 tablet.cc:2406] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:27.616087 20127 raft_consensus.cc:385] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.616458 20127 raft_consensus.cc:740] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.617369 20127 consensus_queue.cc:260] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:27.622133 20127 ts_tablet_manager.cc:1434] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:22:27.623612 20127 tablet_bootstrap.cc:492] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:27.631659 20139 leader_election.cc:290] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:27.650417 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5cc1a80804da78ba578ecc962897f" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
W20260709 12:22:27.653021 19901 leader_election.cc:343] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.664310 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5cc1a80804da78ba578ecc962897f" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:27.668072 19901 leader_election.cc:343] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.668553 19901 leader_election.cc:304] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:27.669533 20137 raft_consensus.cc:2749] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:27.669314 20074 tablet_service.cc:1511] Processing CreateTablet for tablet 2956c270268242f88a839bc03d3d5d62 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:27.655416 20127 tablet_bootstrap.cc:654] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.671406 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2956c270268242f88a839bc03d3d5d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.670473 20130 ts_tablet_manager.cc:1434] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.160s	user 0.031s	sys 0.045s
I20260709 12:22:27.674522 20133 raft_consensus.cc:493] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.675149 20130 tablet_bootstrap.cc:492] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:27.675133 20133 raft_consensus.cc:515] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:27.685575 20129 tablet_bootstrap.cc:654] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.691368 20133 leader_election.cc:290] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:27.691107 19842 tablet_service.cc:1511] Processing CreateTablet for tablet a8fd600b97cc4962a0c2aa0ea2192e27 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:27.692502 19842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fd600b97cc4962a0c2aa0ea2192e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.697341 19994 tablet_service.cc:1511] Processing CreateTablet for tablet a8fd600b97cc4962a0c2aa0ea2192e27 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:27.698681 19994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fd600b97cc4962a0c2aa0ea2192e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.699793 19921 tablet_service.cc:1511] Processing CreateTablet for tablet a8fd600b97cc4962a0c2aa0ea2192e27 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:27.701601 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fd600b97cc4962a0c2aa0ea2192e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.701782 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 40d5f2bc032946c286131fbde1598003 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:22:27.703086 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d5f2bc032946c286131fbde1598003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.706310 19924 tablet_service.cc:1511] Processing CreateTablet for tablet 40d5f2bc032946c286131fbde1598003 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:22:27.709002 19924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d5f2bc032946c286131fbde1598003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.716499 19844 tablet_service.cc:1511] Processing CreateTablet for tablet 40d5f2bc032946c286131fbde1598003 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:22:27.723564 19844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d5f2bc032946c286131fbde1598003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.724893 20128 tablet_bootstrap.cc:492] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:27.731442 20128 ts_tablet_manager.cc:1403] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.228s	user 0.010s	sys 0.013s
I20260709 12:22:27.722473 20130 tablet_bootstrap.cc:654] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.747560 19996 tablet_service.cc:1511] Processing CreateTablet for tablet bd824adf5e1e4a799b2ed798ae40d3a3 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:27.748939 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd824adf5e1e4a799b2ed798ae40d3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.757057 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
W20260709 12:22:27.767011 20050 leader_election.cc:343] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.769537 20068 tablet_service.cc:1511] Processing CreateTablet for tablet bd824adf5e1e4a799b2ed798ae40d3a3 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:27.771059 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd824adf5e1e4a799b2ed798ae40d3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.793465 20128 raft_consensus.cc:359] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:27.797508 19851 tablet_service.cc:1511] Processing CreateTablet for tablet bd824adf5e1e4a799b2ed798ae40d3a3 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:27.798467 20130 tablet_bootstrap.cc:492] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:27.798869 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd824adf5e1e4a799b2ed798ae40d3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.799013 20130 ts_tablet_manager.cc:1403] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.020s
I20260709 12:22:27.801725 19922 tablet_service.cc:1511] Processing CreateTablet for tablet ce7e36fa79c74c6c9f841770de353a62 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:27.802258 20130 raft_consensus.cc:359] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:27.803066 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7e36fa79c74c6c9f841770de353a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.803035 20130 raft_consensus.cc:385] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.806285 20130 raft_consensus.cc:740] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.794306 20128 raft_consensus.cc:385] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.806476 20133 raft_consensus.cc:493] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.806912 20128 raft_consensus.cc:740] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.807297 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6778cad39436ab0a260f86049592f" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:27.807744 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:27.809043 19975 leader_election.cc:343] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:27.809351 20049 leader_election.cc:343] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.809830 20049 leader_election.cc:304] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:27.810348 20130 consensus_queue.cc:260] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:27.811128 20142 raft_consensus.cc:2749] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:27.807107 20133 raft_consensus.cc:515] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:27.812649 20130 ts_tablet_manager.cc:1434] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 12:22:27.812232 20128 consensus_queue.cc:260] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:27.814525 20128 ts_tablet_manager.cc:1434] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.083s	user 0.003s	sys 0.007s
I20260709 12:22:27.815091 20133 leader_election.cc:290] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:27.815781 20128 tablet_bootstrap.cc:492] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:27.816879 20130 tablet_bootstrap.cc:492] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:27.822750 20128 tablet_bootstrap.cc:654] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.823335 20130 tablet_bootstrap.cc:654] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.828876 20127 tablet_bootstrap.cc:492] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:27.829517 20127 ts_tablet_manager.cc:1403] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.206s	user 0.011s	sys 0.010s
I20260709 12:22:27.833683 20127 raft_consensus.cc:359] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:27.834421 20127 raft_consensus.cc:385] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.834728 20127 raft_consensus.cc:740] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.835577 20127 consensus_queue.cc:260] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:27.837849 20127 ts_tablet_manager.cc:1434] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:27.844529 20000 tablet_service.cc:1511] Processing CreateTablet for tablet ce7e36fa79c74c6c9f841770de353a62 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:27.856441 20068 tablet_service.cc:1511] Processing CreateTablet for tablet ce7e36fa79c74c6c9f841770de353a62 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:27.857853 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7e36fa79c74c6c9f841770de353a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.858011 20127 tablet_bootstrap.cc:492] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:27.857887 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7e36fa79c74c6c9f841770de353a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.864521 20129 tablet_bootstrap.cc:492] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:27.865152 20129 ts_tablet_manager.cc:1403] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.296s	user 0.015s	sys 0.020s
I20260709 12:22:27.874071 19844 tablet_service.cc:1511] Processing CreateTablet for tablet a19aff8bcdbb4bd29e22cb5f7f4cc1e6 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:27.875541 19844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19aff8bcdbb4bd29e22cb5f7f4cc1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.886052 20127 tablet_bootstrap.cc:654] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:27.886266 20129 raft_consensus.cc:359] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:27.889994 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6778cad39436ab0a260f86049592f" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:27.890937 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:27.897145 20133 raft_consensus.cc:493] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.907881 20133 raft_consensus.cc:515] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:27.909467 20000 tablet_service.cc:1511] Processing CreateTablet for tablet a19aff8bcdbb4bd29e22cb5f7f4cc1e6 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:27.910131 20133 leader_election.cc:290] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:27.911080 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19aff8bcdbb4bd29e22cb5f7f4cc1e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:27.912215 19975 leader_election.cc:343] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.912379 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 2b19f486bdbe4ad6ad645409c3a27940 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:27.912737 19975 leader_election.cc:304] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:27.913791 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b19f486bdbe4ad6ad645409c3a27940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.914151 20140 raft_consensus.cc:493] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.914680 20140 raft_consensus.cc:515] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:27.897450 19924 tablet_service.cc:1511] Processing CreateTablet for tablet a19aff8bcdbb4bd29e22cb5f7f4cc1e6 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:27.916193 19924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19aff8bcdbb4bd29e22cb5f7f4cc1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.916524 19919 tablet_service.cc:1511] Processing CreateTablet for tablet 2b19f486bdbe4ad6ad645409c3a27940 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:27.917860 19919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b19f486bdbe4ad6ad645409c3a27940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.921093 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4498a59f91364174bc407d6d3adb80dd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:27.904978 20129 raft_consensus.cc:385] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:27.932145 20129 raft_consensus.cc:740] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:27.935046 19996 tablet_service.cc:1511] Processing CreateTablet for tablet d943a11750804b61969f012e4f945c2d (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
W20260709 12:22:27.935472 19975 leader_election.cc:343] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:27.936240 19975 leader_election.cc:343] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.936501 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d943a11750804b61969f012e4f945c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.912668 19851 tablet_service.cc:1511] Processing CreateTablet for tablet 2b19f486bdbe4ad6ad645409c3a27940 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:27.940032 20068 tablet_service.cc:1511] Processing CreateTablet for tablet d943a11750804b61969f012e4f945c2d (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:22:27.940773 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:27.941443 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d943a11750804b61969f012e4f945c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.943032 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4498a59f91364174bc407d6d3adb80dd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:27.938594 20133 raft_consensus.cc:2749] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:27.947938 20140 leader_election.cc:290] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:27.953339 19994 tablet_service.cc:1511] Processing CreateTablet for tablet 7dee8a7582284ad8a4edbc4d53c02cf2 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:27.953342 19922 tablet_service.cc:1511] Processing CreateTablet for tablet 7dee8a7582284ad8a4edbc4d53c02cf2 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:27.954998 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dee8a7582284ad8a4edbc4d53c02cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.954998 19994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dee8a7582284ad8a4edbc4d53c02cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.953557 19842 tablet_service.cc:1511] Processing CreateTablet for tablet d943a11750804b61969f012e4f945c2d (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:22:27.963063 19842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d943a11750804b61969f012e4f945c2d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:27.967967 19975 leader_election.cc:343] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.968503 19975 leader_election.cc:304] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:27.969311 20133 raft_consensus.cc:2749] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:27.969722 19975 leader_election.cc:343] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.970206 19975 leader_election.cc:304] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:27.972668 20074 tablet_service.cc:1511] Processing CreateTablet for tablet 7dee8a7582284ad8a4edbc4d53c02cf2 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:27.974061 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dee8a7582284ad8a4edbc4d53c02cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.970443 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b19f486bdbe4ad6ad645409c3a27940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.976622 20133 raft_consensus.cc:2749] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:27.984900 19921 tablet_service.cc:1511] Processing CreateTablet for tablet f383be5926e94960a9e3a9481d19e8d9 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:27.986379 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f383be5926e94960a9e3a9481d19e8d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.935060 20129 consensus_queue.cc:260] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:27.988435 20129 ts_tablet_manager.cc:1434] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.123s	user 0.004s	sys 0.005s
I20260709 12:22:27.988966 19993 tablet_service.cc:1511] Processing CreateTablet for tablet f383be5926e94960a9e3a9481d19e8d9 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:27.989495 20129 tablet_bootstrap.cc:492] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:27.990388 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f383be5926e94960a9e3a9481d19e8d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.991549 19844 tablet_service.cc:1511] Processing CreateTablet for tablet f383be5926e94960a9e3a9481d19e8d9 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:27.992893 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552c7773ca94ad597485fb7683e0ec2" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
W20260709 12:22:27.994521 19826 leader_election.cc:343] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:27.992945 19844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f383be5926e94960a9e3a9481d19e8d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:27.997611 20128 tablet_bootstrap.cc:492] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:27.998152 20128 ts_tablet_manager.cc:1403] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.183s	user 0.028s	sys 0.022s
I20260709 12:22:28.001406 20128 raft_consensus.cc:359] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.002146 20128 raft_consensus.cc:385] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.002455 20128 raft_consensus.cc:740] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.008055 20130 tablet_bootstrap.cc:492] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:28.009040 20130 ts_tablet_manager.cc:1403] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.192s	user 0.019s	sys 0.051s
I20260709 12:22:28.009277 19843 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0efb7c87754b739cb88f4e13cb66c6 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:28.010687 19843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0efb7c87754b739cb88f4e13cb66c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.013424 20130 raft_consensus.cc:359] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.014577 20142 raft_consensus.cc:493] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.015122 20142 raft_consensus.cc:515] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.017650 20142 leader_election.cc:290] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:28.020852 20130 raft_consensus.cc:385] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.021294 20130 raft_consensus.cc:740] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.022095 20130 consensus_queue.cc:260] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.022296 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5cc1a80804da78ba578ecc962897f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:28.023932 20049 leader_election.cc:343] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.024497 20130 ts_tablet_manager.cc:1434] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:22:28.007740 20128 consensus_queue.cc:260] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.025642 20130 tablet_bootstrap.cc:492] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:28.032754 20068 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1caa8a675041d28e2eb5045f7e6a4a (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:28.034053 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1caa8a675041d28e2eb5045f7e6a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.032756 19999 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1caa8a675041d28e2eb5045f7e6a4a (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:28.038702 19999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1caa8a675041d28e2eb5045f7e6a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.038923 20128 ts_tablet_manager.cc:1434] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.040s	user 0.002s	sys 0.007s
I20260709 12:22:28.039108 20127 tablet_bootstrap.cc:492] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:28.039839 20127 ts_tablet_manager.cc:1403] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.182s	user 0.008s	sys 0.006s
I20260709 12:22:28.022358 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0efb7c87754b739cb88f4e13cb66c6 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:28.042414 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0efb7c87754b739cb88f4e13cb66c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.056869 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552c7773ca94ad597485fb7683e0ec2" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
W20260709 12:22:28.059413 19827 leader_election.cc:343] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.060181 19827 leader_election.cc:304] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:28.061251 20140 raft_consensus.cc:2749] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:28.064805 19919 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0efb7c87754b739cb88f4e13cb66c6 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:28.094834 19849 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1caa8a675041d28e2eb5045f7e6a4a (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:28.095366 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5cc1a80804da78ba578ecc962897f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:28.096130 19935 raft_consensus.cc:2468] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:28.096493 19849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1caa8a675041d28e2eb5045f7e6a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.099035 20049 leader_election.cc:304] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:28.100157 20142 raft_consensus.cc:2804] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:28.100548 20142 raft_consensus.cc:493] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.100889 20142 raft_consensus.cc:3060] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.101001 19919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0efb7c87754b739cb88f4e13cb66c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.111356 19920 tablet_service.cc:1511] Processing CreateTablet for tablet 240e5e8e04aa4ce2bbff8d21eb78a76c (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:22:28.112927 19920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240e5e8e04aa4ce2bbff8d21eb78a76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.113355 19997 tablet_service.cc:1511] Processing CreateTablet for tablet 240e5e8e04aa4ce2bbff8d21eb78a76c (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:22:28.114660 19997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240e5e8e04aa4ce2bbff8d21eb78a76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.118834 20129 tablet_bootstrap.cc:654] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.120064 20070 tablet_service.cc:1511] Processing CreateTablet for tablet 240e5e8e04aa4ce2bbff8d21eb78a76c (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:22:28.121447 20070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240e5e8e04aa4ce2bbff8d21eb78a76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.108561 20142 raft_consensus.cc:515] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.127022 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5cc1a80804da78ba578ecc962897f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
W20260709 12:22:28.128643 20049 leader_election.cc:343] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.141774 19842 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3835bda54b4d75a4985b5f514743a4 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:28.143265 19842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3835bda54b4d75a4985b5f514743a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.148658 19921 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3835bda54b4d75a4985b5f514743a4 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:28.150633 20140 raft_consensus.cc:493] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.151404 20140 raft_consensus.cc:515] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:28.158514 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
W20260709 12:22:28.164892 19827 leader_election.cc:343] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.160408 20140 leader_election.cc:290] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:28.167013 20137 raft_consensus.cc:493] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.167773 20137 raft_consensus.cc:515] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:28.169745 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:28.170485 19935 raft_consensus.cc:2468] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:28.171185 20137 leader_election.cc:290] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:28.172053 19826 leader_election.cc:304] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:28.173395 20140 raft_consensus.cc:2804] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:28.173581 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:28.173923 20140 raft_consensus.cc:493] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.161432 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3835bda54b4d75a4985b5f514743a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.174450 20140 raft_consensus.cc:3060] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.181419 20127 raft_consensus.cc:359] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.182204 20127 raft_consensus.cc:385] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.182480 20127 raft_consensus.cc:740] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
W20260709 12:22:28.192333 19806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:28.185150 20128 tablet_bootstrap.cc:492] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:28.195587 20000 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3835bda54b4d75a4985b5f514743a4 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:28.196986 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3835bda54b4d75a4985b5f514743a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.184248 20142 leader_election.cc:290] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:28.185266 20130 tablet_bootstrap.cc:654] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.183266 20127 consensus_queue.cc:260] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.202498 20128 tablet_bootstrap.cc:654] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.206337 19851 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1d3bf6702e45d280388eaf43d70e74 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:22:28.214030 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1d3bf6702e45d280388eaf43d70e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.214116 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d5cc1a80804da78ba578ecc962897f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:28.214324 19922 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1d3bf6702e45d280388eaf43d70e74 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:22:28.214787 19935 raft_consensus.cc:3060] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.215919 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1d3bf6702e45d280388eaf43d70e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.209635 20129 tablet_bootstrap.cc:492] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:28.220786 20129 ts_tablet_manager.cc:1403] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.231s	user 0.020s	sys 0.032s
I20260709 12:22:28.222664 19935 raft_consensus.cc:2468] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:28.224200 20129 raft_consensus.cc:359] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.224982 20129 raft_consensus.cc:385] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.225287 20129 raft_consensus.cc:740] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.226269 19999 tablet_service.cc:1511] Processing CreateTablet for tablet 551cd77f8f81497eaf0336d9004c56cd (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:22:28.227675 19999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 551cd77f8f81497eaf0336d9004c56cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.228719 20130 tablet_bootstrap.cc:492] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:28.229205 20130 ts_tablet_manager.cc:1403] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.204s	user 0.008s	sys 0.010s
I20260709 12:22:28.211218 20140 raft_consensus.cc:515] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:28.235414 19860 raft_consensus.cc:2393] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
I20260709 12:22:28.235492 20049 leader_election.cc:304] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:28.236523 20142 raft_consensus.cc:2804] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:28.212456 20070 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1d3bf6702e45d280388eaf43d70e74 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:22:28.240020 20070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1d3bf6702e45d280388eaf43d70e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.239701 20074 tablet_service.cc:1511] Processing CreateTablet for tablet 551cd77f8f81497eaf0336d9004c56cd (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:22:28.241688 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 551cd77f8f81497eaf0336d9004c56cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.244052 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:28.244451 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:28.246701 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
W20260709 12:22:28.248114 19827 leader_election.cc:343] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:28.248574 19902 leader_election.cc:343] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.249048 19902 leader_election.cc:304] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:28.244740 19935 raft_consensus.cc:3060] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.222688 20127 ts_tablet_manager.cc:1434] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.182s	user 0.011s	sys 0.002s
I20260709 12:22:28.251355 20129 consensus_queue.cc:260] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.257332 19935 raft_consensus.cc:2468] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:28.257965 20137 raft_consensus.cc:2749] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:28.259057 19826 leader_election.cc:304] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:28.260676 20127 tablet_bootstrap.cc:492] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:28.251590 20140 leader_election.cc:290] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:28.239753 20130 raft_consensus.cc:359] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.268270 20140 raft_consensus.cc:2804] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:28.268520 20130 raft_consensus.cc:385] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.268889 20140 raft_consensus.cc:697] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:28.269052 20130 raft_consensus.cc:740] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.269871 20140 consensus_queue.cc:237] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:28.270287 20130 consensus_queue.cc:260] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.272998 20142 raft_consensus.cc:697] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:28.273995 20142 consensus_queue.cc:237] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.279749 20129 ts_tablet_manager.cc:1434] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.009s
I20260709 12:22:28.280230 19842 tablet_service.cc:1511] Processing CreateTablet for tablet 551cd77f8f81497eaf0336d9004c56cd (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:22:28.280622 19996 tablet_service.cc:1511] Processing CreateTablet for tablet 096a550b72b246c3b15fd4b627f51174 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:28.281220 19921 tablet_service.cc:1511] Processing CreateTablet for tablet 096a550b72b246c3b15fd4b627f51174 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:28.281752 20129 tablet_bootstrap.cc:492] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:28.282001 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096a550b72b246c3b15fd4b627f51174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.282529 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096a550b72b246c3b15fd4b627f51174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.281818 19842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 551cd77f8f81497eaf0336d9004c56cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.290984 20128 tablet_bootstrap.cc:492] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:28.291610 20128 ts_tablet_manager.cc:1403] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.013s
I20260709 12:22:28.293659 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 096a550b72b246c3b15fd4b627f51174 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:28.295006 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096a550b72b246c3b15fd4b627f51174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.291414 20129 tablet_bootstrap.cc:654] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.296505 19843 tablet_service.cc:1511] Processing CreateTablet for tablet b16c8dbaaffb4ff58286d705232636e3 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:28.299568 19843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16c8dbaaffb4ff58286d705232636e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.303923 19919 tablet_service.cc:1511] Processing CreateTablet for tablet b16c8dbaaffb4ff58286d705232636e3 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:28.305328 19919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16c8dbaaffb4ff58286d705232636e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.321601 20128 raft_consensus.cc:359] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.322774 20128 raft_consensus.cc:385] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.333110 20127 tablet_bootstrap.cc:654] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.323251 20128 raft_consensus.cc:740] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.352721 19993 tablet_service.cc:1511] Processing CreateTablet for tablet b16c8dbaaffb4ff58286d705232636e3 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:28.354827 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16c8dbaaffb4ff58286d705232636e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.368136 20166 raft_consensus.cc:493] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.368875 20166 raft_consensus.cc:515] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.385854 19755 catalog_manager.cc:5697] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:28.388608 20068 tablet_service.cc:1511] Processing CreateTablet for tablet 78284f7a2a9440b5a5d708cd128f3b04 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:28.389925 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78284f7a2a9440b5a5d708cd128f3b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.390630 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
W20260709 12:22:28.392231 19826 leader_election.cc:343] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.394271 20166 leader_election.cc:290] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:28.394721 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:28.395478 19935 raft_consensus.cc:2468] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:28.397445 20129 tablet_bootstrap.cc:492] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:28.398001 20129 ts_tablet_manager.cc:1403] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.116s	user 0.026s	sys 0.035s
I20260709 12:22:28.397315 19826 leader_election.cc:304] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:28.399883 20140 raft_consensus.cc:2804] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:28.400271 20140 raft_consensus.cc:493] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.400640 20140 raft_consensus.cc:3060] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.401580 20129 raft_consensus.cc:359] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.402357 20129 raft_consensus.cc:385] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.402637 20129 raft_consensus.cc:740] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.403378 20129 consensus_queue.cc:260] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.405429 20129 ts_tablet_manager.cc:1434] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:28.406492 20129 tablet_bootstrap.cc:492] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:28.407625 20128 consensus_queue.cc:260] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.409914 19756 catalog_manager.cc:5697] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:28.417412 20128 ts_tablet_manager.cc:1434] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.125s	user 0.010s	sys 0.005s
I20260709 12:22:28.419416 20130 ts_tablet_manager.cc:1434] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.190s	user 0.011s	sys 0.007s
I20260709 12:22:28.420593 20130 tablet_bootstrap.cc:492] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:28.434526 20142 raft_consensus.cc:493] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.435948 20142 raft_consensus.cc:515] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.438920 20142 leader_election.cc:290] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:28.440861 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552c7773ca94ad597485fb7683e0ec2" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
W20260709 12:22:28.442473 20050 leader_election.cc:343] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.445943 20137 raft_consensus.cc:493] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.446587 20130 tablet_bootstrap.cc:654] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.446519 20137 raft_consensus.cc:515] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.449035 20142 raft_consensus.cc:493] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.449548 20142 raft_consensus.cc:515] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.449997 20137 leader_election.cc:290] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:28.451579 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:28.451752 20142 leader_election.cc:290] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:28.452234 20010 raft_consensus.cc:2468] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:28.453572 20127 tablet_bootstrap.cc:492] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:28.453629 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4498a59f91364174bc407d6d3adb80dd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:28.454169 20127 ts_tablet_manager.cc:1403] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.194s	user 0.012s	sys 0.023s
I20260709 12:22:28.454463 20140 raft_consensus.cc:515] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.454308 19902 leader_election.cc:304] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
W20260709 12:22:28.456225 20049 leader_election.cc:343] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.454771 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4498a59f91364174bc407d6d3adb80dd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:28.456282 20137 raft_consensus.cc:2804] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:28.457038 20010 raft_consensus.cc:2468] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:28.457132 20137 raft_consensus.cc:493] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.457639 20137 raft_consensus.cc:3060] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.457501 20127 raft_consensus.cc:359] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:28.458271 20127 raft_consensus.cc:385] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.458246 20050 leader_election.cc:304] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:28.458850 20127 raft_consensus.cc:740] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.459573 20128 tablet_bootstrap.cc:492] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:28.459815 20142 raft_consensus.cc:2804] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:28.460358 20142 raft_consensus.cc:493] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.459836 20127 consensus_queue.cc:260] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:28.460714 20142 raft_consensus.cc:3060] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.464303 20129 tablet_bootstrap.cc:654] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.465334 20127 ts_tablet_manager.cc:1434] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 12:22:28.466531 20127 tablet_bootstrap.cc:492] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:28.467669 20137 raft_consensus.cc:515] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.468417 20142 raft_consensus.cc:515] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.470157 20140 leader_election.cc:290] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:28.470257 20137 leader_election.cc:290] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:28.471402 20142 leader_election.cc:290] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:28.474339 20128 tablet_bootstrap.cc:654] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.507359 20127 tablet_bootstrap.cc:654] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.509109 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4498a59f91364174bc407d6d3adb80dd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:28.509472 19921 tablet_service.cc:1511] Processing CreateTablet for tablet 78284f7a2a9440b5a5d708cd128f3b04 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:28.510725 20010 raft_consensus.cc:3060] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.511492 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:28.512370 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:28.508888 19843 tablet_service.cc:1511] Processing CreateTablet for tablet 78284f7a2a9440b5a5d708cd128f3b04 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:28.516898 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552c7773ca94ad597485fb7683e0ec2" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:28.517172 19901 leader_election.cc:343] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.518169 19859 raft_consensus.cc:2468] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:28.519994 19935 raft_consensus.cc:3060] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.520699 20049 leader_election.cc:304] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:28.521086 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:28.522298 20009 raft_consensus.cc:3060] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.529400 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4498a59f91364174bc407d6d3adb80dd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:28.530601 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78284f7a2a9440b5a5d708cd128f3b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.540292 20129 tablet_bootstrap.cc:492] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:28.541420 20129 ts_tablet_manager.cc:1403] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.003s
I20260709 12:22:28.543579 20140 raft_consensus.cc:493] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.544440 20140 raft_consensus.cc:515] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.547863 20129 raft_consensus.cc:359] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.548877 20129 raft_consensus.cc:385] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.549073 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:28.549289 20129 raft_consensus.cc:740] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.550513 20129 consensus_queue.cc:260] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.551476 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:28.552948 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 0e6b3c311ea54efba7ed246f0ccd9c2e (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:28.555004 20129 ts_tablet_manager.cc:1434] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 12:22:28.555106 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6b3c311ea54efba7ed246f0ccd9c2e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:28.556174 19826 leader_election.cc:343] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:28.557464 19827 leader_election.cc:343] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.559664 20142 raft_consensus.cc:2804] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:28.560192 20142 raft_consensus.cc:493] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.560545 20142 raft_consensus.cc:3060] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.561872 19919 tablet_service.cc:1511] Processing CreateTablet for tablet 52d17d263a1240d09b5735c7adad3e3c (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:28.556089 20130 tablet_bootstrap.cc:492] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:28.563375 20130 ts_tablet_manager.cc:1403] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.001s
I20260709 12:22:28.564695 19851 tablet_service.cc:1511] Processing CreateTablet for tablet 0e6b3c311ea54efba7ed246f0ccd9c2e (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:28.566722 19996 tablet_service.cc:1511] Processing CreateTablet for tablet 52d17d263a1240d09b5735c7adad3e3c (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:28.568591 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d17d263a1240d09b5735c7adad3e3c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:28.570191 20049 leader_election.cc:343] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.571270 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:28.572043 19919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d17d263a1240d09b5735c7adad3e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.574663 19849 tablet_service.cc:1511] Processing CreateTablet for tablet 6deec39d0e7447fe9d7802f05466f079 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:28.575160 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:28.571784 20068 tablet_service.cc:1511] Processing CreateTablet for tablet 52d17d263a1240d09b5735c7adad3e3c (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:28.577072 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d17d263a1240d09b5735c7adad3e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.562325 19935 raft_consensus.cc:2468] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
W20260709 12:22:28.573675 19901 leader_election.cc:343] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.578521 20084 raft_consensus.cc:2468] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:28.574101 19843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78284f7a2a9440b5a5d708cd128f3b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.579669 19826 leader_election.cc:304] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:28.580216 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6b3c311ea54efba7ed246f0ccd9c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.581704 20169 raft_consensus.cc:2804] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:28.582366 20169 raft_consensus.cc:697] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:28.583843 19849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6deec39d0e7447fe9d7802f05466f079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.583856 20169 consensus_queue.cc:237] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.572636 20140 leader_election.cc:290] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:28.589566 19826 leader_election.cc:304] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:28.590458 20140 raft_consensus.cc:2804] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:28.591130 20140 raft_consensus.cc:493] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.592262 20140 raft_consensus.cc:3060] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.595122 20130 raft_consensus.cc:359] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.596304 19993 tablet_service.cc:1511] Processing CreateTablet for tablet 0e6b3c311ea54efba7ed246f0ccd9c2e (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:28.597766 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6b3c311ea54efba7ed246f0ccd9c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.597937 20010 raft_consensus.cc:2468] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:28.595960 20130 raft_consensus.cc:385] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.599536 20050 leader_election.cc:304] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:28.599923 20130 raft_consensus.cc:740] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.601184 20165 raft_consensus.cc:2804] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:28.601768 20165 raft_consensus.cc:697] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:28.602782 20165 consensus_queue.cc:237] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.602957 20130 consensus_queue.cc:260] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.607710 20127 tablet_bootstrap.cc:492] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:28.608152 20129 tablet_bootstrap.cc:492] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:28.608446 20127 ts_tablet_manager.cc:1403] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.142s	user 0.012s	sys 0.005s
I20260709 12:22:28.608536 19921 tablet_service.cc:1511] Processing CreateTablet for tablet 6deec39d0e7447fe9d7802f05466f079 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:28.609438 19999 tablet_service.cc:1511] Processing CreateTablet for tablet 6deec39d0e7447fe9d7802f05466f079 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:28.610948 19999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6deec39d0e7447fe9d7802f05466f079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.612663 20127 raft_consensus.cc:359] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.613564 20127 raft_consensus.cc:385] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.613888 20127 raft_consensus.cc:740] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.609951 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6deec39d0e7447fe9d7802f05466f079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.624037 20128 tablet_bootstrap.cc:492] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:28.624936 20128 ts_tablet_manager.cc:1403] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.177s	user 0.019s	sys 0.012s
I20260709 12:22:28.629446 20130 ts_tablet_manager.cc:1434] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 12:22:28.631023 20130 tablet_bootstrap.cc:492] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:28.631542 20009 raft_consensus.cc:2468] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:28.634753 19902 leader_election.cc:304] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:28.636415 20137 raft_consensus.cc:2804] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:28.644490 20127 consensus_queue.cc:260] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.653033 20133 raft_consensus.cc:493] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.653740 20133 raft_consensus.cc:515] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.655596 20127 ts_tablet_manager.cc:1434] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:22:28.657080 20127 tablet_bootstrap.cc:492] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:28.657542 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26bba3e147042a9bc03b848a9e13780" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:28.658489 20140 raft_consensus.cc:515] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.651307 20129 tablet_bootstrap.cc:654] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:28.659507 19975 leader_election.cc:343] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.660791 20133 leader_election.cc:290] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:28.662885 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26bba3e147042a9bc03b848a9e13780" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:28.664574 20084 raft_consensus.cc:2468] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:28.665190 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:28.665942 20083 raft_consensus.cc:3060] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.666231 19975 leader_election.cc:304] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:28.663802 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:28.668337 20140 leader_election.cc:290] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:28.677642 20009 raft_consensus.cc:3060] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.686319 19860 raft_consensus.cc:3060] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.675911 20133 raft_consensus.cc:2804] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:28.691802 20133 raft_consensus.cc:493] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.692191 20133 raft_consensus.cc:3060] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.696568 20164 consensus_queue.cc:1048] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:28.700058 20142 raft_consensus.cc:515] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.701197 19842 tablet_service.cc:1511] Processing CreateTablet for tablet 22ae825dd7c04568bd5e70cd1433e282 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:28.702601 19842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ae825dd7c04568bd5e70cd1433e282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.703048 20142 leader_election.cc:290] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:28.706252 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552c7773ca94ad597485fb7683e0ec2" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:28.707108 19861 raft_consensus.cc:3060] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.712067 20137 raft_consensus.cc:697] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:28.712675 20083 raft_consensus.cc:2468] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:28.713392 20137 consensus_queue.cc:237] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.713718 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 22ae825dd7c04568bd5e70cd1433e282 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:28.714103 19826 leader_election.cc:304] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:28.715240 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ae825dd7c04568bd5e70cd1433e282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.715358 20140 raft_consensus.cc:2804] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:28.716073 20140 raft_consensus.cc:697] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:28.642076 20128 raft_consensus.cc:359] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.740687 19919 tablet_service.cc:1511] Processing CreateTablet for tablet 22ae825dd7c04568bd5e70cd1433e282 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:28.742334 19919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ae825dd7c04568bd5e70cd1433e282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.743366 19861 raft_consensus.cc:2468] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:28.735636 20128 raft_consensus.cc:385] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.744570 20128 raft_consensus.cc:740] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.744843 20049 leader_election.cc:304] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:28.745373 20128 consensus_queue.cc:260] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.745736 20165 raft_consensus.cc:2804] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:28.728715 20140 consensus_queue.cc:237] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.746577 20165 raft_consensus.cc:697] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:28.746860 20129 tablet_bootstrap.cc:492] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:28.747496 20129 ts_tablet_manager.cc:1403] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.188s	user 0.022s	sys 0.006s
I20260709 12:22:28.748214 20165 consensus_queue.cc:237] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:28.772394 19999 tablet_service.cc:1511] Processing CreateTablet for tablet f7b3985b4c004f27b2636195c5870246 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:28.772815 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552c7773ca94ad597485fb7683e0ec2" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:28.773885 19999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b3985b4c004f27b2636195c5870246. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:28.774441 20050 leader_election.cc:343] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.774618 20068 tablet_service.cc:1511] Processing CreateTablet for tablet f7b3985b4c004f27b2636195c5870246 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:28.777590 19843 tablet_service.cc:1511] Processing CreateTablet for tablet f7b3985b4c004f27b2636195c5870246 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:28.778026 19921 tablet_service.cc:1511] Processing CreateTablet for tablet 3237b68a928849c2b369e32505a6e4a8 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:22:28.778977 19843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b3985b4c004f27b2636195c5870246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.779343 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3237b68a928849c2b369e32505a6e4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.780563 20009 raft_consensus.cc:2468] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:28.782809 20130 tablet_bootstrap.cc:654] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.783890 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b3985b4c004f27b2636195c5870246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.789013 20133 raft_consensus.cc:515] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.791145 20133 leader_election.cc:290] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:28.778379 20127 tablet_bootstrap.cc:654] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.797969 19993 tablet_service.cc:1511] Processing CreateTablet for tablet 3237b68a928849c2b369e32505a6e4a8 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 12:22:28.729555 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:45345, user_credentials={real_user=slave}} blocked reactor thread for 63135.5us
I20260709 12:22:28.812199 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3237b68a928849c2b369e32505a6e4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.815012 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26bba3e147042a9bc03b848a9e13780" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:28.815765 20009 raft_consensus.cc:3060] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.815807 20083 raft_consensus.cc:3060] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.816206 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26bba3e147042a9bc03b848a9e13780" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:28.821156 20000 tablet_service.cc:1511] Processing CreateTablet for tablet e6f762ace6474e3d8514494a97777505 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:28.822607 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f762ace6474e3d8514494a97777505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.822402 19849 tablet_service.cc:1511] Processing CreateTablet for tablet e6f762ace6474e3d8514494a97777505 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:28.829018 20070 tablet_service.cc:1511] Processing CreateTablet for tablet 3237b68a928849c2b369e32505a6e4a8 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 12:22:28.828955 19975 leader_election.cc:343] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:28.838773 19849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f762ace6474e3d8514494a97777505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.838485 19922 tablet_service.cc:1511] Processing CreateTablet for tablet e6f762ace6474e3d8514494a97777505 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:28.839063 20070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3237b68a928849c2b369e32505a6e4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.840018 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f762ace6474e3d8514494a97777505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.842725 20140 consensus_queue.cc:1048] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:28.828316 20083 raft_consensus.cc:2468] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:28.857622 20074 tablet_service.cc:1511] Processing CreateTablet for tablet 0301806b41464a5b8e873701b04451df (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:28.859088 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0301806b41464a5b8e873701b04451df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.871908 19851 tablet_service.cc:1511] Processing CreateTablet for tablet 0301806b41464a5b8e873701b04451df (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:28.873468 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0301806b41464a5b8e873701b04451df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.876499 19975 leader_election.cc:304] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:28.876698 20129 raft_consensus.cc:359] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.877556 20129 raft_consensus.cc:385] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.877863 20129 raft_consensus.cc:740] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.879791 19920 tablet_service.cc:1511] Processing CreateTablet for tablet 0301806b41464a5b8e873701b04451df (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:28.881502 20133 raft_consensus.cc:2804] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:28.884109 20128 ts_tablet_manager.cc:1434] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.259s	user 0.009s	sys 0.010s
I20260709 12:22:28.884254 20133 raft_consensus.cc:697] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:28.885757 20128 tablet_bootstrap.cc:492] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:28.886036 20133 consensus_queue.cc:237] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:28.887110 19996 tablet_service.cc:1511] Processing CreateTablet for tablet cf3cb77b38fa4d559fd0dbf6852f150d (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:28.889801 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf3cb77b38fa4d559fd0dbf6852f150d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.890182 19758 catalog_manager.cc:5697] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 0 to 1, leader changed from <none> to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 1 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:28.895041 20165 consensus_queue.cc:1048] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:28.897362 20071 tablet_service.cc:1511] Processing CreateTablet for tablet cf3cb77b38fa4d559fd0dbf6852f150d (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:28.898844 20071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf3cb77b38fa4d559fd0dbf6852f150d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.888399 19920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0301806b41464a5b8e873701b04451df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.924162 20183 raft_consensus.cc:493] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.924804 20183 raft_consensus.cc:515] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:28.930547 19921 tablet_service.cc:1511] Processing CreateTablet for tablet 8acee3c287d24c97ad0f5fcea4bbcaa9 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:22:28.931869 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acee3c287d24c97ad0f5fcea4bbcaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.931643 19843 tablet_service.cc:1511] Processing CreateTablet for tablet cf3cb77b38fa4d559fd0dbf6852f150d (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:28.932950 19843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf3cb77b38fa4d559fd0dbf6852f150d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.906553 20129 consensus_queue.cc:260] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:28.952715 20130 tablet_bootstrap.cc:492] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:28.953330 20130 ts_tablet_manager.cc:1403] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.323s	user 0.012s	sys 0.009s
I20260709 12:22:28.961261 20127 tablet_bootstrap.cc:492] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:28.962046 20127 ts_tablet_manager.cc:1403] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.305s	user 0.017s	sys 0.007s
I20260709 12:22:28.969671 20130 raft_consensus.cc:359] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:28.970484 20130 raft_consensus.cc:385] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.970754 20130 raft_consensus.cc:740] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.971740 20130 consensus_queue.cc:260] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:28.974395 20130 ts_tablet_manager.cc:1434] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 12:22:28.979612 20183 leader_election.cc:290] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:28.981802 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:28.986687 19996 tablet_service.cc:1511] Processing CreateTablet for tablet 8acee3c287d24c97ad0f5fcea4bbcaa9 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:22:28.988507 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acee3c287d24c97ad0f5fcea4bbcaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.003494 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:29.005731 20142 raft_consensus.cc:493] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.006076 20127 raft_consensus.cc:359] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:29.007603 20127 raft_consensus.cc:385] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.006448 20142 raft_consensus.cc:515] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.009335 19975 leader_election.cc:304] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:29.012557 20183 raft_consensus.cc:2749] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:29.013291 20193 log.cc:927] Time spent T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:22:29.013962 20142 leader_election.cc:290] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:29.013739 20140 consensus_queue.cc:1048] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:29.014114 20068 tablet_service.cc:1511] Processing CreateTablet for tablet 8acee3c287d24c97ad0f5fcea4bbcaa9 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:22:29.015947 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acee3c287d24c97ad0f5fcea4bbcaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.016568 19843 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce5ba2a49a949ec95fb5e6a9627f1f7 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:29.018091 19843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce5ba2a49a949ec95fb5e6a9627f1f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.018828 20129 ts_tablet_manager.cc:1434] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.271s	user 0.006s	sys 0.004s
I20260709 12:22:29.020147 20129 tablet_bootstrap.cc:492] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:29.020339 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:29.023243 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:29.024217 19933 raft_consensus.cc:2393] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eafc6cb9dfb7468581367b29682ec024 in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
W20260709 12:22:29.028468 20049 consensus_peers.cc:597] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:29.029253 20049 leader_election.cc:304] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:29.009570 20127 raft_consensus.cc:740] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.012166 20130 tablet_bootstrap.cc:492] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:29.038554 19922 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce5ba2a49a949ec95fb5e6a9627f1f7 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:29.040017 20142 raft_consensus.cc:3060] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.054879 19996 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce5ba2a49a949ec95fb5e6a9627f1f7 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:29.056310 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce5ba2a49a949ec95fb5e6a9627f1f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.049809 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce5ba2a49a949ec95fb5e6a9627f1f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.067984 20127 consensus_queue.cc:260] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:29.070672 20127 ts_tablet_manager.cc:1434] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.108s	user 0.005s	sys 0.004s
I20260709 12:22:29.072767 20127 tablet_bootstrap.cc:492] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:29.082516 20142 raft_consensus.cc:2749] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:29.089576 20130 tablet_bootstrap.cc:654] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.109562 19843 tablet_service.cc:1511] Processing CreateTablet for tablet 98432926ed9c4d049f84b4d657eb940f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:29.110967 20129 tablet_bootstrap.cc:654] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.112576 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 98432926ed9c4d049f84b4d657eb940f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:29.113852 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98432926ed9c4d049f84b4d657eb940f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.110966 19843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98432926ed9c4d049f84b4d657eb940f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.142676 20000 tablet_service.cc:1511] Processing CreateTablet for tablet 52fa7ab6ac204f20991d64236150e97f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:29.143848 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fa7ab6ac204f20991d64236150e97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.147323 19921 tablet_service.cc:1511] Processing CreateTablet for tablet 98432926ed9c4d049f84b4d657eb940f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:29.148651 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98432926ed9c4d049f84b4d657eb940f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.174276 20166 consensus_queue.cc:1048] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:29.175560 20128 tablet_bootstrap.cc:654] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.178138 20133 raft_consensus.cc:493] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.178736 20133 raft_consensus.cc:515] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:29.180991 20133 leader_election.cc:290] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:29.180899 20070 tablet_service.cc:1511] Processing CreateTablet for tablet 52fa7ab6ac204f20991d64236150e97f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:29.182477 20070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fa7ab6ac204f20991d64236150e97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.183132 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
W20260709 12:22:29.185619 19975 leader_election.cc:343] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:29.186841 20050 consensus_peers.cc:597] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 -> Peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Couldn't send request to peer 86ad94e539f24675ba7226e7371cec9b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:29.190367 20127 tablet_bootstrap.cc:654] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.190478 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:29.192123 19975 leader_election.cc:343] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.192631 19975 leader_election.cc:304] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:29.194207 19757 catalog_manager.cc:5697] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.197423 20137 raft_consensus.cc:493] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.198141 20137 raft_consensus.cc:515] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.198436 19757 catalog_manager.cc:5697] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.200570 20142 consensus_queue.cc:1048] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:22:29.212669 19843 tablet_service.cc:1511] Processing CreateTablet for tablet 52fa7ab6ac204f20991d64236150e97f (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:29.214464 19843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fa7ab6ac204f20991d64236150e97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.201701 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f153ead7b64c4983b271c2c190b7d2fc" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:29.201787 20137 leader_election.cc:290] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:29.203604 20133 raft_consensus.cc:2749] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:29.199404 19806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:29.227237 20000 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0a72abd201421e9bde4dcd6e8a3d43 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:22:29.240294 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0a72abd201421e9bde4dcd6e8a3d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.242828 19851 tablet_service.cc:1511] Processing CreateTablet for tablet aa5fc07ed3b34983a19659aac8863a06 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:29.244222 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa5fc07ed3b34983a19659aac8863a06. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:29.244570 19901 leader_election.cc:343] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.238473 20140 raft_consensus.cc:493] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.246883 20074 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0a72abd201421e9bde4dcd6e8a3d43 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:22:29.247987 19993 tablet_service.cc:1511] Processing CreateTablet for tablet 39f4a78b032347e688bf751ec532d805 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:29.248804 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0a72abd201421e9bde4dcd6e8a3d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.249275 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f4a78b032347e688bf751ec532d805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.252246 19849 tablet_service.cc:1511] Processing CreateTablet for tablet f67375288ddd4f70b9d2b85894e64783 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:29.252907 20070 tablet_service.cc:1511] Processing CreateTablet for tablet f67375288ddd4f70b9d2b85894e64783 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:29.254043 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f153ead7b64c4983b271c2c190b7d2fc" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:29.254839 19842 tablet_service.cc:1511] Processing CreateTablet for tablet 39f4a78b032347e688bf751ec532d805 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:29.255266 20140 raft_consensus.cc:515] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:29.256162 20169 consensus_queue.cc:1048] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:29.256101 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 39f4a78b032347e688bf751ec532d805 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:29.257763 20140 leader_election.cc:290] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:29.231521 20166 consensus_queue.cc:1048] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:29.259840 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3b7cf591de4141825ccc578837bdb3" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:29.232963 20181 consensus_queue.cc:1048] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:29.253585 19849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67375288ddd4f70b9d2b85894e64783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.234287 19996 tablet_service.cc:1511] Processing CreateTablet for tablet aa5fc07ed3b34983a19659aac8863a06 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:29.260187 19921 tablet_service.cc:1511] Processing CreateTablet for tablet aa5fc07ed3b34983a19659aac8863a06 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:29.202090 19920 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0a72abd201421e9bde4dcd6e8a3d43 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:22:29.264495 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa5fc07ed3b34983a19659aac8863a06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.264495 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa5fc07ed3b34983a19659aac8863a06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.254850 20070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67375288ddd4f70b9d2b85894e64783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.270589 20128 tablet_bootstrap.cc:492] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:29.271549 19999 tablet_service.cc:1511] Processing CreateTablet for tablet f157aabf5bdd4201a3677151f9ccc1de (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:29.271718 19922 tablet_service.cc:1511] Processing CreateTablet for tablet f67375288ddd4f70b9d2b85894e64783 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:29.279757 20129 tablet_bootstrap.cc:492] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:29.280085 20130 tablet_bootstrap.cc:492] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:29.292621 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f4a78b032347e688bf751ec532d805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.301362 19919 tablet_service.cc:1511] Processing CreateTablet for tablet f157aabf5bdd4201a3677151f9ccc1de (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:29.296983 19920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0a72abd201421e9bde4dcd6e8a3d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.308369 19999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f157aabf5bdd4201a3677151f9ccc1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.294126 19842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f4a78b032347e688bf751ec532d805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.321858 19756 catalog_manager.cc:5697] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.294279 20130 ts_tablet_manager.cc:1403] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.282s	user 0.007s	sys 0.016s
I20260709 12:22:29.290683 20128 ts_tablet_manager.cc:1403] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.404s	user 0.019s	sys 0.012s
I20260709 12:22:29.326432 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67375288ddd4f70b9d2b85894e64783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.349831 19919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f157aabf5bdd4201a3677151f9ccc1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.334052 19997 tablet_service.cc:1511] Processing CreateTablet for tablet ebcd105158424342b29d433430a26086 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:29.336177 19844 tablet_service.cc:1511] Processing CreateTablet for tablet ebcd105158424342b29d433430a26086 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:29.351131 19997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebcd105158424342b29d433430a26086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.351284 19844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebcd105158424342b29d433430a26086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.294916 20129 ts_tablet_manager.cc:1403] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.275s	user 0.023s	sys 0.040s
W20260709 12:22:29.338148 19826 leader_election.cc:343] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.338055 19756 catalog_manager.cc:5697] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:29.357815 19901 consensus_peers.cc:597] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:29.338362 20074 tablet_service.cc:1511] Processing CreateTablet for tablet f157aabf5bdd4201a3677151f9ccc1de (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:29.359098 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f157aabf5bdd4201a3677151f9ccc1de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:29.339339 19975 consensus_peers.cc:597] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:29.284435 20142 consensus_queue.cc:1048] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.056s
I20260709 12:22:29.341130 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3b7cf591de4141825ccc578837bdb3" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:29.341427 20130 raft_consensus.cc:359] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:29.368983 20130 raft_consensus.cc:385] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.369385 20130 raft_consensus.cc:740] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.370332 20130 consensus_queue.cc:260] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
W20260709 12:22:29.345680 19902 leader_election.cc:343] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.338002 20166 consensus_queue.cc:1048] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:29.383041 20130 ts_tablet_manager.cc:1434] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.059s	user 0.003s	sys 0.004s
I20260709 12:22:29.402853 20127 tablet_bootstrap.cc:492] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:29.403447 20127 ts_tablet_manager.cc:1403] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.331s	user 0.027s	sys 0.018s
I20260709 12:22:29.388468 20129 raft_consensus.cc:359] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.405640 20129 raft_consensus.cc:385] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.405951 20129 raft_consensus.cc:740] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.389883 19902 leader_election.cc:304] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024
W20260709 12:22:29.423275 19902 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 77657.5us
I20260709 12:22:29.424211 20181 raft_consensus.cc:2749] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:29.406638 20129 consensus_queue.cc:260] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.437661 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 43b2d93090d64da389b15b3b5b736ae2 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:29.439121 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b2d93090d64da389b15b3b5b736ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.449301 20130 tablet_bootstrap.cc:492] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
W20260709 12:22:29.435098 19827 leader_election.cc:343] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.452907 19827 leader_election.cc:304] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:29.464524 20166 raft_consensus.cc:2749] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:29.477535 20133 consensus_queue.cc:1048] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:29.478729 20128 raft_consensus.cc:359] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:29.479549 20128 raft_consensus.cc:385] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.479835 20128 raft_consensus.cc:740] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.482581 20127 raft_consensus.cc:359] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:29.483397 20127 raft_consensus.cc:385] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.483774 20127 raft_consensus.cc:740] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.484774 20127 consensus_queue.cc:260] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
W20260709 12:22:29.485930 19827 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 54067.7us
I20260709 12:22:29.535826 19842 tablet_service.cc:1511] Processing CreateTablet for tablet 43b2d93090d64da389b15b3b5b736ae2 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:29.537294 19842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b2d93090d64da389b15b3b5b736ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.554132 20133 raft_consensus.cc:493] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.554725 20133 raft_consensus.cc:515] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:29.555255 19922 tablet_service.cc:1511] Processing CreateTablet for tablet ebcd105158424342b29d433430a26086 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:29.556989 20133 leader_election.cc:290] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:29.544334 20128 consensus_queue.cc:260] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:29.559155 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552c7773ca94ad597485fb7683e0ec2" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:29.560756 20181 raft_consensus.cc:493] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.561312 20181 raft_consensus.cc:515] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:29.560482 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552c7773ca94ad597485fb7683e0ec2" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:29.477025 19755 catalog_manager.cc:5697] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.566910 19975 leader_election.cc:304] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:29.568101 20133 raft_consensus.cc:2749] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:29.557046 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebcd105158424342b29d433430a26086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.573091 20127 ts_tablet_manager.cc:1434] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.169s	user 0.006s	sys 0.016s
I20260709 12:22:29.577457 20127 tablet_bootstrap.cc:492] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:29.560557 20128 ts_tablet_manager.cc:1434] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.211s	user 0.012s	sys 0.000s
I20260709 12:22:29.584758 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3b7cf591de4141825ccc578837bdb3" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:29.585815 19861 raft_consensus.cc:2468] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:29.569212 20181 leader_election.cc:290] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:29.588991 19901 leader_election.cc:304] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:29.602510 20137 raft_consensus.cc:2804] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.603076 20137 raft_consensus.cc:493] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.603549 20137 raft_consensus.cc:3060] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.592691 20128 tablet_bootstrap.cc:492] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:29.592836 20129 ts_tablet_manager.cc:1434] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.240s	user 0.007s	sys 0.001s
I20260709 12:22:29.593324 20010 raft_consensus.cc:3060] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.596357 20166 raft_consensus.cc:493] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.606679 20166 raft_consensus.cc:515] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:29.607327 20129 tablet_bootstrap.cc:492] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:29.629158 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3b7cf591de4141825ccc578837bdb3" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:29.641037 19997 tablet_service.cc:1511] Processing CreateTablet for tablet 9aacfd09289c4d5a8b72e5391c896c26 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:29.642204 19849 tablet_service.cc:1511] Processing CreateTablet for tablet 9aacfd09289c4d5a8b72e5391c896c26 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:29.643021 19997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aacfd09289c4d5a8b72e5391c896c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.643815 19849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aacfd09289c4d5a8b72e5391c896c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.641037 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 9aacfd09289c4d5a8b72e5391c896c26 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:29.647594 19919 tablet_service.cc:1511] Processing CreateTablet for tablet 43b2d93090d64da389b15b3b5b736ae2 (DEFAULT_TABLE table=test-workload [id=78974d8183284524891e8968258fb3f9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:29.648010 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aacfd09289c4d5a8b72e5391c896c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.648850 19919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b2d93090d64da389b15b3b5b736ae2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:29.650240 19902 leader_election.cc:343] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.660462 20127 tablet_bootstrap.cc:654] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.667026 20128 tablet_bootstrap.cc:654] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.669661 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6778cad39436ab0a260f86049592f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:29.671168 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6778cad39436ab0a260f86049592f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
W20260709 12:22:29.671574 19826 leader_election.cc:343] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.672047 20007 raft_consensus.cc:2468] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:29.675951 19827 leader_election.cc:304] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:29.682269 20129 tablet_bootstrap.cc:654] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.692946 20140 raft_consensus.cc:2804] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.693462 20140 raft_consensus.cc:493] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.693862 20140 raft_consensus.cc:3060] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.701120 20166 leader_election.cc:290] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:29.713009 20129 tablet_bootstrap.cc:492] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:29.713647 20129 ts_tablet_manager.cc:1403] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.005s
I20260709 12:22:29.714115 20130 tablet_bootstrap.cc:654] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.720613 20140 raft_consensus.cc:515] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:29.720645 20137 raft_consensus.cc:515] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:29.724041 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6778cad39436ab0a260f86049592f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:29.724687 20009 raft_consensus.cc:3060] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.725725 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3b7cf591de4141825ccc578837bdb3" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:29.726425 19859 raft_consensus.cc:3060] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.733840 20009 raft_consensus.cc:2468] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:29.735389 19827 leader_election.cc:304] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:29.736445 20166 raft_consensus.cc:2804] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.736660 19859 raft_consensus.cc:2468] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:29.736972 20166 raft_consensus.cc:697] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:29.737917 20166 consensus_queue.cc:237] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:29.738194 19901 leader_election.cc:304] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:29.739812 20137 leader_election.cc:290] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:29.743324 20127 tablet_bootstrap.cc:492] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:29.744112 20127 ts_tablet_manager.cc:1403] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.167s	user 0.008s	sys 0.007s
I20260709 12:22:29.739362 20221 raft_consensus.cc:2804] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.748823 20221 raft_consensus.cc:697] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:29.750067 20221 consensus_queue.cc:237] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:29.753921 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3b7cf591de4141825ccc578837bdb3" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:29.754822 20129 raft_consensus.cc:359] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.755815 20129 raft_consensus.cc:385] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.755930 20140 leader_election.cc:290] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:29.756201 20129 raft_consensus.cc:740] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.757591 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6778cad39436ab0a260f86049592f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
W20260709 12:22:29.759322 19826 leader_election.cc:343] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.757241 20129 consensus_queue.cc:260] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
W20260709 12:22:29.764739 19902 leader_election.cc:343] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.771737 20127 raft_consensus.cc:359] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:29.772761 20127 raft_consensus.cc:385] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.773101 20127 raft_consensus.cc:740] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.774061 20127 consensus_queue.cc:260] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:29.786228 20127 ts_tablet_manager.cc:1434] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:22:29.787794 20127 tablet_bootstrap.cc:492] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:29.788532 20210 raft_consensus.cc:493] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.789155 20210 raft_consensus.cc:515] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.795157 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:29.795272 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:29.795904 20127 tablet_bootstrap.cc:654] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:29.797225 20049 leader_election.cc:343] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:29.798090 20049 leader_election.cc:343] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.798687 20049 leader_election.cc:304] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:29.799616 20165 raft_consensus.cc:2749] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:29.791703 20210 leader_election.cc:290] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:29.801311 20127 tablet_bootstrap.cc:492] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:29.801854 20127 ts_tablet_manager.cc:1403] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:22:29.802848 20129 ts_tablet_manager.cc:1434] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.001s
I20260709 12:22:29.804032 20129 tablet_bootstrap.cc:492] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:29.805935 20128 tablet_bootstrap.cc:492] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:29.806464 20128 ts_tablet_manager.cc:1403] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.214s	user 0.022s	sys 0.040s
I20260709 12:22:29.810022 20130 tablet_bootstrap.cc:492] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:29.810554 20130 ts_tablet_manager.cc:1403] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.362s	user 0.022s	sys 0.018s
I20260709 12:22:29.813539 20130 raft_consensus.cc:359] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.814287 20130 raft_consensus.cc:385] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.814577 20127 raft_consensus.cc:359] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.815274 20127 raft_consensus.cc:385] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.814584 20130 raft_consensus.cc:740] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.816442 20130 consensus_queue.cc:260] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.816104 19756 catalog_manager.cc:5697] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 0 to 1, leader changed from <none> to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 1 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.818665 20130 ts_tablet_manager.cc:1434] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:22:29.818343 19755 catalog_manager.cc:5697] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.819839 20130 tablet_bootstrap.cc:492] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:29.821890 20128 raft_consensus.cc:359] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.822433 20128 raft_consensus.cc:385] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.822679 20128 raft_consensus.cc:740] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.823419 20128 consensus_queue.cc:260] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.815549 20127 raft_consensus.cc:740] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.825876 20128 ts_tablet_manager.cc:1434] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 12:22:29.825501 20127 consensus_queue.cc:260] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.827030 20128 tablet_bootstrap.cc:492] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:29.829319 20127 ts_tablet_manager.cc:1434] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:22:29.830524 20127 tablet_bootstrap.cc:492] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:29.832572 20224 raft_consensus.cc:493] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.833092 20224 raft_consensus.cc:515] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.834569 20128 tablet_bootstrap.cc:654] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.837167 20127 tablet_bootstrap.cc:654] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.837566 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f153ead7b64c4983b271c2c190b7d2fc" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:29.838471 20082 raft_consensus.cc:2468] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:29.839157 20130 tablet_bootstrap.cc:654] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.840474 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f153ead7b64c4983b271c2c190b7d2fc" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:29.841364 19933 raft_consensus.cc:2468] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:29.843236 19975 leader_election.cc:304] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:29.844365 20183 raft_consensus.cc:2804] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.844935 20183 raft_consensus.cc:493] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.845394 20183 raft_consensus.cc:3060] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.835338 20224 leader_election.cc:290] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:29.835330 20129 tablet_bootstrap.cc:654] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.857969 20183 raft_consensus.cc:515] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.869891 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f153ead7b64c4983b271c2c190b7d2fc" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:29.870572 19933 raft_consensus.cc:3060] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.874366 20128 tablet_bootstrap.cc:492] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:29.874924 20128 ts_tablet_manager.cc:1403] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.023s
I20260709 12:22:29.877777 20128 raft_consensus.cc:359] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.878432 20128 raft_consensus.cc:385] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.878679 20128 raft_consensus.cc:740] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.879329 20128 consensus_queue.cc:260] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.881393 20128 ts_tablet_manager.cc:1434] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:22:29.882431 20128 tablet_bootstrap.cc:492] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:29.884244 20127 tablet_bootstrap.cc:492] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:29.885174 20127 ts_tablet_manager.cc:1403] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.001s
I20260709 12:22:29.889636 20166 raft_consensus.cc:493] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.890353 20166 raft_consensus.cc:515] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.893180 20166 leader_election.cc:290] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:29.896041 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:29.896601 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:29.897619 19936 raft_consensus.cc:2468] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:29.899471 20128 tablet_bootstrap.cc:654] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.899631 20082 raft_consensus.cc:2468] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:29.899861 19826 leader_election.cc:304] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:29.901973 20166 raft_consensus.cc:2804] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.902468 20166 raft_consensus.cc:493] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.902962 20166 raft_consensus.cc:3060] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.908668 20183 leader_election.cc:290] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:29.909629 20128 tablet_bootstrap.cc:492] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:29.909825 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f153ead7b64c4983b271c2c190b7d2fc" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:29.910143 20128 ts_tablet_manager.cc:1403] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:22:29.910420 20082 raft_consensus.cc:3060] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.913061 20128 raft_consensus.cc:359] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.913800 20128 raft_consensus.cc:385] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.914072 20128 raft_consensus.cc:740] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.914474 20166 raft_consensus.cc:515] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.914817 20128 consensus_queue.cc:260] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.916960 20128 ts_tablet_manager.cc:1434] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:29.879999 19933 raft_consensus.cc:2468] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:29.917994 20128 tablet_bootstrap.cc:492] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:29.919051 19975 leader_election.cc:304] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:29.889118 20127 raft_consensus.cc:359] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.920185 20127 raft_consensus.cc:385] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.920493 20127 raft_consensus.cc:740] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.921363 20127 consensus_queue.cc:260] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.922943 20224 raft_consensus.cc:2804] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.923619 20127 ts_tablet_manager.cc:1434] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:22:29.924513 20128 tablet_bootstrap.cc:654] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.924825 20127 tablet_bootstrap.cc:492] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:29.929744 20224 raft_consensus.cc:697] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:29.930962 20082 raft_consensus.cc:2468] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:29.932230 20129 tablet_bootstrap.cc:492] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:29.932813 20129 ts_tablet_manager.cc:1403] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.021s
I20260709 12:22:29.930872 20224 consensus_queue.cc:237] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:29.936525 20129 raft_consensus.cc:359] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:29.937318 20129 raft_consensus.cc:385] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.937968 20130 tablet_bootstrap.cc:492] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:29.940089 20130 ts_tablet_manager.cc:1403] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.047s
I20260709 12:22:29.943300 20130 raft_consensus.cc:359] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:29.944065 20130 raft_consensus.cc:385] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.944371 20130 raft_consensus.cc:740] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.945129 20130 consensus_queue.cc:260] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:29.937619 20129 raft_consensus.cc:740] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.948300 20129 consensus_queue.cc:260] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:29.950490 20129 ts_tablet_manager.cc:1434] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:22:29.951825 20166 leader_election.cc:290] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:29.952491 20130 ts_tablet_manager.cc:1434] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:22:29.953727 20130 tablet_bootstrap.cc:492] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:29.956424 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:29.957301 20082 raft_consensus.cc:3060] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.958375 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:29.960911 20127 tablet_bootstrap.cc:654] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.959241 19933 raft_consensus.cc:3060] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.964918 20130 tablet_bootstrap.cc:654] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.966296 20129 tablet_bootstrap.cc:492] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:29.973735 20129 tablet_bootstrap.cc:654] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.969889 19755 catalog_manager.cc:5697] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.986424 19933 raft_consensus.cc:2468] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:29.988097 19826 leader_election.cc:304] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:29.989156 20166 raft_consensus.cc:2804] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.989714 20166 raft_consensus.cc:697] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:29.990656 20166 consensus_queue.cc:237] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.992237 20082 raft_consensus.cc:2468] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:29.992705 20129 tablet_bootstrap.cc:492] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:29.994217 20129 ts_tablet_manager.cc:1403] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.007s
I20260709 12:22:29.997108 20129 raft_consensus.cc:359] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:29.997748 20129 raft_consensus.cc:385] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.998003 20129 raft_consensus.cc:740] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.998605 20127 tablet_bootstrap.cc:492] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:29.999248 20127 ts_tablet_manager.cc:1403] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.011s
I20260709 12:22:29.998648 20129 consensus_queue.cc:260] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.000715 20128 tablet_bootstrap.cc:492] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:30.001209 20128 ts_tablet_manager.cc:1403] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.083s	user 0.039s	sys 0.017s
I20260709 12:22:30.001523 20129 ts_tablet_manager.cc:1434] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:22:30.002746 20129 tablet_bootstrap.cc:492] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:30.004065 20128 raft_consensus.cc:359] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.004740 20128 raft_consensus.cc:385] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.005007 20128 raft_consensus.cc:740] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.005761 20128 consensus_queue.cc:260] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.007254 19759 catalog_manager.cc:5697] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.009618 20130 tablet_bootstrap.cc:492] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:30.010187 20130 ts_tablet_manager.cc:1403] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.005s
I20260709 12:22:30.012784 20128 ts_tablet_manager.cc:1434] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:22:30.013671 20129 tablet_bootstrap.cc:654] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.013949 20128 tablet_bootstrap.cc:492] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:30.021739 20128 tablet_bootstrap.cc:654] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.025830 20127 raft_consensus.cc:359] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.027374 20127 raft_consensus.cc:385] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.027716 20127 raft_consensus.cc:740] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.028590 20127 consensus_queue.cc:260] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.034476 20128 tablet_bootstrap.cc:492] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:30.035182 20128 ts_tablet_manager.cc:1403] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 12:22:30.035950 20127 ts_tablet_manager.cc:1434] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 12:22:30.038789 20128 raft_consensus.cc:359] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.039776 20128 raft_consensus.cc:385] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.040115 20128 raft_consensus.cc:740] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.041347 20128 consensus_queue.cc:260] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.041616 20130 raft_consensus.cc:359] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.042438 20130 raft_consensus.cc:385] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.042776 20130 raft_consensus.cc:740] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.043486 20130 consensus_queue.cc:260] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.045591 20130 ts_tablet_manager.cc:1434] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:30.047302 20130 tablet_bootstrap.cc:492] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:30.047204 20224 raft_consensus.cc:493] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.048015 20224 raft_consensus.cc:515] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.050191 20224 leader_election.cc:290] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:30.051487 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3b7cf591de4141825ccc578837bdb3" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:30.053368 20129 tablet_bootstrap.cc:492] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:30.053540 20166 raft_consensus.cc:493] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.053864 20129 ts_tablet_manager.cc:1403] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.015s
I20260709 12:22:30.054076 20130 tablet_bootstrap.cc:654] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.054325 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3b7cf591de4141825ccc578837bdb3" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:30.054176 20166 raft_consensus.cc:515] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.055235 19859 raft_consensus.cc:2393] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86ad94e539f24675ba7226e7371cec9b in current term 1: Already voted for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in this term.
I20260709 12:22:30.056598 20128 ts_tablet_manager.cc:1434] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 12:22:30.056661 20166 leader_election.cc:290] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:30.056841 20129 raft_consensus.cc:359] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.057498 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:30.057787 20129 raft_consensus.cc:385] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.058192 20129 raft_consensus.cc:740] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.059106 20129 consensus_queue.cc:260] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.060240 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:30.061901 20129 ts_tablet_manager.cc:1434] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:30.063383 20129 tablet_bootstrap.cc:492] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:30.066681 19975 leader_election.cc:304] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:30.068445 20224 raft_consensus.cc:3060] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.069123 19826 leader_election.cc:304] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:30.071563 20166 raft_consensus.cc:2749] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.075695 20129 tablet_bootstrap.cc:654] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.060312 20128 tablet_bootstrap.cc:492] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:30.080785 20130 tablet_bootstrap.cc:492] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:30.081280 20130 ts_tablet_manager.cc:1403] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.006s
I20260709 12:22:30.082141 20128 tablet_bootstrap.cc:654] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.084086 20130 raft_consensus.cc:359] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.084960 20130 raft_consensus.cc:385] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.085585 20130 raft_consensus.cc:740] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.086532 20130 consensus_queue.cc:260] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.087702 19933 raft_consensus.cc:3060] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.089290 20130 ts_tablet_manager.cc:1434] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:30.090757 20130 tablet_bootstrap.cc:492] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:30.097445 20127 tablet_bootstrap.cc:492] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:30.100394 20130 tablet_bootstrap.cc:654] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.106123 20129 tablet_bootstrap.cc:492] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:30.106782 20129 ts_tablet_manager.cc:1403] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.009s
I20260709 12:22:30.110374 20129 raft_consensus.cc:359] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.111171 20129 raft_consensus.cc:385] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.111568 20129 raft_consensus.cc:740] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.112483 20129 consensus_queue.cc:260] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.114374 20224 raft_consensus.cc:2749] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.115218 20129 ts_tablet_manager.cc:1434] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:22:30.117169 20129 tablet_bootstrap.cc:492] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:30.118676 20221 raft_consensus.cc:493] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.119441 20221 raft_consensus.cc:515] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:30.123481 20221 leader_election.cc:290] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:30.127279 20130 tablet_bootstrap.cc:492] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:30.128032 20130 ts_tablet_manager.cc:1403] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.000s
I20260709 12:22:30.132107 20130 raft_consensus.cc:359] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.133047 20130 raft_consensus.cc:385] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.133391 20130 raft_consensus.cc:740] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.134495 20127 tablet_bootstrap.cc:654] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.134274 20130 consensus_queue.cc:260] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.124413 20129 tablet_bootstrap.cc:654] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.123260 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26bba3e147042a9bc03b848a9e13780" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:30.124646 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b26bba3e147042a9bc03b848a9e13780" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:30.143491 19901 leader_election.cc:304] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:30.144651 20221 raft_consensus.cc:2749] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.149183 20130 ts_tablet_manager.cc:1434] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 12:22:30.150995 20130 tablet_bootstrap.cc:492] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:30.152642 20128 tablet_bootstrap.cc:492] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:30.153138 20128 ts_tablet_manager.cc:1403] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.093s	user 0.027s	sys 0.042s
I20260709 12:22:30.156014 20128 raft_consensus.cc:359] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:30.156724 20128 raft_consensus.cc:385] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.156992 20128 raft_consensus.cc:740] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.157642 20128 consensus_queue.cc:260] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:30.159652 20128 ts_tablet_manager.cc:1434] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:22:30.160466 20127 tablet_bootstrap.cc:492] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:30.160764 20128 tablet_bootstrap.cc:492] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:30.161027 20127 ts_tablet_manager.cc:1403] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.000s
I20260709 12:22:30.164525 20127 raft_consensus.cc:359] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.165268 20127 raft_consensus.cc:385] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.165571 20127 raft_consensus.cc:740] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.166363 20127 consensus_queue.cc:260] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.166920 20128 tablet_bootstrap.cc:654] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.169200 20127 ts_tablet_manager.cc:1434] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:30.173282 20129 tablet_bootstrap.cc:492] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:30.174186 20129 ts_tablet_manager.cc:1403] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.000s
I20260709 12:22:30.177284 20130 tablet_bootstrap.cc:654] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.178206 20129 raft_consensus.cc:359] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:30.179140 20129 raft_consensus.cc:385] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.178779 20166 consensus_queue.cc:1048] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:30.179668 20129 raft_consensus.cc:740] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.180586 20129 consensus_queue.cc:260] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:30.187289 20130 tablet_bootstrap.cc:492] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:30.187884 20130 ts_tablet_manager.cc:1403] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.005s
I20260709 12:22:30.189178 20221 consensus_queue.cc:1048] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:30.190920 20130 raft_consensus.cc:359] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.191643 20130 raft_consensus.cc:385] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.191926 20130 raft_consensus.cc:740] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.192747 20127 tablet_bootstrap.cc:492] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:30.192596 20130 consensus_queue.cc:260] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.195184 20129 ts_tablet_manager.cc:1434] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:22:30.197244 20129 tablet_bootstrap.cc:492] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:30.203204 20130 ts_tablet_manager.cc:1434] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:22:30.204301 20129 tablet_bootstrap.cc:654] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.214529 20130 tablet_bootstrap.cc:492] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:30.220060 20127 tablet_bootstrap.cc:654] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.227149 20224 raft_consensus.cc:493] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.228360 20224 raft_consensus.cc:515] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.229947 20128 tablet_bootstrap.cc:492] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:30.230652 20128 ts_tablet_manager.cc:1403] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.014s
I20260709 12:22:30.232331 20224 leader_election.cc:290] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:30.233227 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371a360baa8343b796acd184956f785e" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:30.234038 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371a360baa8343b796acd184956f785e" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:30.234962 19859 raft_consensus.cc:2468] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:30.236418 20128 raft_consensus.cc:359] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.234032 20082 raft_consensus.cc:2468] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:30.237203 19975 leader_election.cc:304] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:30.240523 20127 tablet_bootstrap.cc:492] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:30.241015 20127 ts_tablet_manager.cc:1403] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.002s
I20260709 12:22:30.237210 20128 raft_consensus.cc:385] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.242275 20128 raft_consensus.cc:740] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.243587 20224 raft_consensus.cc:2804] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.243979 20224 raft_consensus.cc:493] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.244324 20224 raft_consensus.cc:3060] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.246587 20130 tablet_bootstrap.cc:654] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.253813 20128 consensus_queue.cc:260] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.253458 20127 raft_consensus.cc:359] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.255591 20127 raft_consensus.cc:385] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.256238 20127 raft_consensus.cc:740] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.258973 20128 ts_tablet_manager.cc:1434] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 12:22:30.262607 20127 consensus_queue.cc:260] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.262362 20133 raft_consensus.cc:493] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.264179 20133 raft_consensus.cc:515] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:30.265846 20082 raft_consensus.cc:3060] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.266247 20133 leader_election.cc:290] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:30.269416 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd522cd408c24f868f5c1c4ab9d026b6" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
W20260709 12:22:30.269482 19806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:30.269810 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd522cd408c24f868f5c1c4ab9d026b6" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:30.270614 19933 raft_consensus.cc:2468] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:30.271842 19975 leader_election.cc:304] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:30.273360 20083 raft_consensus.cc:2468] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:30.276382 20129 tablet_bootstrap.cc:492] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:30.276974 20129 ts_tablet_manager.cc:1403] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.080s	user 0.029s	sys 0.019s
I20260709 12:22:30.280279 20129 raft_consensus.cc:359] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:30.280968 20129 raft_consensus.cc:385] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.281307 20129 raft_consensus.cc:740] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.282276 20129 consensus_queue.cc:260] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:30.284588 20129 ts_tablet_manager.cc:1434] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:30.285749 20129 tablet_bootstrap.cc:492] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:30.286569 20140 consensus_queue.cc:1048] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.291177 20183 raft_consensus.cc:493] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.291729 20183 raft_consensus.cc:515] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.292078 20129 tablet_bootstrap.cc:654] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.300696 20128 tablet_bootstrap.cc:492] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:30.304291 20183 leader_election.cc:290] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:30.305210 20183 raft_consensus.cc:2804] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.305758 20183 raft_consensus.cc:493] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.306248 20183 raft_consensus.cc:3060] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.311815 20127 ts_tablet_manager.cc:1434] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 12:22:30.314697 20224 raft_consensus.cc:515] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.334088 20127 tablet_bootstrap.cc:492] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:30.347632 19861 raft_consensus.cc:3060] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.348043 20221 consensus_queue.cc:1048] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.350334 20130 tablet_bootstrap.cc:492] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:30.350836 20130 ts_tablet_manager.cc:1403] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.028s
I20260709 12:22:30.350621 20183 raft_consensus.cc:515] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
W20260709 12:22:30.353052 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:36799, user_credentials={real_user=slave}} blocked reactor thread for 81315.9us
I20260709 12:22:30.354871 19933 raft_consensus.cc:3060] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.355154 20130 raft_consensus.cc:359] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.356223 20130 raft_consensus.cc:385] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.356477 20130 raft_consensus.cc:740] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.354904 20128 tablet_bootstrap.cc:654] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.357086 20130 consensus_queue.cc:260] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.366636 20183 leader_election.cc:290] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:30.354934 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dee1529a574c56ad2cb367867c20b7" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:30.378481 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd522cd408c24f868f5c1c4ab9d026b6" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:30.378757 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371a360baa8343b796acd184956f785e" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:30.379362 20082 raft_consensus.cc:3060] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.382071 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dee1529a574c56ad2cb367867c20b7" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:30.382972 19936 raft_consensus.cc:2468] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:30.379408 20084 raft_consensus.cc:3060] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.388693 20130 ts_tablet_manager.cc:1434] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.006s
I20260709 12:22:30.389902 20130 tablet_bootstrap.cc:492] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:30.390830 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371a360baa8343b796acd184956f785e" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:30.393034 20210 raft_consensus.cc:493] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.393744 20210 raft_consensus.cc:515] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.371228 19860 raft_consensus.cc:2468] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:30.396948 19975 leader_election.cc:304] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:30.398514 20133 raft_consensus.cc:2804] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.398901 20133 raft_consensus.cc:493] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.399222 20133 raft_consensus.cc:3060] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.402966 20140 raft_consensus.cc:493] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.403499 20140 raft_consensus.cc:515] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.392388 19859 raft_consensus.cc:3060] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.371657 20221 raft_consensus.cc:493] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.414494 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd522cd408c24f868f5c1c4ab9d026b6" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:30.416555 19935 raft_consensus.cc:3060] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.416766 20267 raft_consensus.cc:493] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.374089 20224 leader_election.cc:290] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:30.427326 20129 tablet_bootstrap.cc:492] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:30.428005 20129 ts_tablet_manager.cc:1403] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.143s	user 0.017s	sys 0.011s
I20260709 12:22:30.420282 20264 consensus_queue.cc:1048] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:22:30.426436 20221 raft_consensus.cc:515] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.425743 20267 raft_consensus.cc:515] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.456205 20221 leader_election.cc:290] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:30.456067 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:30.457031 19936 raft_consensus.cc:2468] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:30.455176 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318a253a656405f809d73600a4fab9b" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:30.458717 20127 tablet_bootstrap.cc:654] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.458905 19860 raft_consensus.cc:2468] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:30.461346 20130 tablet_bootstrap.cc:654] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.468580 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:30.469337 20009 raft_consensus.cc:2468] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:30.470423 20049 leader_election.cc:304] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:30.470667 19827 leader_election.cc:304] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:30.471347 20165 raft_consensus.cc:2804] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.471091 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:30.471642 20169 raft_consensus.cc:2804] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.472065 20169 raft_consensus.cc:493] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.472426 20169 raft_consensus.cc:3060] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.473413 20267 leader_election.cc:290] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:30.443197 20210 leader_election.cc:290] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:30.476797 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:30.478678 20009 raft_consensus.cc:2468] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:30.478771 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318a253a656405f809d73600a4fab9b" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:30.479880 19932 raft_consensus.cc:2468] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:30.471815 20165 raft_consensus.cc:493] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.480854 20165 raft_consensus.cc:3060] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.480909 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318a253a656405f809d73600a4fab9b" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:30.481609 19858 raft_consensus.cc:2468] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:30.447856 20140 leader_election.cc:290] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:30.483100 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318a253a656405f809d73600a4fab9b" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:30.484658 19901 leader_election.cc:304] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:30.485759 19902 leader_election.cc:304] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:30.486872 20271 raft_consensus.cc:2804] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.487684 20267 raft_consensus.cc:2804] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.487205 20133 raft_consensus.cc:515] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.487269 20271 raft_consensus.cc:493] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.497656 20271 raft_consensus.cc:3060] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.501530 20130 tablet_bootstrap.cc:492] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:30.502002 20130 ts_tablet_manager.cc:1403] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.009s
I20260709 12:22:30.501685 20129 raft_consensus.cc:359] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.502511 20129 raft_consensus.cc:385] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.502727 20129 raft_consensus.cc:740] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.496417 20267 raft_consensus.cc:493] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.506227 20129 consensus_queue.cc:260] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.505256 20267 raft_consensus.cc:3060] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.513659 20129 ts_tablet_manager.cc:1434] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.085s	user 0.004s	sys 0.003s
I20260709 12:22:30.516826 20082 raft_consensus.cc:2468] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:30.523046 20129 tablet_bootstrap.cc:492] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:30.528285 20127 tablet_bootstrap.cc:492] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:30.529110 20127 ts_tablet_manager.cc:1403] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.195s	user 0.016s	sys 0.015s
I20260709 12:22:30.529654 20128 tablet_bootstrap.cc:492] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:30.530413 20128 ts_tablet_manager.cc:1403] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.237s	user 0.016s	sys 0.011s
I20260709 12:22:30.532308 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dee1529a574c56ad2cb367867c20b7" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:30.533056 19858 raft_consensus.cc:3060] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.534659 20165 raft_consensus.cc:515] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.536144 20080 raft_consensus.cc:2393] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:30.540199 20140 consensus_queue.cc:1048] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:30.547142 20140 consensus_queue.cc:1048] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:30.542011 20169 raft_consensus.cc:515] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.552114 19860 raft_consensus.cc:2393] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
I20260709 12:22:30.549614 19859 raft_consensus.cc:2468] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:30.553740 20165 leader_election.cc:290] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:30.555589 19975 leader_election.cc:304] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:30.556936 20169 leader_election.cc:290] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:30.557204 20264 raft_consensus.cc:2804] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.558176 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dee1529a574c56ad2cb367867c20b7" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:30.561216 20264 raft_consensus.cc:697] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:30.561353 19932 raft_consensus.cc:3060] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.561517 20166 raft_consensus.cc:493] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.562129 20166 raft_consensus.cc:515] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.562338 20264 consensus_queue.cc:237] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:30.559556 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318a253a656405f809d73600a4fab9b" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:30.564572 20166 leader_election.cc:290] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:30.565862 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:30.566591 20009 raft_consensus.cc:3060] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.551755 20128 raft_consensus.cc:359] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.567993 19935 raft_consensus.cc:2468] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:30.568369 20128 raft_consensus.cc:385] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.568742 20128 raft_consensus.cc:740] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.560393 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318a253a656405f809d73600a4fab9b" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:30.574260 20128 consensus_queue.cc:260] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.578135 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:30.578979 20010 raft_consensus.cc:2468] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:30.544936 20133 leader_election.cc:290] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:30.580482 19859 raft_consensus.cc:3060] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.592375 20128 ts_tablet_manager.cc:1434] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:22:30.580242 20183 raft_consensus.cc:493] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.587669 19826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:45345, user_credentials={real_user=slave}} blocked reactor thread for 46958.4us
I20260709 12:22:30.608299 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:30.610307 19827 leader_election.cc:304] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:30.610810 19975 leader_election.cc:304] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:30.611469 20166 raft_consensus.cc:2804] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.623032 20166 raft_consensus.cc:493] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.623585 20166 raft_consensus.cc:3060] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.624433 20084 raft_consensus.cc:2468] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:30.628290 20271 raft_consensus.cc:515] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.614820 19859 raft_consensus.cc:2468] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:30.599895 20183 raft_consensus.cc:515] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.630867 20271 leader_election.cc:290] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:30.631474 20183 leader_election.cc:290] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:30.632274 20183 raft_consensus.cc:2804] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.633270 19934 raft_consensus.cc:2393] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eafc6cb9dfb7468581367b29682ec024 in current term 1: Already voted for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in this term.
I20260709 12:22:30.634235 20009 raft_consensus.cc:2468] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:30.635407 20183 raft_consensus.cc:697] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:30.636843 20183 consensus_queue.cc:237] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.622087 20129 tablet_bootstrap.cc:654] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.638556 19858 raft_consensus.cc:2468] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:30.638793 20165 raft_consensus.cc:493] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.644454 20128 tablet_bootstrap.cc:492] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:30.653076 19827 leader_election.cc:304] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:30.654664 19975 leader_election.cc:304] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:30.645463 20049 leader_election.cc:304] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:30.655833 20278 raft_consensus.cc:2804] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.655995 20133 consensus_queue.cc:1048] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:30.657291 20264 raft_consensus.cc:2804] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.656450 20278 raft_consensus.cc:697] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:30.657912 20264 raft_consensus.cc:697] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:30.645964 19932 raft_consensus.cc:2468] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:30.658527 20278 consensus_queue.cc:237] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.652467 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318a253a656405f809d73600a4fab9b" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:30.651856 20165 raft_consensus.cc:515] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.663555 20210 raft_consensus.cc:493] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.660579 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:30.673522 20130 raft_consensus.cc:359] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.674952 20130 raft_consensus.cc:385] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.676290 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:30.677184 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318a253a656405f809d73600a4fab9b" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:30.678097 19859 raft_consensus.cc:2393] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:30.675253 20130 raft_consensus.cc:740] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.658922 20264 consensus_queue.cc:237] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.683645 20084 raft_consensus.cc:2393] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:30.678874 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:30.694561 20280 raft_consensus.cc:2804] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.694881 19901 leader_election.cc:304] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:30.685206 20130 consensus_queue.cc:260] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.697363 20221 raft_consensus.cc:2749] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.695181 20280 raft_consensus.cc:697] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:30.699441 20280 consensus_queue.cc:237] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.701956 20267 raft_consensus.cc:515] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.703174 19936 raft_consensus.cc:2393] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in this term.
I20260709 12:22:30.704555 20282 raft_consensus.cc:493] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.705128 20282 raft_consensus.cc:515] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:30.680702 20210 raft_consensus.cc:515] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.710042 20081 raft_consensus.cc:2468] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:30.714056 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956c270268242f88a839bc03d3d5d62" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:30.715396 20165 leader_election.cc:290] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:30.715631 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956c270268242f88a839bc03d3d5d62" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:30.715281 19757 catalog_manager.cc:5697] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.717686 20210 leader_election.cc:290] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:30.720455 19975 leader_election.cc:304] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:30.722424 20282 leader_election.cc:290] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:30.727593 20133 raft_consensus.cc:2804] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.732290 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:30.731909 20130 ts_tablet_manager.cc:1434] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.230s	user 0.007s	sys 0.003s
I20260709 12:22:30.739178 20130 tablet_bootstrap.cc:492] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:30.739552 20267 leader_election.cc:290] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:30.732319 20133 raft_consensus.cc:493] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.741663 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:30.742036 20133 raft_consensus.cc:3060] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:30.727852 20050 leader_election.cc:343] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.750905 20128 tablet_bootstrap.cc:654] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.730168 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bb95b2a5614ee7b33bf343c88fdf34" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:30.752401 20127 raft_consensus.cc:359] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.760401 20127 raft_consensus.cc:385] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.728480 20166 raft_consensus.cc:515] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.761087 20127 raft_consensus.cc:740] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.741605 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
W20260709 12:22:30.755378 20049 leader_election.cc:343] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.762970 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bb95b2a5614ee7b33bf343c88fdf34" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:30.769016 19933 raft_consensus.cc:2468] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:30.773392 20129 tablet_bootstrap.cc:492] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:30.772490 20127 consensus_queue.cc:260] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.774021 20129 ts_tablet_manager.cc:1403] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.253s	user 0.013s	sys 0.009s
I20260709 12:22:30.765473 19859 raft_consensus.cc:2468] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:30.776067 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:30.783726 20127 ts_tablet_manager.cc:1434] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.254s	user 0.007s	sys 0.005s
I20260709 12:22:30.791761 20007 raft_consensus.cc:2393] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
I20260709 12:22:30.782521 19858 raft_consensus.cc:2393] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86ad94e539f24675ba7226e7371cec9b in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
I20260709 12:22:30.794996 19902 leader_election.cc:304] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:30.797329 20221 raft_consensus.cc:2749] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.797736 20129 raft_consensus.cc:359] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.798674 20129 raft_consensus.cc:385] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.799018 20129 raft_consensus.cc:740] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.800518 20129 consensus_queue.cc:260] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.804587 20127 tablet_bootstrap.cc:492] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
W20260709 12:22:30.808225 20283 log.cc:927] Time spent T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:30.813570 20129 ts_tablet_manager.cc:1434] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:22:30.819464 20166 leader_election.cc:290] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:30.820287 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:30.822324 20084 raft_consensus.cc:3060] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.825795 20133 raft_consensus.cc:515] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.826998 20010 raft_consensus.cc:2393] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eafc6cb9dfb7468581367b29682ec024 in current term 1: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:30.828564 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:30.829425 20130 tablet_bootstrap.cc:654] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.831887 20129 tablet_bootstrap.cc:492] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:30.821308 20049 leader_election.cc:304] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:30.837221 20183 raft_consensus.cc:493] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.837515 20280 raft_consensus.cc:2749] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:30.837767 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:36799, user_credentials={real_user=slave}} blocked reactor thread for 89376.9us
I20260709 12:22:30.837803 20183 raft_consensus.cc:515] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.840401 20084 raft_consensus.cc:2468] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:30.840122 20128 tablet_bootstrap.cc:492] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:30.841675 20128 ts_tablet_manager.cc:1403] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.242s	user 0.022s	sys 0.000s
I20260709 12:22:30.841180 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fd600b97cc4962a0c2aa0ea2192e27" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:30.843066 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fd600b97cc4962a0c2aa0ea2192e27" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:30.843379 19826 leader_election.cc:304] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:30.845223 20278 raft_consensus.cc:2804] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:22:30.845266 19975 leader_election.cc:343] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.845925 20278 raft_consensus.cc:697] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:30.847175 20278 consensus_queue.cc:237] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
W20260709 12:22:30.849431 19975 leader_election.cc:343] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.860245 20129 tablet_bootstrap.cc:654] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.860746 20128 raft_consensus.cc:359] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.873366 20128 raft_consensus.cc:385] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.873831 20128 raft_consensus.cc:740] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.856153 20050 leader_election.cc:304] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:30.847128 20049 leader_election.cc:304] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:30.877063 20280 raft_consensus.cc:2749] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.874902 20128 consensus_queue.cc:260] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.877890 20280 raft_consensus.cc:2804] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.886879 20280 raft_consensus.cc:493] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.887588 20280 raft_consensus.cc:3060] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.858889 20133 leader_election.cc:290] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:30.892659 20127 tablet_bootstrap.cc:654] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.850044 20183 leader_election.cc:290] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:30.855391 19975 leader_election.cc:304] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
W20260709 12:22:30.899591 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 50200us
I20260709 12:22:30.905071 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:30.913208 20081 raft_consensus.cc:2393] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86ad94e539f24675ba7226e7371cec9b in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
I20260709 12:22:30.907743 20183 raft_consensus.cc:2749] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.917735 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:30.918656 20280 raft_consensus.cc:515] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.921209 20280 leader_election.cc:290] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:30.922132 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bb95b2a5614ee7b33bf343c88fdf34" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:30.922320 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bb95b2a5614ee7b33bf343c88fdf34" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:30.923100 19933 raft_consensus.cc:3060] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.923234 19858 raft_consensus.cc:3060] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.928558 19975 leader_election.cc:304] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:30.929620 20183 raft_consensus.cc:2749] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.930938 20210 raft_consensus.cc:493] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.931408 19858 raft_consensus.cc:2468] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:30.931493 20210 raft_consensus.cc:515] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.933137 20049 leader_election.cc:304] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:30.933446 19933 raft_consensus.cc:2468] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:30.934194 20210 leader_election.cc:290] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:30.934798 20210 raft_consensus.cc:2804] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.936651 20129 tablet_bootstrap.cc:492] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:30.937206 20129 ts_tablet_manager.cc:1403] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.005s
I20260709 12:22:30.938484 20128 ts_tablet_manager.cc:1434] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.097s	user 0.010s	sys 0.000s
I20260709 12:22:30.939690 20128 tablet_bootstrap.cc:492] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:30.939805 20130 tablet_bootstrap.cc:492] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:30.940590 20130 ts_tablet_manager.cc:1403] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.202s	user 0.029s	sys 0.019s
I20260709 12:22:30.940351 20129 raft_consensus.cc:359] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.941422 20129 raft_consensus.cc:385] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.941733 20129 raft_consensus.cc:740] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.942252 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d5f2bc032946c286131fbde1598003" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:30.942492 20129 consensus_queue.cc:260] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:30.943010 19933 raft_consensus.cc:2468] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:30.944121 20049 leader_election.cc:304] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:30.945072 20282 raft_consensus.cc:2804] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.945479 20282 raft_consensus.cc:493] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.945879 20282 raft_consensus.cc:3060] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.948077 20130 raft_consensus.cc:359] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.945809 20210 raft_consensus.cc:697] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:30.951467 20130 raft_consensus.cc:385] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.951872 20130 raft_consensus.cc:740] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.952046 20210 consensus_queue.cc:237] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.953033 20128 tablet_bootstrap.cc:654] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.952728 20130 consensus_queue.cc:260] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:30.955505 20130 ts_tablet_manager.cc:1434] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:22:30.950337 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d5f2bc032946c286131fbde1598003" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:30.955631 20282 raft_consensus.cc:515] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:30.956727 20130 tablet_bootstrap.cc:492] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:30.964970 20130 tablet_bootstrap.cc:654] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:30.969452 20049 leader_election.cc:343] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.976823 20130 tablet_bootstrap.cc:492] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:30.975749 19756 catalog_manager.cc:5697] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.977419 20130 ts_tablet_manager.cc:1403] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 12:22:30.983032 20129 ts_tablet_manager.cc:1434] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:22:30.986351 20129 tablet_bootstrap.cc:492] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:30.984313 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d5f2bc032946c286131fbde1598003" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
W20260709 12:22:30.993325 20049 leader_election.cc:343] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.996690 20282 leader_election.cc:290] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:30.996968 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d5f2bc032946c286131fbde1598003" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:30.997742 19933 raft_consensus.cc:3060] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.998324 19755 catalog_manager.cc:5697] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.001454 20129 tablet_bootstrap.cc:654] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.003520 20127 tablet_bootstrap.cc:492] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:31.004045 20127 ts_tablet_manager.cc:1403] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.204s	user 0.024s	sys 0.014s
I20260709 12:22:31.006693 20183 consensus_queue.cc:1048] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:31.006717 20130 raft_consensus.cc:359] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.007287 20127 raft_consensus.cc:359] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.007752 20130 raft_consensus.cc:385] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.008069 20127 raft_consensus.cc:385] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.008220 20130 raft_consensus.cc:740] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.008482 20127 raft_consensus.cc:740] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.009490 20127 consensus_queue.cc:260] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.009236 20130 consensus_queue.cc:260] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.012194 20130 ts_tablet_manager.cc:1434] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 12:22:31.012138 20127 ts_tablet_manager.cc:1434] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:31.014031 20127 tablet_bootstrap.cc:492] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:31.014185 20130 tablet_bootstrap.cc:492] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:31.015322 20128 tablet_bootstrap.cc:492] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:31.015887 20128 ts_tablet_manager.cc:1403] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.076s	user 0.026s	sys 0.002s
I20260709 12:22:31.020754 20127 tablet_bootstrap.cc:654] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.022032 19933 raft_consensus.cc:2468] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:31.031805 20278 raft_consensus.cc:493] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.032373 20278 raft_consensus.cc:515] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.032706 20127 tablet_bootstrap.cc:492] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:31.032786 20049 leader_election.cc:304] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:31.033368 20127 ts_tablet_manager.cc:1403] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:22:31.033551 20130 tablet_bootstrap.cc:654] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.034863 20278 leader_election.cc:290] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:31.036767 20127 raft_consensus.cc:359] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.037503 20127 raft_consensus.cc:385] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.037801 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d5f2bc032946c286131fbde1598003" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:31.037814 20127 raft_consensus.cc:740] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.038699 20083 raft_consensus.cc:2393] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:31.038823 20127 consensus_queue.cc:260] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.039733 20210 raft_consensus.cc:2804] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.039940 20130 tablet_bootstrap.cc:492] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:31.040316 20210 raft_consensus.cc:697] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:31.018954 20128 raft_consensus.cc:359] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.026178 19755 catalog_manager.cc:5697] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.040937 20128 raft_consensus.cc:385] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.041249 20128 raft_consensus.cc:740] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.041427 20127 ts_tablet_manager.cc:1434] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:31.041294 20210 consensus_queue.cc:237] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.042131 20128 consensus_queue.cc:260] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.027662 20129 tablet_bootstrap.cc:492] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:31.042694 20127 tablet_bootstrap.cc:492] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:31.043933 20129 ts_tablet_manager.cc:1403] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.000s
I20260709 12:22:31.044569 20128 ts_tablet_manager.cc:1434] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:22:31.040521 20130 ts_tablet_manager.cc:1403] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.001s
I20260709 12:22:31.047096 20129 raft_consensus.cc:359] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.050323 20129 raft_consensus.cc:385] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.050688 20129 raft_consensus.cc:740] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.017625 19757 catalog_manager.cc:5697] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.051555 20129 consensus_queue.cc:260] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.051584 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d5f2bc032946c286131fbde1598003" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:31.054651 20264 raft_consensus.cc:493] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.055233 20264 raft_consensus.cc:515] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.055537 19757 catalog_manager.cc:5697] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.057669 20264 leader_election.cc:290] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:31.053735 20130 raft_consensus.cc:359] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.058163 20128 tablet_bootstrap.cc:492] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:31.059654 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd824adf5e1e4a799b2ed798ae40d3a3" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:31.061771 20129 ts_tablet_manager.cc:1434] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:22:31.061815 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd824adf5e1e4a799b2ed798ae40d3a3" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:31.062728 20083 raft_consensus.cc:2468] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:31.050688 20127 tablet_bootstrap.cc:654] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.064566 19975 leader_election.cc:304] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:31.065935 20133 raft_consensus.cc:2804] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.066365 20133 raft_consensus.cc:493] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.063153 20129 tablet_bootstrap.cc:492] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:31.066812 20133 raft_consensus.cc:3060] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.055240 19933 raft_consensus.cc:2393] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:31.068814 19826 leader_election.cc:304] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:31.069242 20224 consensus_queue.cc:1048] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.073707 20129 tablet_bootstrap.cc:654] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.079643 20278 raft_consensus.cc:3060] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.082267 20128 tablet_bootstrap.cc:654] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.089638 20127 tablet_bootstrap.cc:492] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:31.090135 20127 ts_tablet_manager.cc:1403] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.000s
I20260709 12:22:31.058478 20130 raft_consensus.cc:385] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.091145 20130 raft_consensus.cc:740] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.092909 20130 consensus_queue.cc:260] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.093449 20127 raft_consensus.cc:359] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.102600 20127 raft_consensus.cc:385] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.102927 20127 raft_consensus.cc:740] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.103804 20127 consensus_queue.cc:260] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.105031 20130 ts_tablet_manager.cc:1434] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:22:31.091629 20133 raft_consensus.cc:515] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.098830 19758 catalog_manager.cc:5697] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.100237 20129 tablet_bootstrap.cc:492] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:31.101387 20128 tablet_bootstrap.cc:492] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:31.102104 19858 raft_consensus.cc:2468] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:31.105901 20278 raft_consensus.cc:2749] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:31.112005 20129 ts_tablet_manager.cc:1403] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.000s
I20260709 12:22:31.106333 20127 ts_tablet_manager.cc:1434] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 12:22:31.113986 20128 ts_tablet_manager.cc:1403] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.008s
I20260709 12:22:31.106225 20130 tablet_bootstrap.cc:492] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:31.114012 20133 leader_election.cc:290] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:31.117091 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd824adf5e1e4a799b2ed798ae40d3a3" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:31.134182 20081 raft_consensus.cc:3060] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.134790 20128 raft_consensus.cc:359] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.135639 20128 raft_consensus.cc:385] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.135922 20128 raft_consensus.cc:740] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.119014 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd824adf5e1e4a799b2ed798ae40d3a3" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:31.137133 20128 consensus_queue.cc:260] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.137694 19858 raft_consensus.cc:3060] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.139593 20128 ts_tablet_manager.cc:1434] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:31.139535 19755 catalog_manager.cc:5697] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.140851 20128 tablet_bootstrap.cc:492] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:31.122638 20129 raft_consensus.cc:359] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.142454 20129 raft_consensus.cc:385] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.131489 20127 tablet_bootstrap.cc:492] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:31.143064 20129 raft_consensus.cc:740] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.143879 20129 consensus_queue.cc:260] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.122421 20282 consensus_queue.cc:1048] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.146756 20264 consensus_queue.cc:1048] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.149899 20264 raft_consensus.cc:493] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.150439 20264 raft_consensus.cc:515] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.153945 20264 leader_election.cc:290] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:31.159353 20130 tablet_bootstrap.cc:654] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.154511 20127 tablet_bootstrap.cc:654] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.155195 20081 raft_consensus.cc:2468] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:31.155836 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956c270268242f88a839bc03d3d5d62" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:31.166946 20084 raft_consensus.cc:2468] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:31.156268 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956c270268242f88a839bc03d3d5d62" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:31.168160 19933 raft_consensus.cc:2468] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:31.160279 19858 raft_consensus.cc:2468] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:31.171849 20128 tablet_bootstrap.cc:654] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.171712 19975 leader_election.cc:304] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:31.173292 19975 leader_election.cc:304] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:31.162257 20261 raft_consensus.cc:493] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.183211 20261 raft_consensus.cc:515] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.158553 20129 ts_tablet_manager.cc:1434] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.039s	user 0.012s	sys 0.002s
I20260709 12:22:31.183082 20279 consensus_queue.cc:1048] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:31.185695 20261 leader_election.cc:290] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:31.185891 20129 tablet_bootstrap.cc:492] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:31.192698 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fd600b97cc4962a0c2aa0ea2192e27" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:31.193423 20010 raft_consensus.cc:2468] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:31.193604 20130 tablet_bootstrap.cc:492] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:31.194113 20130 ts_tablet_manager.cc:1403] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.002s
I20260709 12:22:31.197204 20130 raft_consensus.cc:359] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.197865 20130 raft_consensus.cc:385] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.198130 20130 raft_consensus.cc:740] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.198738 20130 consensus_queue.cc:260] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.200907 20130 ts_tablet_manager.cc:1434] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:31.201915 20130 tablet_bootstrap.cc:492] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:31.203974 19902 leader_election.cc:304] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:31.205070 20261 raft_consensus.cc:2804] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.205504 20261 raft_consensus.cc:493] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.205942 20261 raft_consensus.cc:3060] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.206861 20128 tablet_bootstrap.cc:492] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:31.207645 20128 ts_tablet_manager.cc:1403] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.067s	user 0.026s	sys 0.015s
I20260709 12:22:31.173908 20264 raft_consensus.cc:2804] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.209981 20264 raft_consensus.cc:493] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.215054 20224 raft_consensus.cc:2804] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.215236 20130 tablet_bootstrap.cc:654] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.215728 20224 raft_consensus.cc:697] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:31.216663 20224 consensus_queue.cc:237] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.210157 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fd600b97cc4962a0c2aa0ea2192e27" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:31.211620 20279 raft_consensus.cc:493] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.214054 20128 raft_consensus.cc:359] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.218174 20129 tablet_bootstrap.cc:654] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.220525 20128 raft_consensus.cc:385] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.221032 20128 raft_consensus.cc:740] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.224615 20130 tablet_bootstrap.cc:492] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:31.225510 20130 ts_tablet_manager.cc:1403] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 12:22:31.225119 20279 raft_consensus.cc:515] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.228822 20130 raft_consensus.cc:359] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.229528 20130 raft_consensus.cc:385] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.229790 20130 raft_consensus.cc:740] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.230465 20130 consensus_queue.cc:260] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.233876 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7e36fa79c74c6c9f841770de353a62" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:31.234822 19858 raft_consensus.cc:2468] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:31.235882 20210 raft_consensus.cc:493] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.235956 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7e36fa79c74c6c9f841770de353a62" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:31.236651 20210 raft_consensus.cc:515] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.236905 20010 raft_consensus.cc:2468] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:31.236122 20279 leader_election.cc:290] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:31.238790 20050 leader_election.cc:304] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:31.239097 20210 leader_election.cc:290] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:31.239711 20210 raft_consensus.cc:2804] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.240093 20210 raft_consensus.cc:493] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.240480 20210 raft_consensus.cc:3060] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.240697 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d943a11750804b61969f012e4f945c2d" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:31.225152 20128 consensus_queue.cc:260] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.241016 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d943a11750804b61969f012e4f945c2d" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:31.241345 19859 raft_consensus.cc:2468] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:31.245807 19935 raft_consensus.cc:2468] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
W20260709 12:22:31.251946 20050 leader_election.cc:343] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.253149 20049 leader_election.cc:304] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:31.255620 20279 raft_consensus.cc:2804] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.256026 20279 raft_consensus.cc:493] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.256374 20279 raft_consensus.cc:3060] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.231180 20264 raft_consensus.cc:3060] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.263543 20128 ts_tablet_manager.cc:1434] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.001s
I20260709 12:22:31.269757 20169 consensus_queue.cc:1048] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:31.285343 20127 tablet_bootstrap.cc:492] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:31.285974 20127 ts_tablet_manager.cc:1403] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.164s	user 0.015s	sys 0.006s
I20260709 12:22:31.285630 20183 consensus_queue.cc:1048] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:31.298910 20130 ts_tablet_manager.cc:1434] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 12:22:31.300264 20128 tablet_bootstrap.cc:492] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:31.305773 20130 tablet_bootstrap.cc:492] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:31.310806 20261 raft_consensus.cc:515] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.316653 20261 leader_election.cc:290] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:31.318758 20183 consensus_queue.cc:1048] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.320538 20169 consensus_queue.cc:1048] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.323987 20127 raft_consensus.cc:359] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.324692 20127 raft_consensus.cc:385] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.324950 20127 raft_consensus.cc:740] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.323300 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fd600b97cc4962a0c2aa0ea2192e27" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:31.325630 20127 consensus_queue.cc:260] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.326220 19858 raft_consensus.cc:3060] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.325407 19756 catalog_manager.cc:5697] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.332240 20166 raft_consensus.cc:493] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.333567 20140 consensus_queue.cc:1048] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:31.333635 20166 raft_consensus.cc:515] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.339183 20129 tablet_bootstrap.cc:492] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:31.339716 20129 ts_tablet_manager.cc:1403] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.154s	user 0.017s	sys 0.016s
I20260709 12:22:31.342857 20129 raft_consensus.cc:359] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.343542 20129 raft_consensus.cc:385] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.343796 20129 raft_consensus.cc:740] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.344455 20129 consensus_queue.cc:260] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.345932 20129 ts_tablet_manager.cc:1434] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:31.346875 20129 tablet_bootstrap.cc:492] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:31.349102 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fd600b97cc4962a0c2aa0ea2192e27" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:31.349746 20010 raft_consensus.cc:3060] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.350557 20282 consensus_queue.cc:1048] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.336102 20279 raft_consensus.cc:515] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.353909 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d943a11750804b61969f012e4f945c2d" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:31.357249 20129 tablet_bootstrap.cc:654] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:31.358954 20050 leader_election.cc:343] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.359010 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19aff8bcdbb4bd29e22cb5f7f4cc1e6" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:31.360064 20279 leader_election.cc:290] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:31.364388 20127 ts_tablet_manager.cc:1434] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.001s
W20260709 12:22:31.374898 19826 leader_election.cc:343] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.375137 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d943a11750804b61969f012e4f945c2d" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:31.375849 19860 raft_consensus.cc:3060] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.355201 19858 raft_consensus.cc:2468] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:31.332643 20224 consensus_queue.cc:1048] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 12:22:31.396042 20127 tablet_bootstrap.cc:492] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:31.385742 20166 leader_election.cc:290] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
W20260709 12:22:31.399339 20323 log.cc:927] Time spent T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:22:31.396039 20210 raft_consensus.cc:515] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.408879 20130 tablet_bootstrap.cc:654] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.411091 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7e36fa79c74c6c9f841770de353a62" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:31.411805 20007 raft_consensus.cc:3060] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.412016 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7e36fa79c74c6c9f841770de353a62" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:31.412659 19933 raft_consensus.cc:3060] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.414283 19860 raft_consensus.cc:2468] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:31.415624 20210 leader_election.cc:290] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:31.411530 19901 leader_election.cc:304] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:31.422485 20128 tablet_bootstrap.cc:654] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.423887 20261 raft_consensus.cc:2804] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.424451 20261 raft_consensus.cc:697] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:31.424866 20049 leader_election.cc:304] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:31.425283 20261 consensus_queue.cc:237] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.426151 20282 raft_consensus.cc:2804] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.426630 20282 raft_consensus.cc:697] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:31.427183 20007 raft_consensus.cc:2468] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:31.427500 20282 consensus_queue.cc:237] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.420162 20140 consensus_queue.cc:1048] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.432996 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19aff8bcdbb4bd29e22cb5f7f4cc1e6" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
W20260709 12:22:31.434917 19827 leader_election.cc:343] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.433573 20264 raft_consensus.cc:515] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.436239 19827 leader_election.cc:304] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:31.439042 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956c270268242f88a839bc03d3d5d62" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:31.439515 20127 tablet_bootstrap.cc:654] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.439755 19936 raft_consensus.cc:3060] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.440742 20050 leader_election.cc:304] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:31.442710 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956c270268242f88a839bc03d3d5d62" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:31.443367 20081 raft_consensus.cc:3060] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.444721 20264 leader_election.cc:290] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:31.445902 20279 raft_consensus.cc:2804] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.446404 20279 raft_consensus.cc:697] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:31.466370 20081 raft_consensus.cc:2468] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:31.468822 20280 consensus_queue.cc:1048] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:31.478449 20330 raft_consensus.cc:2749] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:31.447273 20279 consensus_queue.cc:237] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
W20260709 12:22:31.481498 19806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:31.485786 20130 tablet_bootstrap.cc:492] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:31.486510 20130 ts_tablet_manager.cc:1403] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.182s	user 0.008s	sys 0.011s
I20260709 12:22:31.509506 20129 tablet_bootstrap.cc:492] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:31.510036 20129 ts_tablet_manager.cc:1403] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.163s	user 0.009s	sys 0.010s
I20260709 12:22:31.531263 19975 leader_election.cc:304] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:31.532127 20224 raft_consensus.cc:2804] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.532686 20224 raft_consensus.cc:697] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:31.533555 20224 consensus_queue.cc:237] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.539605 20129 raft_consensus.cc:359] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.544689 20129 raft_consensus.cc:385] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.545091 20129 raft_consensus.cc:740] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.537093 20010 raft_consensus.cc:2468] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:31.568251 20129 consensus_queue.cc:260] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.555950 19936 raft_consensus.cc:2468] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:31.587862 20129 ts_tablet_manager.cc:1434] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.002s
I20260709 12:22:31.600804 19759 catalog_manager.cc:5697] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 0 to 1, leader changed from <none> to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 1 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.602455 20130 raft_consensus.cc:359] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.617659 20130 raft_consensus.cc:385] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.618005 20130 raft_consensus.cc:740] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.618319 20280 consensus_queue.cc:1048] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.618709 20130 consensus_queue.cc:260] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.620976 20130 ts_tablet_manager.cc:1434] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.134s	user 0.007s	sys 0.000s
I20260709 12:22:31.622036 19933 raft_consensus.cc:2468] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:31.622751 20280 consensus_queue.cc:1048] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.623253 20129 tablet_bootstrap.cc:492] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:31.639019 20128 tablet_bootstrap.cc:492] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:31.639588 20128 ts_tablet_manager.cc:1403] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.343s	user 0.024s	sys 0.018s
I20260709 12:22:31.642455 20128 raft_consensus.cc:359] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.643158 20128 raft_consensus.cc:385] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.644945 20130 tablet_bootstrap.cc:492] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:31.645390 20127 tablet_bootstrap.cc:492] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:31.645931 20127 ts_tablet_manager.cc:1403] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.262s	user 0.017s	sys 0.015s
I20260709 12:22:31.650166 20128 raft_consensus.cc:740] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.653101 20130 tablet_bootstrap.cc:654] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.652956 20127 raft_consensus.cc:359] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.653784 20127 raft_consensus.cc:385] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.654089 20127 raft_consensus.cc:740] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.653635 19759 catalog_manager.cc:5697] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.654788 20127 consensus_queue.cc:260] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.655356 19759 catalog_manager.cc:5697] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.656288 20128 consensus_queue.cc:260] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.662555 20224 consensus_queue.cc:1048] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:31.677810 20128 ts_tablet_manager.cc:1434] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:22:31.679020 20128 tablet_bootstrap.cc:492] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:31.686019 20128 tablet_bootstrap.cc:654] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.687242 20224 raft_consensus.cc:493] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.688009 20224 raft_consensus.cc:515] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.668052 20129 tablet_bootstrap.cc:654] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.697955 20128 tablet_bootstrap.cc:492] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:31.698670 20128 ts_tablet_manager.cc:1403] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:22:31.698089 20127 ts_tablet_manager.cc:1434] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:22:31.700760 20127 tablet_bootstrap.cc:492] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:31.701758 20128 raft_consensus.cc:359] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.702544 20128 raft_consensus.cc:385] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.702840 20128 raft_consensus.cc:740] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.703584 20128 consensus_queue.cc:260] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.706414 20128 ts_tablet_manager.cc:1434] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:31.707831 20128 tablet_bootstrap.cc:492] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:31.712181 20224 leader_election.cc:290] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:31.714741 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f383be5926e94960a9e3a9481d19e8d9" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:31.715502 19936 raft_consensus.cc:2468] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:31.715715 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f383be5926e94960a9e3a9481d19e8d9" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:31.716409 19860 raft_consensus.cc:2468] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:31.717870 20129 tablet_bootstrap.cc:492] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:31.718484 20129 ts_tablet_manager.cc:1403] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.002s
I20260709 12:22:31.720914 20128 tablet_bootstrap.cc:654] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.721661 20129 raft_consensus.cc:359] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.722493 20129 raft_consensus.cc:385] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.722803 20129 raft_consensus.cc:740] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.723631 20129 consensus_queue.cc:260] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.724498 19975 leader_election.cc:304] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:31.725337 20127 tablet_bootstrap.cc:654] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.725540 20224 raft_consensus.cc:2804] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.725983 20224 raft_consensus.cc:493] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.726402 20224 raft_consensus.cc:3060] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.728719 20129 ts_tablet_manager.cc:1434] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:22:31.732733 20129 tablet_bootstrap.cc:492] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:31.736392 20224 raft_consensus.cc:515] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.737584 20261 raft_consensus.cc:493] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.738154 20261 raft_consensus.cc:515] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.740921 20261 leader_election.cc:290] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:31.741544 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b19f486bdbe4ad6ad645409c3a27940" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:31.742342 20084 raft_consensus.cc:2468] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:31.743623 19901 leader_election.cc:304] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:31.745003 20261 raft_consensus.cc:2804] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.742549 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b19f486bdbe4ad6ad645409c3a27940" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:31.745400 20261 raft_consensus.cc:493] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.745834 20261 raft_consensus.cc:3060] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.736124 19756 catalog_manager.cc:5697] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:31.748056 19901 leader_election.cc:343] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.763861 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f383be5926e94960a9e3a9481d19e8d9" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:31.764384 20133 consensus_queue.cc:1048] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.764626 19858 raft_consensus.cc:3060] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.770603 20130 tablet_bootstrap.cc:492] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:31.771128 20130 ts_tablet_manager.cc:1403] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.126s	user 0.032s	sys 0.059s
I20260709 12:22:31.774086 20130 raft_consensus.cc:359] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.774812 20130 raft_consensus.cc:385] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.775101 20130 raft_consensus.cc:740] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.776072 20130 consensus_queue.cc:260] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.777716 20130 ts_tablet_manager.cc:1434] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:31.778720 20130 tablet_bootstrap.cc:492] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:31.784925 20130 tablet_bootstrap.cc:654] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.788511 19858 raft_consensus.cc:2468] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:31.758795 20261 raft_consensus.cc:515] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.793358 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b19f486bdbe4ad6ad645409c3a27940" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:31.794317 20081 raft_consensus.cc:3060] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.794615 20261 leader_election.cc:290] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:31.795984 20165 raft_consensus.cc:493] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.796716 20165 raft_consensus.cc:515] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.798959 20127 tablet_bootstrap.cc:492] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:31.799531 20127 ts_tablet_manager.cc:1403] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.005s
I20260709 12:22:31.799903 19975 leader_election.cc:304] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:31.762143 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f383be5926e94960a9e3a9481d19e8d9" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:31.801788 19936 raft_consensus.cc:3060] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.801857 20133 raft_consensus.cc:2804] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.802127 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1caa8a675041d28e2eb5045f7e6a4a" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:31.802866 19861 raft_consensus.cc:2468] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:31.802927 20133 raft_consensus.cc:697] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:31.804162 20129 tablet_bootstrap.cc:654] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.804437 20049 leader_election.cc:304] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:31.805335 20282 raft_consensus.cc:2804] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.800850 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1caa8a675041d28e2eb5045f7e6a4a" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:31.805765 20282 raft_consensus.cc:493] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.806182 20282 raft_consensus.cc:3060] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.804916 20133 consensus_queue.cc:237] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
W20260709 12:22:31.807989 20050 leader_election.cc:343] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.809351 19936 raft_consensus.cc:2468] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:31.754658 20128 tablet_bootstrap.cc:492] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:31.810618 20128 ts_tablet_manager.cc:1403] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.005s
I20260709 12:22:31.811527 20165 leader_election.cc:290] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:31.813550 20128 raft_consensus.cc:359] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.814244 20128 raft_consensus.cc:385] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.814527 20128 raft_consensus.cc:740] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.760766 20224 leader_election.cc:290] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:31.802706 20127 raft_consensus.cc:359] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.815147 20282 raft_consensus.cc:515] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.815196 20128 consensus_queue.cc:260] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.825521 20210 raft_consensus.cc:493] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.854985 20128 ts_tablet_manager.cc:1434] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.044s	user 0.017s	sys 0.005s
I20260709 12:22:31.855250 20210 raft_consensus.cc:515] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:31.857366 20128 tablet_bootstrap.cc:492] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:31.858523 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0efb7c87754b739cb88f4e13cb66c6" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:31.858971 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1caa8a675041d28e2eb5045f7e6a4a" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
W20260709 12:22:31.860165 20049 leader_election.cc:343] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:31.862540 20050 leader_election.cc:343] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.865346 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0efb7c87754b739cb88f4e13cb66c6" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:31.869621 20081 raft_consensus.cc:2468] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:31.870584 20128 tablet_bootstrap.cc:654] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.870994 19901 leader_election.cc:304] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:31.871013 20282 leader_election.cc:290] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:31.872202 20261 raft_consensus.cc:2804] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.872855 20261 raft_consensus.cc:697] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:31.873776 20261 consensus_queue.cc:237] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
W20260709 12:22:31.877218 20049 leader_election.cc:343] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.877800 20049 leader_election.cc:304] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:31.877941 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1caa8a675041d28e2eb5045f7e6a4a" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:31.878772 19858 raft_consensus.cc:3060] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.862965 20210 leader_election.cc:290] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:31.882112 20210 raft_consensus.cc:2749] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:31.815879 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b19f486bdbe4ad6ad645409c3a27940" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
W20260709 12:22:31.885435 19901 leader_election.cc:343] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.887593 20127 raft_consensus.cc:385] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.888110 20127 raft_consensus.cc:740] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.889035 20127 consensus_queue.cc:260] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:31.892815 20129 tablet_bootstrap.cc:492] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:31.920429 20129 ts_tablet_manager.cc:1403] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.188s	user 0.018s	sys 0.050s
I20260709 12:22:31.924259 20129 raft_consensus.cc:359] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.925475 20129 raft_consensus.cc:385] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.925884 20129 raft_consensus.cc:740] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.891834 20127 ts_tablet_manager.cc:1434] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.092s	user 0.004s	sys 0.005s
I20260709 12:22:31.926693 20267 consensus_queue.cc:1048] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:31.927919 20127 tablet_bootstrap.cc:492] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:31.932618 20165 consensus_queue.cc:1048] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.933892 20128 tablet_bootstrap.cc:492] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:31.936030 20128 ts_tablet_manager.cc:1403] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.023s
I20260709 12:22:31.945693 20165 consensus_queue.cc:1048] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:31.926743 20129 consensus_queue.cc:260] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.890514 19858 raft_consensus.cc:2468] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:31.954898 20049 leader_election.cc:304] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:31.956756 20165 raft_consensus.cc:2804] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.957532 20165 raft_consensus.cc:697] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:31.920780 19757 catalog_manager.cc:5697] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.959053 20165 consensus_queue.cc:237] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:31.978233 20129 ts_tablet_manager.cc:1434] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 12:22:31.977983 20128 raft_consensus.cc:359] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.978850 20128 raft_consensus.cc:385] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.979157 20128 raft_consensus.cc:740] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.979414 20129 tablet_bootstrap.cc:492] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:31.979874 20128 consensus_queue.cc:260] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.981940 20128 ts_tablet_manager.cc:1434] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.046s	user 0.000s	sys 0.004s
I20260709 12:22:31.982992 20128 tablet_bootstrap.cc:492] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:31.983112 20133 raft_consensus.cc:493] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.985306 20282 consensus_queue.cc:1048] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.983728 20133 raft_consensus.cc:515] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:31.990521 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dee8a7582284ad8a4edbc4d53c02cf2" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
W20260709 12:22:31.995095 19975 leader_election.cc:343] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.997434 20133 leader_election.cc:290] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:31.997748 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dee8a7582284ad8a4edbc4d53c02cf2" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
W20260709 12:22:32.002493 19975 leader_election.cc:343] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.002997 19975 leader_election.cc:304] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:32.004225 20264 raft_consensus.cc:2749] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:32.007085 20128 tablet_bootstrap.cc:654] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:32.010535 20050 consensus_peers.cc:597] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 -> Peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Couldn't send request to peer 86ad94e539f24675ba7226e7371cec9b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:32.012754 20130 tablet_bootstrap.cc:492] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:32.013269 20130 ts_tablet_manager.cc:1403] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.235s	user 0.031s	sys 0.053s
I20260709 12:22:32.016225 20130 raft_consensus.cc:359] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.016925 20130 raft_consensus.cc:385] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.017180 19756 catalog_manager.cc:5697] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 0 to 1, leader changed from <none> to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 1 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.017199 20130 raft_consensus.cc:740] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.021198 20130 consensus_queue.cc:260] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.025625 20130 ts_tablet_manager.cc:1434] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:22:32.026718 20130 tablet_bootstrap.cc:492] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:32.028929 20127 tablet_bootstrap.cc:654] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.032841 20130 tablet_bootstrap.cc:654] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.034149 20129 tablet_bootstrap.cc:654] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.045445 20127 tablet_bootstrap.cc:492] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:32.046118 20127 ts_tablet_manager.cc:1403] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.004s
I20260709 12:22:32.049908 20129 tablet_bootstrap.cc:492] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:32.049908 20128 tablet_bootstrap.cc:492] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:32.050655 20128 ts_tablet_manager.cc:1403] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.001s
I20260709 12:22:32.053128 20127 raft_consensus.cc:359] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.053341 20128 raft_consensus.cc:359] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.054005 20127 raft_consensus.cc:385] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.054057 20128 raft_consensus.cc:385] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.054553 20127 raft_consensus.cc:740] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.054615 20128 raft_consensus.cc:740] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.055419 20128 consensus_queue.cc:260] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.050655 20129 ts_tablet_manager.cc:1403] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 12:22:32.058194 20128 ts_tablet_manager.cc:1434] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:32.059196 20128 tablet_bootstrap.cc:492] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:32.059535 20264 consensus_queue.cc:1048] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.061443 20129 raft_consensus.cc:359] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.062258 20129 raft_consensus.cc:385] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.063175 20129 raft_consensus.cc:740] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.064647 20127 consensus_queue.cc:260] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.064810 20129 consensus_queue.cc:260] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.066941 20127 ts_tablet_manager.cc:1434] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:22:32.068749 20129 ts_tablet_manager.cc:1434] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:22:32.069574 20128 tablet_bootstrap.cc:654] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.069885 20129 tablet_bootstrap.cc:492] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:32.070500 20127 tablet_bootstrap.cc:492] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:32.082118 20362 consensus_queue.cc:1048] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:32.083278 20127 tablet_bootstrap.cc:654] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.087879 20130 tablet_bootstrap.cc:492] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:32.088398 20130 ts_tablet_manager.cc:1403] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.008s
I20260709 12:22:32.090962 20129 tablet_bootstrap.cc:654] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.091651 20130 raft_consensus.cc:359] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.092468 20130 raft_consensus.cc:385] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.092762 20130 raft_consensus.cc:740] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.093538 20130 consensus_queue.cc:260] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.096212 20130 ts_tablet_manager.cc:1434] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:32.097333 20130 tablet_bootstrap.cc:492] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:32.097983 20127 tablet_bootstrap.cc:492] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:32.098534 20127 ts_tablet_manager.cc:1403] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 12:22:32.099339 20133 raft_consensus.cc:493] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.099865 20133 raft_consensus.cc:515] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.101544 20127 raft_consensus.cc:359] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.101936 20133 leader_election.cc:290] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:32.102708 20127 raft_consensus.cc:385] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.103061 20127 raft_consensus.cc:740] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.103790 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "240e5e8e04aa4ce2bbff8d21eb78a76c" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:32.103938 20127 consensus_queue.cc:260] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.104482 20084 raft_consensus.cc:2468] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:32.104611 20130 tablet_bootstrap.cc:654] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.106491 19975 leader_election.cc:304] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:32.109668 20127 ts_tablet_manager.cc:1434] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:22:32.110268 20133 raft_consensus.cc:2804] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.110659 20133 raft_consensus.cc:493] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.111174 20133 raft_consensus.cc:3060] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.110730 20127 tablet_bootstrap.cc:492] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:32.115805 20362 raft_consensus.cc:493] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.115705 20264 consensus_queue.cc:1048] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:32.116641 20362 raft_consensus.cc:515] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.117504 20129 tablet_bootstrap.cc:492] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:32.118158 20129 ts_tablet_manager.cc:1403] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.005s
I20260709 12:22:32.120633 20362 leader_election.cc:290] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:32.121029 20129 raft_consensus.cc:359] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.121778 20129 raft_consensus.cc:385] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.122551 20129 raft_consensus.cc:740] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.123471 20129 consensus_queue.cc:260] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.129652 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19aff8bcdbb4bd29e22cb5f7f4cc1e6" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:32.130451 20008 raft_consensus.cc:2468] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:32.130936 20133 raft_consensus.cc:515] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.132552 19902 leader_election.cc:304] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:32.133467 20362 raft_consensus.cc:2804] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.134279 20362 raft_consensus.cc:493] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.134737 20362 raft_consensus.cc:3060] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.135167 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "240e5e8e04aa4ce2bbff8d21eb78a76c" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:32.135845 20084 raft_consensus.cc:3060] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.108359 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "240e5e8e04aa4ce2bbff8d21eb78a76c" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:32.143939 19936 raft_consensus.cc:2468] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:32.145182 20127 tablet_bootstrap.cc:654] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.154174 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "240e5e8e04aa4ce2bbff8d21eb78a76c" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:32.154989 19933 raft_consensus.cc:3060] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.143224 20129 ts_tablet_manager.cc:1434] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:22:32.157316 20129 tablet_bootstrap.cc:492] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:32.158205 20127 tablet_bootstrap.cc:492] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:32.158798 20127 ts_tablet_manager.cc:1403] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.000s
I20260709 12:22:32.161418 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19aff8bcdbb4bd29e22cb5f7f4cc1e6" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:32.161772 20127 raft_consensus.cc:359] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.162271 19861 raft_consensus.cc:2468] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:32.162583 20127 raft_consensus.cc:385] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.162971 20127 raft_consensus.cc:740] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.163846 20127 consensus_queue.cc:260] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.165939 20127 ts_tablet_manager.cc:1434] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:22:32.166905 20127 tablet_bootstrap.cc:492] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:32.155714 20084 raft_consensus.cc:2468] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:32.172838 19975 leader_election.cc:304] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:32.173810 20264 raft_consensus.cc:2804] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.174366 20264 raft_consensus.cc:697] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:32.175819 20264 consensus_queue.cc:237] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.176632 20127 tablet_bootstrap.cc:654] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.181015 20129 tablet_bootstrap.cc:654] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.133483 20133 leader_election.cc:290] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:32.189277 20128 tablet_bootstrap.cc:492] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:32.194003 20128 ts_tablet_manager.cc:1403] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.010s
I20260709 12:22:32.192456 20133 raft_consensus.cc:493] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.201702 20133 raft_consensus.cc:515] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.204886 19759 catalog_manager.cc:5697] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.193194 19933 raft_consensus.cc:2468] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:32.200730 20280 raft_consensus.cc:493] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.207022 20280 raft_consensus.cc:515] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.209326 20128 raft_consensus.cc:359] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.211159 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "551cd77f8f81497eaf0336d9004c56cd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:32.212375 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1caa8a675041d28e2eb5045f7e6a4a" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
W20260709 12:22:32.220022 20050 leader_election.cc:343] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.220793 20128 raft_consensus.cc:385] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.221346 20128 raft_consensus.cc:740] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.214171 20280 leader_election.cc:290] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:32.215305 20129 tablet_bootstrap.cc:492] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:32.224299 20129 ts_tablet_manager.cc:1403] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.000s
I20260709 12:22:32.224741 20127 tablet_bootstrap.cc:492] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:32.225334 20127 ts_tablet_manager.cc:1403] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.025s
I20260709 12:22:32.217085 20133 leader_election.cc:290] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:32.215116 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "551cd77f8f81497eaf0336d9004c56cd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:32.228376 20049 leader_election.cc:343] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.229018 20049 leader_election.cc:304] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:32.230182 20169 raft_consensus.cc:493] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.223686 20128 consensus_queue.cc:260] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.228296 20129 raft_consensus.cc:359] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.230515 20127 raft_consensus.cc:359] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.230762 20169 raft_consensus.cc:515] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.234576 20127 raft_consensus.cc:385] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.234999 20127 raft_consensus.cc:740] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.235780 20127 consensus_queue.cc:260] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.236994 20169 leader_election.cc:290] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:32.238158 20127 ts_tablet_manager.cc:1434] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:22:32.239395 20127 tablet_bootstrap.cc:492] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:32.240984 20165 raft_consensus.cc:2749] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:32.243386 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b19f486bdbe4ad6ad645409c3a27940" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:32.246031 20127 tablet_bootstrap.cc:654] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.190527 20362 raft_consensus.cc:515] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.246938 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b19f486bdbe4ad6ad645409c3a27940" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:32.247912 20081 raft_consensus.cc:2393] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in this term.
I20260709 12:22:32.233583 20129 raft_consensus.cc:385] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.248857 20129 raft_consensus.cc:740] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.249861 20129 consensus_queue.cc:260] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.253700 20129 ts_tablet_manager.cc:1434] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:22:32.255172 20129 tablet_bootstrap.cc:492] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:32.258170 20127 tablet_bootstrap.cc:492] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:32.258782 20127 ts_tablet_manager.cc:1403] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 12:22:32.233395 20128 ts_tablet_manager.cc:1434] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 12:22:32.261039 20128 tablet_bootstrap.cc:492] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:32.262108 20127 raft_consensus.cc:359] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.262938 20127 raft_consensus.cc:385] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.263330 20127 raft_consensus.cc:740] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.264324 20127 consensus_queue.cc:260] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.265058 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1caa8a675041d28e2eb5045f7e6a4a" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:32.265980 19861 raft_consensus.cc:2393] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86ad94e539f24675ba7226e7371cec9b in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:32.266594 20130 tablet_bootstrap.cc:492] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:32.267132 20130 ts_tablet_manager.cc:1403] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.170s	user 0.062s	sys 0.081s
I20260709 12:22:32.268606 20127 ts_tablet_manager.cc:1434] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:32.269766 20127 tablet_bootstrap.cc:492] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:32.270561 19975 leader_election.cc:304] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:32.271215 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19aff8bcdbb4bd29e22cb5f7f4cc1e6" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:32.271551 20133 raft_consensus.cc:3060] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.271947 20008 raft_consensus.cc:3060] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.272799 20362 leader_election.cc:290] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:32.275197 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19aff8bcdbb4bd29e22cb5f7f4cc1e6" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:32.270526 20130 raft_consensus.cc:359] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.275928 20130 raft_consensus.cc:385] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.276434 20130 raft_consensus.cc:740] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.277523 20130 consensus_queue.cc:260] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.275913 19861 raft_consensus.cc:3060] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.279935 20130 ts_tablet_manager.cc:1434] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:22:32.281036 20130 tablet_bootstrap.cc:492] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:32.281092 20133 raft_consensus.cc:2749] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:32.286907 20129 tablet_bootstrap.cc:654] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.287768 20127 tablet_bootstrap.cc:654] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.288216 20130 tablet_bootstrap.cc:654] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.302893 19861 raft_consensus.cc:2468] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:32.290612 20008 raft_consensus.cc:2468] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:32.306200 19902 leader_election.cc:304] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:32.308048 20261 raft_consensus.cc:493] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.308706 20261 raft_consensus.cc:515] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.311141 20261 leader_election.cc:290] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:32.313638 20261 raft_consensus.cc:2804] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.314280 20261 raft_consensus.cc:697] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:32.313848 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dee8a7582284ad8a4edbc4d53c02cf2" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:32.315415 20261 consensus_queue.cc:237] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.316011 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dee8a7582284ad8a4edbc4d53c02cf2" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:32.317068 20009 raft_consensus.cc:2468] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:32.319191 19902 leader_election.cc:304] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:32.291141 19826 leader_election.cc:304] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:32.320436 20267 raft_consensus.cc:2804] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.321022 20267 raft_consensus.cc:493] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.321532 20267 raft_consensus.cc:3060] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.321617 20140 raft_consensus.cc:3060] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.323482 20127 tablet_bootstrap.cc:492] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:32.324066 20127 ts_tablet_manager.cc:1403] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.002s
I20260709 12:22:32.327322 20127 raft_consensus.cc:359] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.328110 20127 raft_consensus.cc:385] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.328425 20127 raft_consensus.cc:740] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.315304 20081 raft_consensus.cc:2468] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:32.329167 20127 consensus_queue.cc:260] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.335131 20133 consensus_queue.cc:1048] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.336081 20128 tablet_bootstrap.cc:654] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.346562 20140 raft_consensus.cc:2749] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:32.352056 20127 ts_tablet_manager.cc:1434] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:22:32.353223 20127 tablet_bootstrap.cc:492] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:32.353611 20130 tablet_bootstrap.cc:492] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:32.354183 20130 ts_tablet_manager.cc:1403] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.073s	user 0.028s	sys 0.029s
I20260709 12:22:32.357324 20130 raft_consensus.cc:359] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.358019 20130 raft_consensus.cc:385] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.358310 20130 raft_consensus.cc:740] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.359097 20130 consensus_queue.cc:260] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.361358 20130 ts_tablet_manager.cc:1434] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:32.361487 20129 tablet_bootstrap.cc:492] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:32.362269 20129 ts_tablet_manager.cc:1403] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.005s
I20260709 12:22:32.362488 20130 tablet_bootstrap.cc:492] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:32.366597 20129 raft_consensus.cc:359] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.370538 20267 raft_consensus.cc:515] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.371469 20129 raft_consensus.cc:385] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.371915 20129 raft_consensus.cc:740] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.372720 20129 consensus_queue.cc:260] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.375102 20129 ts_tablet_manager.cc:1434] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:22:32.376570 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dee8a7582284ad8a4edbc4d53c02cf2" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:32.377310 20009 raft_consensus.cc:3060] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.378024 20129 tablet_bootstrap.cc:492] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:32.378669 20127 tablet_bootstrap.cc:654] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.383289 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dee8a7582284ad8a4edbc4d53c02cf2" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:32.384066 20081 raft_consensus.cc:3060] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.376609 20267 leader_election.cc:290] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:32.386086 20169 raft_consensus.cc:493] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.386677 20169 raft_consensus.cc:515] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.375586 19757 catalog_manager.cc:5697] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 0 to 1, leader changed from <none> to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 1 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.366756 19755 catalog_manager.cc:5697] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.394757 20169 leader_election.cc:290] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:32.395035 20081 raft_consensus.cc:2468] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:32.396488 19901 leader_election.cc:304] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:32.397516 20267 raft_consensus.cc:2804] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.398278 20267 raft_consensus.cc:697] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:32.399212 20267 consensus_queue.cc:237] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.406157 20129 tablet_bootstrap.cc:654] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.382540 20130 tablet_bootstrap.cc:654] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.410863 20133 consensus_queue.cc:1048] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:32.411756 20264 raft_consensus.cc:493] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.412331 20264 raft_consensus.cc:515] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.414554 20264 leader_election.cc:290] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:32.418836 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0efb7c87754b739cb88f4e13cb66c6" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:32.419319 20128 tablet_bootstrap.cc:492] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:32.419634 20082 raft_consensus.cc:2468] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:32.420166 20362 consensus_queue.cc:1048] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.419952 20128 ts_tablet_manager.cc:1403] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.159s	user 0.024s	sys 0.005s
I20260709 12:22:32.421903 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0efb7c87754b739cb88f4e13cb66c6" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:32.422716 19933 raft_consensus.cc:2468] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:32.424190 20129 tablet_bootstrap.cc:492] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:32.424721 20129 ts_tablet_manager.cc:1403] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.005s
I20260709 12:22:32.425532 20128 raft_consensus.cc:359] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.426513 20128 raft_consensus.cc:385] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.426882 20128 raft_consensus.cc:740] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.427845 20129 raft_consensus.cc:359] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.428613 20129 raft_consensus.cc:385] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.428831 20128 consensus_queue.cc:260] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.431310 20362 consensus_queue.cc:1048] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:32.428894 20129 raft_consensus.cc:740] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.435880 20129 consensus_queue.cc:260] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.439320 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "551cd77f8f81497eaf0336d9004c56cd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:32.440456 20084 raft_consensus.cc:2468] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:32.440855 20128 ts_tablet_manager.cc:1434] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:22:32.456975 20129 ts_tablet_manager.cc:1434] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:22:32.457782 20128 tablet_bootstrap.cc:492] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:32.458140 20129 tablet_bootstrap.cc:492] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:32.442006 19975 leader_election.cc:304] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:32.463636 20133 raft_consensus.cc:2804] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.464152 20133 raft_consensus.cc:493] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.464598 20133 raft_consensus.cc:3060] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.467662 20128 tablet_bootstrap.cc:654] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.443269 19826 leader_election.cc:304] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:32.481019 20169 raft_consensus.cc:2804] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.481458 20129 tablet_bootstrap.cc:654] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.481524 20169 raft_consensus.cc:493] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.482115 20169 raft_consensus.cc:3060] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.487553 20165 consensus_queue.cc:1048] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:32.492209 20183 raft_consensus.cc:493] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.492892 20183 raft_consensus.cc:515] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.495399 20183 leader_election.cc:290] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:32.502871 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096a550b72b246c3b15fd4b627f51174" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:32.507930 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096a550b72b246c3b15fd4b627f51174" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:32.508893 20084 raft_consensus.cc:2468] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:32.511355 19975 leader_election.cc:304] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:32.512391 20183 raft_consensus.cc:2804] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.513015 20183 raft_consensus.cc:493] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.513571 20183 raft_consensus.cc:3060] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:32.514645 19975 leader_election.cc:343] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.518622 20128 tablet_bootstrap.cc:492] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:32.524782 20128 ts_tablet_manager.cc:1403] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.003s
I20260709 12:22:32.528748 20128 raft_consensus.cc:359] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.529788 20128 raft_consensus.cc:385] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.530158 20128 raft_consensus.cc:740] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.534365 20264 raft_consensus.cc:493] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.535148 20264 raft_consensus.cc:515] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.538054 20264 leader_election.cc:290] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:32.541095 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d943a11750804b61969f012e4f945c2d" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
W20260709 12:22:32.541932 19826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:36799, user_credentials={real_user=slave}} blocked reactor thread for 98762.3us
I20260709 12:22:32.530968 20128 consensus_queue.cc:260] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.547833 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "551cd77f8f81497eaf0336d9004c56cd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:32.549199 20128 ts_tablet_manager.cc:1434] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:22:32.550396 20128 tablet_bootstrap.cc:492] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:32.550854 20165 consensus_queue.cc:1048] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.560354 20264 raft_consensus.cc:493] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.562628 20264 raft_consensus.cc:515] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.570744 20010 raft_consensus.cc:3060] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.563308 20133 raft_consensus.cc:515] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.630942 20130 tablet_bootstrap.cc:492] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:32.578946 20128 tablet_bootstrap.cc:654] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.633361 20133 leader_election.cc:290] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:32.635686 20140 raft_consensus.cc:493] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.588766 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3835bda54b4d75a4985b5f514743a4" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:32.636421 20140 raft_consensus.cc:515] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.637753 20130 ts_tablet_manager.cc:1403] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.269s	user 0.038s	sys 0.065s
I20260709 12:22:32.641469 20140 leader_election.cc:290] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:32.646157 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "551cd77f8f81497eaf0336d9004c56cd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:32.646894 20084 raft_consensus.cc:3060] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.647306 20130 raft_consensus.cc:359] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.648070 20130 raft_consensus.cc:385] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.648360 20130 raft_consensus.cc:740] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.649204 20130 consensus_queue.cc:260] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.651346 20130 ts_tablet_manager.cc:1434] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 12:22:32.652313 20130 tablet_bootstrap.cc:492] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:32.656309 20128 tablet_bootstrap.cc:492] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:32.656870 20128 ts_tablet_manager.cc:1403] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.006s
I20260709 12:22:32.657356 20129 tablet_bootstrap.cc:492] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:32.657903 20129 ts_tablet_manager.cc:1403] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.200s	user 0.051s	sys 0.038s
I20260709 12:22:32.659713 20128 raft_consensus.cc:359] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.660454 20128 raft_consensus.cc:385] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.660740 20128 raft_consensus.cc:740] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.660825 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:32.661198 20129 raft_consensus.cc:359] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.661556 20081 raft_consensus.cc:2468] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:32.661461 20128 consensus_queue.cc:260] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.662817 20129 raft_consensus.cc:385] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.663162 20129 raft_consensus.cc:740] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.664134 20129 consensus_queue.cc:260] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.666543 20128 ts_tablet_manager.cc:1434] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:32.667272 20165 raft_consensus.cc:493] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.667609 20128 tablet_bootstrap.cc:492] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:32.667883 20165 raft_consensus.cc:515] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.671684 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d17d263a1240d09b5735c7adad3e3c" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:32.672067 20165 leader_election.cc:290] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:32.672551 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:32.672932 20129 ts_tablet_manager.cc:1434] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:22:32.673237 19935 raft_consensus.cc:2468] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:32.674032 20129 tablet_bootstrap.cc:492] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
W20260709 12:22:32.674610 20049 leader_election.cc:343] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.676156 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d17d263a1240d09b5735c7adad3e3c" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:32.676856 20130 tablet_bootstrap.cc:654] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:32.678169 20050 leader_election.cc:343] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.678685 20050 leader_election.cc:304] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:32.679569 20165 raft_consensus.cc:2749] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:32.682204 20129 tablet_bootstrap.cc:654] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.685000 20128 tablet_bootstrap.cc:654] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.687724 19826 leader_election.cc:304] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:32.693254 20128 tablet_bootstrap.cc:492] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:32.693825 20128 ts_tablet_manager.cc:1403] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:22:32.694293 20140 raft_consensus.cc:2804] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.694752 20140 raft_consensus.cc:493] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.694859 20129 tablet_bootstrap.cc:492] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:32.695147 20140 raft_consensus.cc:3060] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.695505 20129 ts_tablet_manager.cc:1403] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.006s
I20260709 12:22:32.696696 20128 raft_consensus.cc:359] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.697392 20128 raft_consensus.cc:385] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.697642 20128 raft_consensus.cc:740] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.698558 20129 raft_consensus.cc:359] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.699303 20129 raft_consensus.cc:385] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.699611 20129 raft_consensus.cc:740] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.700548 20129 consensus_queue.cc:260] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.703127 20129 ts_tablet_manager.cc:1434] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:32.704187 20129 tablet_bootstrap.cc:492] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:32.599690 20127 tablet_bootstrap.cc:492] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:32.594004 20009 raft_consensus.cc:2468] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:32.707227 20127 ts_tablet_manager.cc:1403] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.354s	user 0.036s	sys 0.041s
I20260709 12:22:32.706327 20128 consensus_queue.cc:260] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.710150 20128 ts_tablet_manager.cc:1434] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:22:32.711093 20128 tablet_bootstrap.cc:492] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:32.710906 20127 raft_consensus.cc:359] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.711687 20127 raft_consensus.cc:385] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.711958 20127 raft_consensus.cc:740] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.712734 20127 consensus_queue.cc:260] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.710611 20129 tablet_bootstrap.cc:654] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.716125 20127 ts_tablet_manager.cc:1434] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:32.717445 20127 tablet_bootstrap.cc:492] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
W20260709 12:22:32.721939 19975 leader_election.cc:343] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.722195 20361 consensus_queue.cc:1048] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.726634 20140 raft_consensus.cc:515] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.729871 20128 tablet_bootstrap.cc:654] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.733435 20165 raft_consensus.cc:493] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.734236 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:32.734078 20165 raft_consensus.cc:515] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.732884 20084 raft_consensus.cc:2468] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:32.614008 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d943a11750804b61969f012e4f945c2d" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:32.614910 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3835bda54b4d75a4985b5f514743a4" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:32.737020 20165 leader_election.cc:290] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:32.738726 19859 raft_consensus.cc:2468] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:32.739113 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:32.739521 20082 raft_consensus.cc:3060] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.619705 19759 catalog_manager.cc:5697] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 0 to 1, leader changed from <none> to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 1 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:32.740903 20049 leader_election.cc:343] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.626075 20267 raft_consensus.cc:493] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.744259 20267 raft_consensus.cc:515] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.756343 19936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:32.757560 20127 tablet_bootstrap.cc:654] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.757402 19936 raft_consensus.cc:3060] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.758253 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "551cd77f8f81497eaf0336d9004c56cd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:32.728971 20140 leader_election.cc:290] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:32.753333 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:32.761965 20130 tablet_bootstrap.cc:492] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:32.762537 20130 ts_tablet_manager.cc:1403] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.110s	user 0.020s	sys 0.006s
I20260709 12:22:32.762389 20082 raft_consensus.cc:2468] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
W20260709 12:22:32.766484 20049 leader_election.cc:343] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.766798 20130 raft_consensus.cc:359] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.767339 20049 leader_election.cc:304] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:32.769217 20280 raft_consensus.cc:2749] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:32.773825 20127 tablet_bootstrap.cc:492] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:32.774398 20127 ts_tablet_manager.cc:1403] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.000s
I20260709 12:22:32.777323 20127 raft_consensus.cc:359] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.778007 20127 raft_consensus.cc:385] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.778264 20127 raft_consensus.cc:740] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.779541 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3835bda54b4d75a4985b5f514743a4" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:32.781916 19858 raft_consensus.cc:2468] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:32.747370 20267 leader_election.cc:290] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:32.785212 20127 consensus_queue.cc:260] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.785427 19933 raft_consensus.cc:2468] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:32.789188 20127 ts_tablet_manager.cc:1434] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:22:32.799304 20127 tablet_bootstrap.cc:492] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:32.573453 20264 leader_election.cc:290] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:32.628144 20169 raft_consensus.cc:515] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.803085 19901 leader_election.cc:304] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:32.804060 20267 raft_consensus.cc:2804] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.804430 20267 raft_consensus.cc:493] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.804766 20267 raft_consensus.cc:3060] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.805613 20127 tablet_bootstrap.cc:654] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.807709 20264 raft_consensus.cc:493] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.808473 20264 raft_consensus.cc:515] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.809513 19826 leader_election.cc:304] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:32.810626 20140 raft_consensus.cc:2804] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.815851 20264 leader_election.cc:290] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:32.815265 20127 tablet_bootstrap.cc:492] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:32.817014 20127 ts_tablet_manager.cc:1403] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.004s
I20260709 12:22:32.817963 20140 raft_consensus.cc:697] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:32.818933 20140 consensus_queue.cc:237] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.824890 20400 raft_consensus.cc:493] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.825381 20400 raft_consensus.cc:515] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.828151 20400 leader_election.cc:290] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:32.829155 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16c8dbaaffb4ff58286d705232636e3" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:32.767818 20130 raft_consensus.cc:385] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.830474 20130 raft_consensus.cc:740] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.830084 19935 raft_consensus.cc:2468] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:32.832041 20130 consensus_queue.cc:260] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.837298 19826 leader_election.cc:304] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:32.838153 20128 tablet_bootstrap.cc:492] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:32.838667 20128 ts_tablet_manager.cc:1403] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.128s	user 0.020s	sys 0.035s
I20260709 12:22:32.839545 20400 raft_consensus.cc:2804] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.839967 20400 raft_consensus.cc:493] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.840296 20400 raft_consensus.cc:3060] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.842080 20128 raft_consensus.cc:359] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.842780 20128 raft_consensus.cc:385] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.843044 20128 raft_consensus.cc:740] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.843717 20128 consensus_queue.cc:260] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.847865 20127 raft_consensus.cc:359] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.849349 20127 raft_consensus.cc:385] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:32.849603 20127 raft_consensus.cc:740] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.850229 20127 consensus_queue.cc:260] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.852880 20128 ts_tablet_manager.cc:1434] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:22:32.853825 20128 tablet_bootstrap.cc:492] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:32.610263 20183 raft_consensus.cc:515] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:32.864055 20183 leader_election.cc:290] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
W20260709 12:22:32.869239 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 145151us
I20260709 12:22:32.870679 20130 ts_tablet_manager.cc:1434] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.002s
I20260709 12:22:32.872774 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0efb7c87754b739cb88f4e13cb66c6" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:32.873497 20267 raft_consensus.cc:515] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.875061 20127 ts_tablet_manager.cc:1434] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.001s
I20260709 12:22:32.900139 20082 raft_consensus.cc:3060] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.902254 20127 tablet_bootstrap.cc:492] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:32.903520 20267 leader_election.cc:290] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:32.904856 19975 leader_election.cc:304] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:32.905990 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3835bda54b4d75a4985b5f514743a4" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:32.906693 20010 raft_consensus.cc:3060] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.907615 20133 raft_consensus.cc:2749] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:32.875195 20169 leader_election.cc:290] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:32.881424 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3835bda54b4d75a4985b5f514743a4" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:32.883862 20128 tablet_bootstrap.cc:654] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.886214 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0efb7c87754b739cb88f4e13cb66c6" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:32.909720 19935 raft_consensus.cc:3060] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.910181 20165 raft_consensus.cc:493] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.910720 20165 raft_consensus.cc:515] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:32.912340 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3835bda54b4d75a4985b5f514743a4" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:32.912952 19858 raft_consensus.cc:3060] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.914389 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6b3c311ea54efba7ed246f0ccd9c2e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:32.917282 20049 leader_election.cc:343] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.918195 20165 leader_election.cc:290] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:32.893116 20130 tablet_bootstrap.cc:492] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:32.898833 19936 raft_consensus.cc:2468] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:32.919725 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6b3c311ea54efba7ed246f0ccd9c2e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:32.930600 20009 raft_consensus.cc:2468] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:32.933283 20050 leader_election.cc:304] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:32.919909 19975 leader_election.cc:304] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:32.930054 20127 tablet_bootstrap.cc:654] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.890905 20400 raft_consensus.cc:515] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
W20260709 12:22:32.939126 19975 leader_election.cc:343] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.935602 20280 raft_consensus.cc:2804] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.947052 20280 raft_consensus.cc:493] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.951851 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deec39d0e7447fe9d7802f05466f079" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:32.953316 20280 raft_consensus.cc:3060] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.958163 19857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deec39d0e7447fe9d7802f05466f079" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:32.961367 19935 raft_consensus.cc:2468] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:32.963418 20400 leader_election.cc:290] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:32.966336 20130 tablet_bootstrap.cc:654] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:32.966833 20267 consensus_queue.cc:1048] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.969209 19826 leader_election.cc:304] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
W20260709 12:22:32.952112 19806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:32.970000 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16c8dbaaffb4ff58286d705232636e3" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:32.971587 19935 raft_consensus.cc:3060] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.977110 19858 raft_consensus.cc:2468] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
W20260709 12:22:32.982250 19975 leader_election.cc:343] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:32.985576 20129 tablet_bootstrap.cc:492] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:32.986224 20129 ts_tablet_manager.cc:1403] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.282s	user 0.063s	sys 0.106s
I20260709 12:22:32.987321 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096a550b72b246c3b15fd4b627f51174" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:32.989017 19901 leader_election.cc:304] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:32.989235 19934 raft_consensus.cc:3060] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.986805 20410 consensus_queue.cc:1048] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:22:32.990252 20361 raft_consensus.cc:2804] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.990760 20361 raft_consensus.cc:697] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:32.991218 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096a550b72b246c3b15fd4b627f51174" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:32.991904 20084 raft_consensus.cc:3060] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.991631 20361 consensus_queue.cc:237] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:32.992566 19756 catalog_manager.cc:5697] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.982312 20407 raft_consensus.cc:2804] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.995695 20407 raft_consensus.cc:697] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:32.997411 20362 consensus_queue.cc:1048] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:32.996308 19935 raft_consensus.cc:2468] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:32.996590 20407 consensus_queue.cc:237] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:32.994827 20010 raft_consensus.cc:2468] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:33.008801 20183 consensus_queue.cc:1048] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:33.014557 20129 raft_consensus.cc:359] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:33.017485 20133 raft_consensus.cc:2764] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:22:33.021293 20129 raft_consensus.cc:385] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.009299 19975 leader_election.cc:304] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:33.021627 20129 raft_consensus.cc:740] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:32.987496 20082 raft_consensus.cc:2468] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:32.998050 20280 raft_consensus.cc:515] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.054774 20129 consensus_queue.cc:260] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:33.062986 20128 tablet_bootstrap.cc:492] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:33.063773 20128 ts_tablet_manager.cc:1403] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.210s	user 0.016s	sys 0.007s
I20260709 12:22:33.056833 20183 raft_consensus.cc:2804] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.023243 20267 consensus_queue.cc:1048] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
W20260709 12:22:33.079571 19975 leader_election.cc:343] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.082681 19975 leader_election.cc:304] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:33.083532 20264 raft_consensus.cc:2749] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:33.084848 20280 leader_election.cc:290] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:33.078985 20183 raft_consensus.cc:697] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:33.089659 20183 consensus_queue.cc:237] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.080689 19826 leader_election.cc:304] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
W20260709 12:22:33.101382 20417 log.cc:927] Time spent T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:22:33.105067 20084 raft_consensus.cc:2468] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:33.084962 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16c8dbaaffb4ff58286d705232636e3" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:33.126483 20127 tablet_bootstrap.cc:492] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:33.127104 20127 ts_tablet_manager.cc:1403] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.225s	user 0.014s	sys 0.005s
I20260709 12:22:33.127555 20128 raft_consensus.cc:359] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:33.128551 20128 raft_consensus.cc:385] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.128914 20128 raft_consensus.cc:740] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.113765 20169 raft_consensus.cc:2804] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.122650 20006 raft_consensus.cc:3060] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.157429 20128 consensus_queue.cc:260] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:33.162007 20130 tablet_bootstrap.cc:492] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:33.162637 20130 ts_tablet_manager.cc:1403] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.270s	user 0.009s	sys 0.012s
W20260709 12:22:33.164287 19826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:45345, user_credentials={real_user=slave}} blocked reactor thread for 46394us
I20260709 12:22:33.165031 19934 raft_consensus.cc:2468] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:33.174212 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16c8dbaaffb4ff58286d705232636e3" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:33.169741 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6b3c311ea54efba7ed246f0ccd9c2e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:33.192086 20128 ts_tablet_manager.cc:1434] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.002s
I20260709 12:22:33.178052 20169 raft_consensus.cc:697] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:33.196089 20127 raft_consensus.cc:359] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:33.199445 20127 raft_consensus.cc:385] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.199904 20127 raft_consensus.cc:740] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.196863 20140 raft_consensus.cc:493] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.201812 20128 tablet_bootstrap.cc:492] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:33.205658 20127 consensus_queue.cc:260] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:33.201828 20140 raft_consensus.cc:515] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.234349 20130 raft_consensus.cc:359] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.235234 20130 raft_consensus.cc:385] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.235590 20130 raft_consensus.cc:740] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.196341 20010 raft_consensus.cc:3060] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:33.237648 20415 log.cc:927] Time spent T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:22:33.243085 20140 leader_election.cc:290] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:33.245239 20362 raft_consensus.cc:493] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.245811 20362 raft_consensus.cc:515] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:33.249193 20127 ts_tablet_manager.cc:1434] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.000s
I20260709 12:22:33.249362 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6b3c311ea54efba7ed246f0ccd9c2e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:33.250249 20127 tablet_bootstrap.cc:492] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:33.253123 20130 consensus_queue.cc:260] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.266507 20129 ts_tablet_manager.cc:1434] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.280s	user 0.015s	sys 0.005s
I20260709 12:22:33.271466 20129 tablet_bootstrap.cc:492] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:33.271276 20130 ts_tablet_manager.cc:1434] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.001s
I20260709 12:22:33.261211 19858 raft_consensus.cc:3060] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.274374 20130 tablet_bootstrap.cc:492] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:33.302134 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:33.302929 20081 raft_consensus.cc:2468] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:33.305706 20130 tablet_bootstrap.cc:654] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.305430 19757 catalog_manager.cc:5697] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 0 to 1, leader changed from <none> to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 1 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.271893 20169 consensus_queue.cc:237] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:33.288065 20362 leader_election.cc:290] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:33.317682 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:33.322106 19901 leader_election.cc:343] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.329392 20129 tablet_bootstrap.cc:654] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.330224 20128 tablet_bootstrap.cc:654] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.334937 20127 tablet_bootstrap.cc:654] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.390271 19901 leader_election.cc:304] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:33.392699 20267 raft_consensus.cc:2804] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.393251 20267 raft_consensus.cc:493] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.393692 20267 raft_consensus.cc:3060] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.405828 20010 raft_consensus.cc:2468] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:33.412168 20006 raft_consensus.cc:2468] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:33.417691 20404 consensus_queue.cc:1048] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:33.417716 19755 catalog_manager.cc:5697] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.424310 19975 leader_election.cc:304] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:33.448710 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "551cd77f8f81497eaf0336d9004c56cd" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:33.449112 20130 tablet_bootstrap.cc:492] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:33.449659 20077 raft_consensus.cc:2393] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:33.449656 20130 ts_tablet_manager.cc:1403] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.028s
I20260709 12:22:33.428572 20183 raft_consensus.cc:2804] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.411249 19858 raft_consensus.cc:2468] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:33.468675 20183 raft_consensus.cc:697] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:33.475131 20183 consensus_queue.cc:237] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:33.480171 20128 tablet_bootstrap.cc:492] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:33.480803 20128 ts_tablet_manager.cc:1403] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.279s	user 0.011s	sys 0.007s
I20260709 12:22:33.484450 20128 raft_consensus.cc:359] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:33.485698 20128 raft_consensus.cc:385] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.486488 20128 raft_consensus.cc:740] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.487808 20128 consensus_queue.cc:260] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:33.485857 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "551cd77f8f81497eaf0336d9004c56cd" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:33.491374 20130 raft_consensus.cc:359] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:33.496428 20130 raft_consensus.cc:385] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.499569 20128 ts_tablet_manager.cc:1434] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:22:33.500828 20128 tablet_bootstrap.cc:492] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:33.496902 20130 raft_consensus.cc:740] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.502761 20130 consensus_queue.cc:260] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:33.509274 20129 tablet_bootstrap.cc:492] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:33.510026 20129 ts_tablet_manager.cc:1403] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.241s	user 0.013s	sys 0.002s
I20260709 12:22:33.513345 20129 raft_consensus.cc:359] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.517815 20127 tablet_bootstrap.cc:492] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:33.521482 20140 consensus_queue.cc:1048] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.521868 20362 consensus_queue.cc:1048] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:33.521955 19757 catalog_manager.cc:5697] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.526433 20129 raft_consensus.cc:385] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.522853 20267 raft_consensus.cc:515] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:33.527489 20127 ts_tablet_manager.cc:1403] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.277s	user 0.014s	sys 0.010s
I20260709 12:22:33.526907 20129 raft_consensus.cc:740] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.528683 20129 consensus_queue.cc:260] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.534271 20130 ts_tablet_manager.cc:1434] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 12:22:33.543805 20130 tablet_bootstrap.cc:492] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:33.537118 19755 catalog_manager.cc:5697] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.554951 20129 ts_tablet_manager.cc:1434] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 12:22:33.556038 20129 tablet_bootstrap.cc:492] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
W20260709 12:22:33.551913 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 107319us
W20260709 12:22:33.570370 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:45345, user_credentials={real_user=slave}} blocked reactor thread for 111910us
I20260709 12:22:33.558755 20049 leader_election.cc:304] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:33.575476 20267 leader_election.cc:290] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:33.576804 20280 raft_consensus.cc:493] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.577379 20280 raft_consensus.cc:515] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:33.579314 20127 raft_consensus.cc:359] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.580073 20127 raft_consensus.cc:385] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.580345 20127 raft_consensus.cc:740] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.581017 20127 consensus_queue.cc:260] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.583213 20127 ts_tablet_manager.cc:1434] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.000s
I20260709 12:22:33.584466 20424 raft_consensus.cc:2804] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.588402 20127 tablet_bootstrap.cc:492] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:33.586884 20280 leader_election.cc:290] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:33.611975 20261 consensus_queue.cc:1048] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:33.613848 20404 raft_consensus.cc:493] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.614591 20404 raft_consensus.cc:515] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:33.600952 20424 raft_consensus.cc:697] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:33.660856 20267 raft_consensus.cc:493] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.661754 20267 raft_consensus.cc:515] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
W20260709 12:22:33.720067 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 128676us
I20260709 12:22:33.724596 20130 tablet_bootstrap.cc:654] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.724891 20128 tablet_bootstrap.cc:700] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent opening tablet: real 0.107s	user 0.003s	sys 0.003s
W20260709 12:22:33.726243 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:36799, user_credentials={real_user=slave}} blocked reactor thread for 118355us
I20260709 12:22:33.728271 20128 tablet_bootstrap.cc:654] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.729110 20127 tablet_bootstrap.cc:654] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.729694 20129 tablet_bootstrap.cc:654] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:33.737578 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:33.760524 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ae825dd7c04568bd5e70cd1433e282" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:33.765192 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:33.765965 20075 raft_consensus.cc:3060] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:33.768177 20049 leader_election.cc:343] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.774058 20404 leader_election.cc:290] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:33.775417 20075 raft_consensus.cc:2468] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:33.794430 20410 raft_consensus.cc:493] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.807503 19901 leader_election.cc:304] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:33.814810 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deec39d0e7447fe9d7802f05466f079" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:33.815752 20007 raft_consensus.cc:2468] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:33.816838 20410 raft_consensus.cc:515] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:33.817655 20133 raft_consensus.cc:493] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.818132 20133 raft_consensus.cc:515] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.819131 20410 leader_election.cc:290] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:33.819974 20133 leader_election.cc:290] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:33.790901 20424 consensus_queue.cc:237] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.820143 19902 leader_election.cc:304] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
W20260709 12:22:33.821256 20444 log.cc:927] Time spent T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:22:33.823588 20261 raft_consensus.cc:2804] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.810040 20267 leader_election.cc:290] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:33.833400 20261 raft_consensus.cc:697] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:33.834273 20261 consensus_queue.cc:237] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:33.834740 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3985b4c004f27b2636195c5870246" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:33.835493 20079 raft_consensus.cc:2468] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:33.835786 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d17d263a1240d09b5735c7adad3e3c" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:33.836503 20082 raft_consensus.cc:2468] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:33.836004 19861 raft_consensus.cc:3060] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.841269 19975 leader_election.cc:304] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:33.842033 20133 raft_consensus.cc:2804] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.842175 19975 leader_election.cc:304] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:33.842411 20133 raft_consensus.cc:493] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.842726 20133 raft_consensus.cc:3060] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.849013 20130 tablet_bootstrap.cc:492] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:33.849524 20130 ts_tablet_manager.cc:1403] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.314s	user 0.007s	sys 0.012s
I20260709 12:22:33.843343 20264 raft_consensus.cc:2804] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.840020 20362 raft_consensus.cc:2804] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:33.868860 19857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3985b4c004f27b2636195c5870246" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:33.872782 19855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deec39d0e7447fe9d7802f05466f079" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:33.873579 19855 raft_consensus.cc:2468] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:33.874070 19758 catalog_manager.cc:5697] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.854604 20264 raft_consensus.cc:493] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.875639 20264 raft_consensus.cc:3060] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.887341 20133 raft_consensus.cc:515] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.891372 20128 tablet_bootstrap.cc:492] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:33.894348 20128 ts_tablet_manager.cc:1403] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.394s	user 0.016s	sys 0.012s
I20260709 12:22:33.897928 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deec39d0e7447fe9d7802f05466f079" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:33.899817 20128 raft_consensus.cc:359] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:33.900563 20128 raft_consensus.cc:385] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.900820 20128 raft_consensus.cc:740] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.901479 20128 consensus_queue.cc:260] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:33.856263 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d17d263a1240d09b5735c7adad3e3c" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:33.903925 19933 raft_consensus.cc:2468] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:33.903065 20130 raft_consensus.cc:359] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:33.905576 20130 raft_consensus.cc:385] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.906098 20130 raft_consensus.cc:740] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.906389 20133 leader_election.cc:290] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:33.906898 20130 consensus_queue.cc:260] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:33.905493 20128 ts_tablet_manager.cc:1434] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
W20260709 12:22:33.893376 19901 leader_election.cc:343] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.884232 20362 raft_consensus.cc:493] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.915944 20362 raft_consensus.cc:3060] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.916599 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deec39d0e7447fe9d7802f05466f079" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:33.917273 20007 raft_consensus.cc:2468] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:33.908509 20128 tablet_bootstrap.cc:492] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:33.909475 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ae825dd7c04568bd5e70cd1433e282" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:33.912997 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3985b4c004f27b2636195c5870246" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
W20260709 12:22:33.922595 19975 leader_election.cc:343] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:33.926955 20133 consensus_queue.cc:1048] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:33.929318 20410 consensus_queue.cc:1048] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.930059 20430 consensus_queue.cc:1048] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:33.932243 20084 raft_consensus.cc:3060] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.932788 20127 tablet_bootstrap.cc:492] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:33.933009 20169 consensus_queue.cc:1048] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.933329 20127 ts_tablet_manager.cc:1403] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.345s	user 0.024s	sys 0.005s
I20260709 12:22:33.934754 19826 leader_election.cc:304] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:33.935479 20169 raft_consensus.cc:2749] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:33.936375 20127 raft_consensus.cc:359] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.937043 20127 raft_consensus.cc:385] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:33.937484 20127 raft_consensus.cc:740] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:33.938156 20127 consensus_queue.cc:260] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.938869 20169 consensus_queue.cc:1048] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:33.940534 20127 ts_tablet_manager.cc:1434] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:33.941746 20130 ts_tablet_manager.cc:1434] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.003s
I20260709 12:22:33.941452 20084 raft_consensus.cc:2468] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:33.943638 20264 raft_consensus.cc:515] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:33.941536 20127 tablet_bootstrap.cc:492] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:33.954357 20130 tablet_bootstrap.cc:492] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:33.962839 19975 leader_election.cc:304] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:33.972434 20264 leader_election.cc:290] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:33.973918 20442 raft_consensus.cc:2804] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:33.974498 20442 raft_consensus.cc:697] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:33.990684 20076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d17d263a1240d09b5735c7adad3e3c" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:33.991397 20076 raft_consensus.cc:3060] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.975409 20442 consensus_queue.cc:237] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:33.975710 19931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d17d263a1240d09b5735c7adad3e3c" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:33.999039 19931 raft_consensus.cc:3060] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:33.966996 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3985b4c004f27b2636195c5870246" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:34.004822 20133 consensus_queue.cc:1048] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:34.013804 20128 tablet_bootstrap.cc:654] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.018397 19759 catalog_manager.cc:5697] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.023861 20264 consensus_queue.cc:1048] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:34.025017 19827 leader_election.cc:304] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:34.026260 20452 raft_consensus.cc:2804] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.033319 20452 raft_consensus.cc:493] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.033704 20452 raft_consensus.cc:3060] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:34.035219 20049 leader_election.cc:343] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.040068 20127 tablet_bootstrap.cc:654] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:34.041604 19975 leader_election.cc:343] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.018970 19931 raft_consensus.cc:2468] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:34.051294 20404 consensus_queue.cc:1048] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:34.029924 20362 raft_consensus.cc:515] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.057359 19975 leader_election.cc:304] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:34.045006 20049 leader_election.cc:304] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:34.061880 20264 raft_consensus.cc:2804] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.060690 20261 raft_consensus.cc:493] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.075022 19935 raft_consensus.cc:2393] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in this term.
I20260709 12:22:34.095674 20264 raft_consensus.cc:697] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:34.102855 20443 raft_consensus.cc:2749] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:34.103091 20462 log.cc:927] Time spent T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:22:34.104274 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 69080.2us
I20260709 12:22:34.113154 20129 tablet_bootstrap.cc:492] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:34.119846 20264 consensus_queue.cc:237] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.124332 20129 ts_tablet_manager.cc:1403] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.569s	user 0.022s	sys 0.027s
I20260709 12:22:34.089536 20261 raft_consensus.cc:515] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.145040 20452 raft_consensus.cc:515] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.147959 20362 leader_election.cc:290] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:34.148948 19757 catalog_manager.cc:5697] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.184602 20410 raft_consensus.cc:493] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.196231 20410 raft_consensus.cc:515] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:34.215267 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf3cb77b38fa4d559fd0dbf6852f150d" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:34.212791 20452 leader_election.cc:290] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:34.224843 20076 raft_consensus.cc:2468] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:34.224687 20129 raft_consensus.cc:359] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.199281 20410 leader_election.cc:290] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:34.236020 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deec39d0e7447fe9d7802f05466f079" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:34.237363 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf3cb77b38fa4d559fd0dbf6852f150d" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:34.250716 19861 raft_consensus.cc:2393] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
I20260709 12:22:34.239251 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deec39d0e7447fe9d7802f05466f079" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:34.252210 19932 raft_consensus.cc:2393] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in this term.
I20260709 12:22:34.246335 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deec39d0e7447fe9d7802f05466f079" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:34.253685 20009 raft_consensus.cc:3060] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.248288 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deec39d0e7447fe9d7802f05466f079" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
W20260709 12:22:34.249452 19975 leader_election.cc:343] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.250053 20129 raft_consensus.cc:385] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.255124 20129 raft_consensus.cc:740] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.253193 20130 tablet_bootstrap.cc:654] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.256794 20129 consensus_queue.cc:260] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.270809 20431 raft_consensus.cc:493] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.272161 20129 ts_tablet_manager.cc:1434] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.147s	user 0.000s	sys 0.008s
I20260709 12:22:34.271657 20431 raft_consensus.cc:515] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
W20260709 12:22:34.276924 19975 leader_election.cc:343] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.268204 19755 catalog_manager.cc:5697] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 0 to 1, leader changed from <none> to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 1 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:34.277626 19975 leader_election.cc:304] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:34.279814 19827 leader_election.cc:304] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:34.279906 20431 leader_election.cc:290] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:34.281364 20431 raft_consensus.cc:2749] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:22:34.282622 20470 log.cc:927] Time spent T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:22:34.291144 20009 raft_consensus.cc:2468] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:34.297658 20443 raft_consensus.cc:493] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.298273 20443 raft_consensus.cc:515] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.301726 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acee3c287d24c97ad0f5fcea4bbcaa9" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
W20260709 12:22:34.303265 20050 leader_election.cc:343] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.303911 20224 raft_consensus.cc:2749] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:34.304044 20443 leader_election.cc:290] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:34.315208 20129 tablet_bootstrap.cc:492] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:34.316079 19902 leader_election.cc:304] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:34.319643 20465 raft_consensus.cc:2804] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.320173 20465 raft_consensus.cc:697] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:34.321039 20465 consensus_queue.cc:237] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.323710 20261 leader_election.cc:290] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:34.332113 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3237b68a928849c2b369e32505a6e4a8" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
W20260709 12:22:34.340260 19826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:45345, user_credentials={real_user=slave}} blocked reactor thread for 75861.8us
I20260709 12:22:34.339756 19931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acee3c287d24c97ad0f5fcea4bbcaa9" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
W20260709 12:22:34.345592 19901 leader_election.cc:343] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.342665 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:34.347404 20079 raft_consensus.cc:2393] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in this term.
I20260709 12:22:34.349109 19759 catalog_manager.cc:5697] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.355489 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:34.348500 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3237b68a928849c2b369e32505a6e4a8" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:34.365360 20127 tablet_bootstrap.cc:492] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
W20260709 12:22:34.365856 20049 leader_election.cc:343] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.366410 20049 leader_election.cc:304] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:34.367982 20280 raft_consensus.cc:2749] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:34.366012 20127 ts_tablet_manager.cc:1403] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.425s	user 0.014s	sys 0.005s
W20260709 12:22:34.370261 19902 leader_election.cc:343] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.370828 19902 leader_election.cc:304] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:34.355646 20130 tablet_bootstrap.cc:492] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:34.387600 20465 raft_consensus.cc:2749] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:34.388634 20130 ts_tablet_manager.cc:1403] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.435s	user 0.016s	sys 0.011s
I20260709 12:22:34.389227 20128 tablet_bootstrap.cc:492] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:34.389822 20128 ts_tablet_manager.cc:1403] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.481s	user 0.015s	sys 0.009s
I20260709 12:22:34.393508 20130 raft_consensus.cc:359] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:34.394440 20130 raft_consensus.cc:385] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.394883 20130 raft_consensus.cc:740] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.395936 20130 consensus_queue.cc:260] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:34.397897 20130 ts_tablet_manager.cc:1434] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:34.398877 20130 tablet_bootstrap.cc:492] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:34.403784 20129 tablet_bootstrap.cc:654] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.405272 20130 tablet_bootstrap.cc:654] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.407415 19826 leader_election.cc:304] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:34.408643 20430 raft_consensus.cc:3060] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.410750 20127 raft_consensus.cc:359] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.411509 20127 raft_consensus.cc:385] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.411778 20127 raft_consensus.cc:740] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.412432 20127 consensus_queue.cc:260] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.418723 20280 consensus_queue.cc:1048] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:34.420056 20127 ts_tablet_manager.cc:1434] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.011s
I20260709 12:22:34.421270 20128 raft_consensus.cc:359] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.427860 20128 raft_consensus.cc:385] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.428210 20128 raft_consensus.cc:740] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.426647 20430 raft_consensus.cc:2749] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:34.430774 20127 tablet_bootstrap.cc:492] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:34.430657 20128 consensus_queue.cc:260] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.436472 20129 tablet_bootstrap.cc:492] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:34.437088 20129 ts_tablet_manager.cc:1403] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.123s	user 0.007s	sys 0.006s
I20260709 12:22:34.441161 20129 raft_consensus.cc:359] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:34.443930 20424 consensus_queue.cc:1048] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:34.443205 20128 ts_tablet_manager.cc:1434] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:22:34.447474 20128 tablet_bootstrap.cc:492] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
W20260709 12:22:34.450296 19806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:34.453907 20128 tablet_bootstrap.cc:654] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.444234 20129 raft_consensus.cc:385] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.454469 20129 raft_consensus.cc:740] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.459527 20460 consensus_queue.cc:1048] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:34.460172 20130 tablet_bootstrap.cc:492] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:34.473834 20130 ts_tablet_manager.cc:1403] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.017s
I20260709 12:22:34.473311 20129 consensus_queue.cc:260] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:34.476903 20130 raft_consensus.cc:359] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.477646 20130 raft_consensus.cc:385] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.477929 20130 raft_consensus.cc:740] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.478582 20130 consensus_queue.cc:260] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.462033 20482 raft_consensus.cc:493] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.476492 20127 tablet_bootstrap.cc:654] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.478888 20129 ts_tablet_manager.cc:1434] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:22:34.465622 19755 catalog_manager.cc:5697] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 0 to 1, leader changed from <none> to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 1 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.480026 20460 consensus_queue.cc:1048] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:34.482009 20482 raft_consensus.cc:515] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:34.485103 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3985b4c004f27b2636195c5870246" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:34.487244 20482 leader_election.cc:290] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:34.489667 20127 tablet_bootstrap.cc:492] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:34.490161 20130 ts_tablet_manager.cc:1434] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 12:22:34.490195 20127 ts_tablet_manager.cc:1403] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.004s
I20260709 12:22:34.491206 20130 tablet_bootstrap.cc:492] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:34.494158 20129 tablet_bootstrap.cc:492] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:34.493863 20127 raft_consensus.cc:359] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.494582 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b3985b4c004f27b2636195c5870246" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:34.496125 20127 raft_consensus.cc:385] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.496277 20079 raft_consensus.cc:2393] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:34.496483 20127 raft_consensus.cc:740] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.497795 19826 leader_election.cc:304] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:34.498813 20482 raft_consensus.cc:3060] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.505304 20129 tablet_bootstrap.cc:654] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.511715 20482 raft_consensus.cc:2749] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:34.513154 20130 tablet_bootstrap.cc:654] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.525144 20460 raft_consensus.cc:493] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.525771 20460 raft_consensus.cc:515] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.526619 20442 consensus_queue.cc:1048] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:34.527804 20129 tablet_bootstrap.cc:492] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:34.528414 20129 ts_tablet_manager.cc:1403] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.004s
I20260709 12:22:34.529085 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f762ace6474e3d8514494a97777505" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:34.530689 20460 leader_election.cc:290] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
W20260709 12:22:34.531071 19901 leader_election.cc:343] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.531749 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f762ace6474e3d8514494a97777505" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
W20260709 12:22:34.534132 19902 leader_election.cc:343] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.534724 19902 leader_election.cc:304] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:34.536688 20465 raft_consensus.cc:2749] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:34.539358 20130 tablet_bootstrap.cc:492] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:34.539939 20130 ts_tablet_manager.cc:1403] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.006s
I20260709 12:22:34.531808 20129 raft_consensus.cc:359] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.541507 20129 raft_consensus.cc:385] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.541805 20129 raft_consensus.cc:740] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.532461 20128 tablet_bootstrap.cc:492] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:34.542657 20129 consensus_queue.cc:260] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.543543 20128 ts_tablet_manager.cc:1403] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.008s
I20260709 12:22:34.546810 20128 raft_consensus.cc:359] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.547523 20128 raft_consensus.cc:385] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.547780 20128 raft_consensus.cc:740] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.551534 20128 consensus_queue.cc:260] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.553150 20128 ts_tablet_manager.cc:1434] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:22:34.554581 20128 tablet_bootstrap.cc:492] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:34.560738 20128 tablet_bootstrap.cc:654] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.561728 20482 raft_consensus.cc:493] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.562315 20129 ts_tablet_manager.cc:1434] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:22:34.562261 20482 raft_consensus.cc:515] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.563405 20129 tablet_bootstrap.cc:492] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:34.564435 20482 leader_election.cc:290] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:34.566459 20127 consensus_queue.cc:260] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.568589 20127 ts_tablet_manager.cc:1434] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 12:22:34.573153 20127 tablet_bootstrap.cc:492] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:34.580514 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ae825dd7c04568bd5e70cd1433e282" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:34.581547 19935 raft_consensus.cc:2468] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:34.590167 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ae825dd7c04568bd5e70cd1433e282" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:34.590727 20127 tablet_bootstrap.cc:654] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.591318 20079 raft_consensus.cc:2468] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:34.593199 20129 tablet_bootstrap.cc:654] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.594723 19826 leader_election.cc:304] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:34.596375 20430 raft_consensus.cc:2804] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.596896 20430 raft_consensus.cc:493] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.597376 20430 raft_consensus.cc:3060] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.607815 20127 tablet_bootstrap.cc:492] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:34.608402 20127 ts_tablet_manager.cc:1403] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.008s
I20260709 12:22:34.608443 20442 consensus_queue.cc:1048] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:34.612188 20127 raft_consensus.cc:359] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.612870 20127 raft_consensus.cc:385] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.613154 20127 raft_consensus.cc:740] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.613848 20127 consensus_queue.cc:260] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.615491 20127 ts_tablet_manager.cc:1434] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:34.622404 20127 tablet_bootstrap.cc:492] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:34.636256 20442 raft_consensus.cc:493] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.636586 20127 tablet_bootstrap.cc:654] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.638338 20422 raft_consensus.cc:493] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.638887 20422 raft_consensus.cc:515] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:34.643330 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf3cb77b38fa4d559fd0dbf6852f150d" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:34.646279 20049 leader_election.cc:343] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.647167 20422 leader_election.cc:290] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:34.649034 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf3cb77b38fa4d559fd0dbf6852f150d" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:34.650084 20006 raft_consensus.cc:2468] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:34.655941 20050 leader_election.cc:304] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:34.657162 20424 raft_consensus.cc:2804] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.657644 20424 raft_consensus.cc:493] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.658061 20424 raft_consensus.cc:3060] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.659934 20280 raft_consensus.cc:493] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.660703 20280 raft_consensus.cc:515] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.665400 19931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
W20260709 12:22:34.667325 20049 leader_election.cc:343] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.670869 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:34.672937 20049 leader_election.cc:343] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.673609 20049 leader_election.cc:304] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:34.637104 20442 raft_consensus.cc:515] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.677690 20280 leader_election.cc:290] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:34.678503 20442 leader_election.cc:290] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:34.678778 20280 raft_consensus.cc:2749] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:34.682441 19931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3237b68a928849c2b369e32505a6e4a8" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:34.683547 19931 raft_consensus.cc:2468] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:34.696664 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3237b68a928849c2b369e32505a6e4a8" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:34.701548 20130 raft_consensus.cc:359] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.705027 20130 raft_consensus.cc:385] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.705511 20130 raft_consensus.cc:740] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.705705 20424 raft_consensus.cc:515] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:34.707086 20130 consensus_queue.cc:260] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.710378 20130 ts_tablet_manager.cc:1434] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.170s	user 0.003s	sys 0.006s
I20260709 12:22:34.710033 20430 raft_consensus.cc:515] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.712080 20130 tablet_bootstrap.cc:492] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
W20260709 12:22:34.716173 19975 leader_election.cc:343] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.743120 19975 leader_election.cc:304] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:34.748431 20133 raft_consensus.cc:2804] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.748842 20133 raft_consensus.cc:493] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.749182 20133 raft_consensus.cc:3060] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.751251 20127 tablet_bootstrap.cc:492] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:34.752414 20127 ts_tablet_manager.cc:1403] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.130s	user 0.021s	sys 0.032s
I20260709 12:22:34.755227 20127 raft_consensus.cc:359] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.756059 20127 raft_consensus.cc:385] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.756412 20127 raft_consensus.cc:740] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.759017 20133 raft_consensus.cc:515] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.759325 20127 consensus_queue.cc:260] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.766175 20129 tablet_bootstrap.cc:492] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:34.766399 20127 ts_tablet_manager.cc:1434] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:22:34.766743 20129 ts_tablet_manager.cc:1403] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.204s	user 0.042s	sys 0.058s
I20260709 12:22:34.767643 20133 leader_election.cc:290] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:34.767995 20127 tablet_bootstrap.cc:492] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:34.773008 20263 consensus_queue.cc:1048] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:34.774376 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3237b68a928849c2b369e32505a6e4a8" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:34.775034 19935 raft_consensus.cc:3060] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.776538 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ae825dd7c04568bd5e70cd1433e282" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:34.777189 19933 raft_consensus.cc:3060] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.780324 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ae825dd7c04568bd5e70cd1433e282" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:34.780750 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3237b68a928849c2b369e32505a6e4a8" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:34.780922 20129 raft_consensus.cc:359] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.782068 20129 raft_consensus.cc:385] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.782337 20129 raft_consensus.cc:740] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.783398 20129 consensus_queue.cc:260] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.784286 20080 raft_consensus.cc:3060] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.785694 20129 ts_tablet_manager.cc:1434] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.005s
I20260709 12:22:34.780965 20079 raft_consensus.cc:3060] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.790257 20130 tablet_bootstrap.cc:654] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.792932 20424 leader_election.cc:290] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:34.793702 20263 consensus_queue.cc:1048] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:34.793728 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf3cb77b38fa4d559fd0dbf6852f150d" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:34.774874 20430 leader_election.cc:290] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:34.798132 20129 tablet_bootstrap.cc:492] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:34.794586 20006 raft_consensus.cc:3060] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.819638 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf3cb77b38fa4d559fd0dbf6852f150d" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:34.837028 20128 tablet_bootstrap.cc:492] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:34.837618 20128 ts_tablet_manager.cc:1403] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.283s	user 0.056s	sys 0.072s
I20260709 12:22:34.809422 20080 raft_consensus.cc:2468] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:34.862131 19935 raft_consensus.cc:2468] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:34.863893 19975 leader_election.cc:304] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:34.837249 20079 raft_consensus.cc:2468] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:34.836864 20460 consensus_queue.cc:1048] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
W20260709 12:22:34.872857 20049 leader_election.cc:343] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.875504 20133 raft_consensus.cc:493] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.876029 20133 raft_consensus.cc:515] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.871592 20410 raft_consensus.cc:2804] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.878989 19826 leader_election.cc:304] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:34.880330 20140 raft_consensus.cc:2804] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.880893 20140 raft_consensus.cc:697] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:34.881559 20140 consensus_queue.cc:237] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.885993 20133 leader_election.cc:290] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:34.877022 20468 consensus_queue.cc:1048] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:22:34.890618 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acee3c287d24c97ad0f5fcea4bbcaa9" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:34.885085 20410 raft_consensus.cc:697] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:34.892091 19933 raft_consensus.cc:2468] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:34.896071 20410 consensus_queue.cc:237] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.897909 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acee3c287d24c97ad0f5fcea4bbcaa9" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:34.898101 20128 raft_consensus.cc:359] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.898666 20082 raft_consensus.cc:2468] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:34.898948 20128 raft_consensus.cc:385] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.899351 20128 raft_consensus.cc:740] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.900118 20128 consensus_queue.cc:260] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.901788 20128 ts_tablet_manager.cc:1434] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 12:22:34.907869 20129 tablet_bootstrap.cc:654] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.898124 20130 tablet_bootstrap.cc:492] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:34.913223 20130 ts_tablet_manager.cc:1403] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.202s	user 0.037s	sys 0.016s
I20260709 12:22:34.914162 20127 tablet_bootstrap.cc:654] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:34.919611 20006 raft_consensus.cc:2468] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:34.921543 19975 leader_election.cc:304] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
W20260709 12:22:34.925391 20494 log.cc:927] Time spent T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:22:34.925854 20050 leader_election.cc:304] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:34.927537 20424 raft_consensus.cc:2804] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:34.928417 20424 raft_consensus.cc:697] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:34.929243 20424 consensus_queue.cc:237] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:34.929687 20263 raft_consensus.cc:2804] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:34.930111 20263 raft_consensus.cc:493] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.930436 20263 raft_consensus.cc:3060] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:34.934567 19975 leader_election.cc:343] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:34.954953 20263 raft_consensus.cc:515] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:34.953779 20129 tablet_bootstrap.cc:492] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:34.940979 20128 tablet_bootstrap.cc:492] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:34.983508 20129 ts_tablet_manager.cc:1403] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.186s	user 0.023s	sys 0.030s
W20260709 12:22:34.983510 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:36799, user_credentials={real_user=slave}} blocked reactor thread for 48975.7us
I20260709 12:22:34.985071 20263 leader_election.cc:290] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:34.975121 20442 raft_consensus.cc:493] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.993546 20442 raft_consensus.cc:515] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:34.996363 20129 raft_consensus.cc:359] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.997440 20129 raft_consensus.cc:385] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:34.997792 20129 raft_consensus.cc:740] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:34.999009 20129 consensus_queue.cc:260] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.000118 20443 raft_consensus.cc:493] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.000757 20443 raft_consensus.cc:515] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:34.988967 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acee3c287d24c97ad0f5fcea4bbcaa9" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:34.989696 20128 tablet_bootstrap.cc:654] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.003743 20080 raft_consensus.cc:3060] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:34.953485 20130 raft_consensus.cc:359] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:34.992684 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acee3c287d24c97ad0f5fcea4bbcaa9" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:35.006325 20130 raft_consensus.cc:385] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.006616 19935 raft_consensus.cc:3060] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.006690 20130 raft_consensus.cc:740] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.007757 20442 leader_election.cc:290] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:35.007599 20130 consensus_queue.cc:260] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.008401 20443 leader_election.cc:290] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:35.010092 20130 ts_tablet_manager.cc:1434] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.097s	user 0.014s	sys 0.000s
I20260709 12:22:35.011137 20130 tablet_bootstrap.cc:492] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:35.012845 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:35.013034 20129 ts_tablet_manager.cc:1434] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:22:35.013134 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:35.014606 20049 leader_election.cc:343] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:35.015334 20049 leader_election.cc:343] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:35.017144 20130 tablet_bootstrap.cc:654] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.017134 20049 leader_election.cc:304] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:35.018774 20282 raft_consensus.cc:2749] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:35.020810 20129 tablet_bootstrap.cc:492] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:35.021622 19935 raft_consensus.cc:2468] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:35.025969 20442 raft_consensus.cc:493] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.027196 20442 raft_consensus.cc:515] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.036976 20130 tablet_bootstrap.cc:492] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:35.037544 20130 ts_tablet_manager.cc:1403] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.005s
I20260709 12:22:35.040382 20129 tablet_bootstrap.cc:654] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.040729 20130 raft_consensus.cc:359] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.041472 20130 raft_consensus.cc:385] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.041821 20130 raft_consensus.cc:740] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.042601 20130 consensus_queue.cc:260] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.047114 20128 tablet_bootstrap.cc:492] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:35.047674 20128 ts_tablet_manager.cc:1403] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.020s
I20260709 12:22:35.049309 20130 ts_tablet_manager.cc:1434] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:22:35.050724 20130 tablet_bootstrap.cc:492] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:35.058590 20130 tablet_bootstrap.cc:654] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.060570 20128 raft_consensus.cc:359] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.061328 20128 raft_consensus.cc:385] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.061611 20128 raft_consensus.cc:740] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.066982 20128 consensus_queue.cc:260] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.068152 20442 leader_election.cc:290] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
W20260709 12:22:35.068976 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:45345, user_credentials={real_user=slave}} blocked reactor thread for 78087.6us
I20260709 12:22:35.075620 19975 leader_election.cc:304] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:35.076455 20263 raft_consensus.cc:2804] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.076951 20263 raft_consensus.cc:697] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:35.077775 20263 consensus_queue.cc:237] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:35.079679 20130 tablet_bootstrap.cc:492] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:35.081915 20130 ts_tablet_manager.cc:1403] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.012s
I20260709 12:22:35.083654 20128 ts_tablet_manager.cc:1434] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:22:35.089843 20129 tablet_bootstrap.cc:492] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:35.090377 20129 ts_tablet_manager.cc:1403] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.017s
I20260709 12:22:35.089833 20128 tablet_bootstrap.cc:492] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:35.085299 20130 raft_consensus.cc:359] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.093454 20129 raft_consensus.cc:359] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.094113 20130 raft_consensus.cc:385] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.094210 20129 raft_consensus.cc:385] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.094482 20130 raft_consensus.cc:740] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.096398 20130 consensus_queue.cc:260] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.098937 20080 raft_consensus.cc:2468] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:35.100344 20130 ts_tablet_manager.cc:1434] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:22:35.101358 20130 tablet_bootstrap.cc:492] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:35.102607 20127 tablet_bootstrap.cc:492] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:35.103178 20127 ts_tablet_manager.cc:1403] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.335s	user 0.014s	sys 0.000s
I20260709 12:22:35.107038 20130 tablet_bootstrap.cc:654] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.111891 20128 tablet_bootstrap.cc:654] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.120687 19759 catalog_manager.cc:5697] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:35.094549 20129 raft_consensus.cc:740] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.127494 20129 consensus_queue.cc:260] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.129151 20128 tablet_bootstrap.cc:492] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:35.129873 20128 ts_tablet_manager.cc:1403] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.006s
I20260709 12:22:35.130532 20129 ts_tablet_manager.cc:1434] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:22:35.133706 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce5ba2a49a949ec95fb5e6a9627f1f7" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:35.133800 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f762ace6474e3d8514494a97777505" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:35.134789 19856 raft_consensus.cc:2468] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:35.134691 20128 raft_consensus.cc:359] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.138803 20128 raft_consensus.cc:385] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.139142 20128 raft_consensus.cc:740] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.139953 20128 consensus_queue.cc:260] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.140939 20129 tablet_bootstrap.cc:492] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:35.141721 20127 raft_consensus.cc:359] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.143586 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f762ace6474e3d8514494a97777505" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:35.144541 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce5ba2a49a949ec95fb5e6a9627f1f7" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:35.168370 20127 raft_consensus.cc:385] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.160467 20129 tablet_bootstrap.cc:654] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.168730 19935 raft_consensus.cc:2468] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:35.155027 19975 leader_election.cc:304] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:35.169050 20127 raft_consensus.cc:740] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.133800 20140 raft_consensus.cc:493] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.171998 20140 raft_consensus.cc:515] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.172214 20127 consensus_queue.cc:260] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.173038 19861 raft_consensus.cc:2468] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:35.174412 20410 raft_consensus.cc:2804] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.174783 20410 raft_consensus.cc:493] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.175132 20410 raft_consensus.cc:3060] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.177943 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce5ba2a49a949ec95fb5e6a9627f1f7" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:35.178305 20140 leader_election.cc:290] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:35.179050 20130 tablet_bootstrap.cc:492] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:35.179615 20130 ts_tablet_manager.cc:1403] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.078s	user 0.006s	sys 0.005s
I20260709 12:22:35.142542 20128 ts_tablet_manager.cc:1434] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:22:35.186249 20130 raft_consensus.cc:359] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.169301 19934 raft_consensus.cc:2468] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:35.190238 20130 raft_consensus.cc:385] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.190610 20130 raft_consensus.cc:740] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.187466 20128 tablet_bootstrap.cc:492] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:35.188458 20410 raft_consensus.cc:515] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.194427 20130 consensus_queue.cc:260] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.187207 20127 ts_tablet_manager.cc:1434] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.076s	user 0.012s	sys 0.001s
I20260709 12:22:35.202214 20127 tablet_bootstrap.cc:492] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:35.202804 20128 tablet_bootstrap.cc:654] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.205252 20410 leader_election.cc:290] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:35.207743 20130 ts_tablet_manager.cc:1434] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:22:35.209198 19975 leader_election.cc:304] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:35.209802 20130 tablet_bootstrap.cc:492] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:35.210974 20410 raft_consensus.cc:2804] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.211436 20410 raft_consensus.cc:493] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.211843 20127 tablet_bootstrap.cc:654] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.211808 20410 raft_consensus.cc:3060] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.213393 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce5ba2a49a949ec95fb5e6a9627f1f7" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:35.222522 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f762ace6474e3d8514494a97777505" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:35.223322 19858 raft_consensus.cc:3060] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.223570 20410 raft_consensus.cc:515] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.226145 20006 raft_consensus.cc:2393] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:35.241381 19858 raft_consensus.cc:2468] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:35.243522 20410 leader_election.cc:290] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:35.245330 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f762ace6474e3d8514494a97777505" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:35.246371 19934 raft_consensus.cc:3060] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.254877 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce5ba2a49a949ec95fb5e6a9627f1f7" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:35.255594 19858 raft_consensus.cc:3060] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.258033 19934 raft_consensus.cc:2468] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:35.260654 19827 leader_election.cc:304] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:35.267324 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce5ba2a49a949ec95fb5e6a9627f1f7" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:35.268121 19933 raft_consensus.cc:3060] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.273764 20127 tablet_bootstrap.cc:492] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:35.281574 20127 ts_tablet_manager.cc:1403] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.003s
I20260709 12:22:35.277570 19933 raft_consensus.cc:2468] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:35.277882 20128 tablet_bootstrap.cc:492] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:35.283509 20128 ts_tablet_manager.cc:1403] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.000s
I20260709 12:22:35.280092 20130 tablet_bootstrap.cc:654] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.280565 19975 leader_election.cc:304] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:35.285702 20264 raft_consensus.cc:2804] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.286204 20264 raft_consensus.cc:697] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:35.287063 20264 consensus_queue.cc:237] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.289199 20128 raft_consensus.cc:359] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.289759 19975 leader_election.cc:304] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:35.290329 20128 raft_consensus.cc:385] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.290846 20128 raft_consensus.cc:740] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.290618 20263 raft_consensus.cc:2804] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:35.292054 20263 raft_consensus.cc:697] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:35.291740 20128 consensus_queue.cc:260] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.293042 20263 consensus_queue.cc:237] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.297183 20128 ts_tablet_manager.cc:1434] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:22:35.298439 20128 tablet_bootstrap.cc:492] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:35.295691 20129 tablet_bootstrap.cc:492] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:35.299750 20127 raft_consensus.cc:359] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.310000 20127 raft_consensus.cc:385] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.310364 20127 raft_consensus.cc:740] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.312161 20127 consensus_queue.cc:260] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.314455 20127 ts_tablet_manager.cc:1434] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 12:22:35.315340 20128 tablet_bootstrap.cc:654] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.315860 20129 ts_tablet_manager.cc:1403] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.175s	user 0.054s	sys 0.047s
I20260709 12:22:35.309281 19858 raft_consensus.cc:2468] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:35.316354 20140 raft_consensus.cc:2749] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:35.319288 20130 tablet_bootstrap.cc:492] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:35.319008 20129 raft_consensus.cc:359] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:35.319778 20129 raft_consensus.cc:385] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.319788 20130 ts_tablet_manager.cc:1403] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.110s	user 0.016s	sys 0.002s
I20260709 12:22:35.320214 20129 raft_consensus.cc:740] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.320999 20129 consensus_queue.cc:260] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:35.321872 20430 consensus_queue.cc:1048] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:35.315390 20127 tablet_bootstrap.cc:492] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:35.323228 20129 ts_tablet_manager.cc:1434] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:35.323289 20130 raft_consensus.cc:359] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.324229 20130 raft_consensus.cc:385] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.324368 20129 tablet_bootstrap.cc:492] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:35.324560 20130 raft_consensus.cc:740] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.325629 20130 consensus_queue.cc:260] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.330725 19858 raft_consensus.cc:3060] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.331161 20129 tablet_bootstrap.cc:654] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.335606 20130 ts_tablet_manager.cc:1434] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:22:35.336675 20130 tablet_bootstrap.cc:492] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:35.337998 19758 catalog_manager.cc:5697] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:35.349102 20424 consensus_queue.cc:1048] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:35.350646 20130 tablet_bootstrap.cc:654] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.353300 20127 tablet_bootstrap.cc:654] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.357735 20128 tablet_bootstrap.cc:492] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:35.359532 20128 ts_tablet_manager.cc:1403] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.003s
I20260709 12:22:35.364252 20128 raft_consensus.cc:359] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.365163 20128 raft_consensus.cc:385] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.365505 20128 raft_consensus.cc:740] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.367906 20128 consensus_queue.cc:260] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.369556 20264 consensus_queue.cc:1048] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:35.376713 20264 consensus_queue.cc:1048] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:35.379726 20129 tablet_bootstrap.cc:492] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:35.380231 20129 ts_tablet_manager.cc:1403] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.027s
I20260709 12:22:35.380867 20128 ts_tablet_manager.cc:1434] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:22:35.381913 20128 tablet_bootstrap.cc:492] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:35.382915 20129 raft_consensus.cc:359] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.388186 20129 raft_consensus.cc:385] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.388484 20129 raft_consensus.cc:740] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.390245 20129 consensus_queue.cc:260] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.413141 19756 catalog_manager.cc:5697] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:35.438630 20410 raft_consensus.cc:493] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.439452 20410 raft_consensus.cc:515] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.445359 20140 raft_consensus.cc:493] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.446120 20140 raft_consensus.cc:515] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.445417 20443 raft_consensus.cc:493] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.448625 20443 raft_consensus.cc:515] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.520138 20482 raft_consensus.cc:493] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.520942 20482 raft_consensus.cc:515] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.523473 20482 leader_election.cc:290] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:35.532153 20129 ts_tablet_manager.cc:1434] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.152s	user 0.008s	sys 0.020s
I20260709 12:22:35.533226 20129 tablet_bootstrap.cc:492] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:35.550952 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:35.548529 20443 leader_election.cc:290] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:35.556612 20127 tablet_bootstrap.cc:492] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:35.557168 20127 ts_tablet_manager.cc:1403] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.242s	user 0.014s	sys 0.000s
I20260709 12:22:35.540720 20468 raft_consensus.cc:493] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.572643 20140 leader_election.cc:290] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:35.580319 20127 raft_consensus.cc:359] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:35.581153 20127 raft_consensus.cc:385] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.581439 20127 raft_consensus.cc:740] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.582136 20127 consensus_queue.cc:260] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:35.587349 20410 leader_election.cc:290] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:35.590173 20183 raft_consensus.cc:493] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.590721 20183 raft_consensus.cc:515] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.591585 20362 raft_consensus.cc:493] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.574800 20468 raft_consensus.cc:515] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.592758 20183 leader_election.cc:290] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:35.594213 20468 leader_election.cc:290] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:35.595745 20362 raft_consensus.cc:515] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.597941 20362 leader_election.cc:290] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:35.598718 20130 tablet_bootstrap.cc:492] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:35.599246 20130 ts_tablet_manager.cc:1403] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.263s	user 0.010s	sys 0.004s
I20260709 12:22:35.601548 19935 raft_consensus.cc:2468] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:35.603179 20127 ts_tablet_manager.cc:1434] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:22:35.604190 20127 tablet_bootstrap.cc:492] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:35.609561 20129 tablet_bootstrap.cc:654] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.609948 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:35.610679 19860 raft_consensus.cc:2468] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:35.613267 20140 raft_consensus.cc:493] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.613744 20140 raft_consensus.cc:515] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
W20260709 12:22:35.616423 19806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:35.620388 20127 tablet_bootstrap.cc:654] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.623698 20140 leader_election.cc:290] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:35.627974 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:35.628687 20080 raft_consensus.cc:2468] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
W20260709 12:22:35.637507 19902 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 75578.2us
I20260709 12:22:35.673655 20128 tablet_bootstrap.cc:654] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:35.661425 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:35.687523 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:35.688366 19933 raft_consensus.cc:2468] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:35.687908 20130 raft_consensus.cc:359] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.689380 19826 leader_election.cc:304] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:35.689781 20130 raft_consensus.cc:385] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.690246 20140 raft_consensus.cc:2804] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.690771 20140 raft_consensus.cc:493] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.690078 20130 raft_consensus.cc:740] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.691212 20140 raft_consensus.cc:3060] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.691859 20130 consensus_queue.cc:260] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.686069 20007 raft_consensus.cc:2468] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:35.699656 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:35.724556 20080 raft_consensus.cc:2468] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:35.740154 20183 raft_consensus.cc:493] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.740794 20183 raft_consensus.cc:515] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:35.741570 20127 tablet_bootstrap.cc:492] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:35.742153 20127 ts_tablet_manager.cc:1403] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.138s	user 0.026s	sys 0.010s
I20260709 12:22:35.745288 20127 raft_consensus.cc:359] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.746112 20127 raft_consensus.cc:385] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:35.746410 20127 raft_consensus.cc:740] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:35.747148 20127 consensus_queue.cc:260] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:35.748750 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:35.752480 20127 ts_tablet_manager.cc:1434] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:22:35.753631 20127 tablet_bootstrap.cc:492] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:35.761672 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:35.762660 20009 raft_consensus.cc:2468] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:35.743129 20183 leader_election.cc:290] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
W20260709 12:22:35.763239 19975 leader_election.cc:343] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:35.772841 19826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:36799, user_credentials={real_user=slave}} blocked reactor thread for 82037.8us
I20260709 12:22:35.773754 19826 leader_election.cc:304] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
W20260709 12:22:35.775215 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 118922us
I20260709 12:22:35.780552 19975 leader_election.cc:304] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:35.781603 20133 raft_consensus.cc:2804] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.782029 20133 raft_consensus.cc:493] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.782377 20133 raft_consensus.cc:3060] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.785734 20140 raft_consensus.cc:515] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.794992 20140 leader_election.cc:290] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:35.774607 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5fc07ed3b34983a19659aac8863a06" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:35.804909 19756 catalog_manager.cc:5697] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:35.815683 19756 catalog_manager.cc:5697] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.816942 19756 catalog_manager.cc:5697] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.829422 20140 raft_consensus.cc:2804] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:35.830122 20140 raft_consensus.cc:493] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.830513 20140 raft_consensus.cc:3060] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:35.791806 20183 consensus_queue.cc:1048] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:22:35.842258 20133 raft_consensus.cc:515] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
W20260709 12:22:35.839329 19826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.2:36799, user_credentials={real_user=slave}} blocked reactor thread for 65637us
I20260709 12:22:35.813556 19934 raft_consensus.cc:2468] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:35.824359 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:35.849417 20140 raft_consensus.cc:515] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:35.878607 20130 ts_tablet_manager.cc:1434] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.279s	user 0.018s	sys 0.024s
I20260709 12:22:35.944124 20130 tablet_bootstrap.cc:492] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:35.944213 20140 leader_election.cc:290] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:35.851909 20424 raft_consensus.cc:493] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:35.947335 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:36799, user_credentials={real_user=slave}} blocked reactor thread for 117861us
I20260709 12:22:35.851011 20537 raft_consensus.cc:493] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.867075 20547 raft_consensus.cc:493] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.950965 20049 leader_election.cc:304] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:35.956956 20129 tablet_bootstrap.cc:492] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:35.957661 20129 ts_tablet_manager.cc:1403] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.425s	user 0.019s	sys 0.037s
I20260709 12:22:35.954054 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5fc07ed3b34983a19659aac8863a06" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:35.948137 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:35.936693 20081 raft_consensus.cc:2468] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:35.983629 19861 raft_consensus.cc:2468] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:35.987316 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:35.988353 20078 raft_consensus.cc:2468] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:35.989809 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:35.990617 20078 raft_consensus.cc:2468] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:35.994812 20076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:35.996125 20133 leader_election.cc:290] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:35.981087 20263 consensus_queue.cc:1048] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 12:22:36.023355 20127 tablet_bootstrap.cc:654] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.027344 20140 consensus_queue.cc:1048] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:36.059363 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 108469us
I20260709 12:22:36.018147 20282 raft_consensus.cc:2804] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.061417 20282 raft_consensus.cc:493] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.061785 20282 raft_consensus.cc:3060] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.062498 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:35.953346 20424 raft_consensus.cc:515] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.065589 20424 leader_election.cc:290] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:35.952266 20537 raft_consensus.cc:515] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:35.963358 20547 raft_consensus.cc:515] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:36.068231 20547 leader_election.cc:290] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:36.078308 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:36.079377 20424 raft_consensus.cc:493] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.079969 20424 raft_consensus.cc:515] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.081913 20424 leader_election.cc:290] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:36.081965 20129 raft_consensus.cc:359] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.082751 20129 raft_consensus.cc:385] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.083076 20129 raft_consensus.cc:740] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.083743 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:36.084376 19933 raft_consensus.cc:3060] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.086395 20130 tablet_bootstrap.cc:654] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:36.086659 20049 leader_election.cc:343] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.087724 19827 leader_election.cc:304] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:36.088549 20129 consensus_queue.cc:260] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.090978 20482 raft_consensus.cc:2804] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.094956 20482 raft_consensus.cc:493] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.095340 20482 raft_consensus.cc:3060] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.096159 20129 ts_tablet_manager.cc:1434] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.138s	user 0.006s	sys 0.001s
I20260709 12:22:36.097815 20550 consensus_queue.cc:1048] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:36.082031 19901 leader_election.cc:304] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:36.100996 19901 leader_election.cc:304] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:36.101766 20468 raft_consensus.cc:2804] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.092338 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:36.102150 20468 raft_consensus.cc:493] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.103132 20468 raft_consensus.cc:3060] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.109172 20282 raft_consensus.cc:515] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.110051 20544 consensus_queue.cc:1048] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:22:36.119938 20076 raft_consensus.cc:2393] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:36.129827 20555 raft_consensus.cc:493] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.130354 20555 raft_consensus.cc:515] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.120774 20282 leader_election.cc:290] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:36.122198 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:36.132074 20006 raft_consensus.cc:2468] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:36.132447 20555 leader_election.cc:290] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:36.125460 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:36.122453 19931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:36.137382 20129 tablet_bootstrap.cc:492] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:36.144743 19933 raft_consensus.cc:2468] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
W20260709 12:22:36.149317 20049 leader_election.cc:343] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.145056 20083 raft_consensus.cc:2468] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:36.154667 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:36.155313 19858 raft_consensus.cc:2393] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
I20260709 12:22:36.156388 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:36.157191 19858 raft_consensus.cc:2393] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
W20260709 12:22:36.148375 19975 leader_election.cc:343] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.109925 20482 raft_consensus.cc:515] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.163838 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67375288ddd4f70b9d2b85894e64783" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:36.146287 20539 raft_consensus.cc:2764] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:22:36.188529 19975 leader_election.cc:304] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:36.193077 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:36.193990 19861 raft_consensus.cc:2393] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eafc6cb9dfb7468581367b29682ec024 in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
I20260709 12:22:36.194027 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:36.194922 19856 raft_consensus.cc:2393] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86ad94e539f24675ba7226e7371cec9b in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
I20260709 12:22:36.195815 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:36.196060 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:36.196470 20077 raft_consensus.cc:3060] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.196740 20081 raft_consensus.cc:3060] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.201918 19826 leader_election.cc:304] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
W20260709 12:22:36.205137 19826 leader_election.cc:343] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.205220 20140 raft_consensus.cc:2804] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:36.205940 20140 raft_consensus.cc:697] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:36.206926 20140 consensus_queue.cc:237] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:36.211717 20133 consensus_queue.cc:1048] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:36.180059 20550 consensus_queue.cc:1048] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 12:22:36.207726 20540 raft_consensus.cc:2804] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.248512 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:36.247725 19975 leader_election.cc:304] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:36.260056 20555 raft_consensus.cc:2804] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.260506 20555 raft_consensus.cc:493] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.260833 20555 raft_consensus.cc:3060] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.262423 20128 tablet_bootstrap.cc:492] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:36.262948 20128 ts_tablet_manager.cc:1403] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.881s	user 0.036s	sys 0.022s
I20260709 12:22:36.265280 20081 raft_consensus.cc:2468] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:36.265385 20077 raft_consensus.cc:2468] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:36.208314 20468 raft_consensus.cc:515] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:36.275698 20555 raft_consensus.cc:515] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.250926 20005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:36.250731 20540 raft_consensus.cc:493] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.249590 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67375288ddd4f70b9d2b85894e64783" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
W20260709 12:22:36.254918 19901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 44988.8us
I20260709 12:22:36.295518 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:36.296456 20004 raft_consensus.cc:2393] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eafc6cb9dfb7468581367b29682ec024 in current term 1: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:36.298617 20468 leader_election.cc:290] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:36.300172 19931 raft_consensus.cc:2393] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in this term.
I20260709 12:22:36.293767 20005 raft_consensus.cc:2468] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:36.304405 20482 leader_election.cc:290] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:36.290913 20127 tablet_bootstrap.cc:492] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:36.288829 20540 raft_consensus.cc:3060] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.306074 20128 raft_consensus.cc:359] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.306694 20127 ts_tablet_manager.cc:1403] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.553s	user 0.021s	sys 0.031s
I20260709 12:22:36.306876 20128 raft_consensus.cc:385] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.307185 20128 raft_consensus.cc:740] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.308379 20128 consensus_queue.cc:260] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.309192 20129 tablet_bootstrap.cc:654] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:36.312484 19902 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 57714.5us
I20260709 12:22:36.358470 20128 ts_tablet_manager.cc:1434] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.004s
I20260709 12:22:36.374553 20130 tablet_bootstrap.cc:492] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:36.375144 20130 ts_tablet_manager.cc:1403] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.495s	user 0.011s	sys 0.025s
I20260709 12:22:36.385106 20554 raft_consensus.cc:493] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.385696 20554 raft_consensus.cc:515] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.388043 20554 leader_election.cc:290] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:36.384711 20130 raft_consensus.cc:359] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:36.390724 20130 raft_consensus.cc:385] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.391031 20130 raft_consensus.cc:740] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.396246 20130 consensus_queue.cc:260] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:36.403896 20128 tablet_bootstrap.cc:492] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:36.415318 20130 ts_tablet_manager.cc:1434] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:22:36.415412 20555 leader_election.cc:290] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:36.416532 20130 tablet_bootstrap.cc:492] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:36.367233 20537 leader_election.cc:290] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
W20260709 12:22:36.429873 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.4:45345, user_credentials={real_user=slave}} blocked reactor thread for 182212us
I20260709 12:22:36.431135 20050 leader_election.cc:304] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb
W20260709 12:22:36.436452 19902 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 83185.2us
I20260709 12:22:36.439812 20552 raft_consensus.cc:2804] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.446224 20552 raft_consensus.cc:493] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.450155 20552 raft_consensus.cc:3060] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:36.434589 19901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 77577.9us
I20260709 12:22:36.446614 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:36.452943 20077 raft_consensus.cc:2468] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 0.
I20260709 12:22:36.442791 19975 leader_election.cc:304] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:36.439632 20050 leader_election.cc:304] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:36.476218 20282 raft_consensus.cc:2749] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.476708 20050 leader_election.cc:304] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:36.477552 20282 raft_consensus.cc:2804] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.478039 20282 raft_consensus.cc:493] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.478430 20282 raft_consensus.cc:3060] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.482504 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:36.482789 19855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5fc07ed3b34983a19659aac8863a06" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:36.483347 19856 raft_consensus.cc:2393] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
I20260709 12:22:36.441234 20540 raft_consensus.cc:515] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:36.485482 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:36.483843 19855 raft_consensus.cc:2468] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:36.486465 20081 raft_consensus.cc:2393] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate 0521760b9b9046b6a1dfd0886aa228f5 in this term.
I20260709 12:22:36.485589 20540 leader_election.cc:290] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:36.491075 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5fc07ed3b34983a19659aac8863a06" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:36.492156 20007 raft_consensus.cc:2393] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:36.492606 20127 raft_consensus.cc:359] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.493316 20127 raft_consensus.cc:385] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.493706 20540 raft_consensus.cc:2749] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.493582 20127 raft_consensus.cc:740] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
W20260709 12:22:36.494096 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 51409us
I20260709 12:22:36.495193 20127 consensus_queue.cc:260] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.467119 20552 raft_consensus.cc:515] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.502841 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:36.503773 20083 raft_consensus.cc:2393] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:36.504047 20552 leader_election.cc:290] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:36.504549 20130 tablet_bootstrap.cc:654] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:36.495882 19975 leader_election.cc:343] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.508836 20282 raft_consensus.cc:515] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.506132 20127 ts_tablet_manager.cc:1434] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.199s	user 0.006s	sys 0.001s
I20260709 12:22:36.510946 20127 tablet_bootstrap.cc:492] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:36.513334 20540 consensus_queue.cc:1048] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:36.521500 20128 tablet_bootstrap.cc:654] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.523548 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f157aabf5bdd4201a3677151f9ccc1de" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:36.524435 19933 raft_consensus.cc:2468] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:36.531903 19826 leader_election.cc:304] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:36.536739 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:36.537341 20049 leader_election.cc:304] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
W20260709 12:22:36.539829 19826 leader_election.cc:343] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.541217 19826 leader_election.cc:304] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:36.540031 20554 raft_consensus.cc:2804] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.542976 20554 raft_consensus.cc:493] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.542943 20549 raft_consensus.cc:2749] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.547569 19858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5fc07ed3b34983a19659aac8863a06" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
W20260709 12:22:36.552304 20049 leader_election.cc:343] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.546396 20554 raft_consensus.cc:3060] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.557334 19858 raft_consensus.cc:3060] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.562584 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:36.539652 19901 leader_election.cc:304] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:36.574061 19858 raft_consensus.cc:2468] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:36.589895 19975 leader_election.cc:304] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:36.592590 20133 raft_consensus.cc:2804] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:36.593142 20133 raft_consensus.cc:493] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.593572 20133 raft_consensus.cc:3060] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.586839 20362 raft_consensus.cc:2749] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.611727 20133 raft_consensus.cc:515] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.615600 20282 leader_election.cc:290] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:36.623273 20129 tablet_bootstrap.cc:492] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:36.624010 20129 ts_tablet_manager.cc:1403] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.489s	user 0.017s	sys 0.003s
W20260709 12:22:36.602965 19901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 67696.4us
I20260709 12:22:36.633836 20133 leader_election.cc:290] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:36.627166 19975 leader_election.cc:304] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:36.640178 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:36.647161 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:36.622439 20551 raft_consensus.cc:2804] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:36.650699 20130 tablet_bootstrap.cc:492] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:36.651229 20130 ts_tablet_manager.cc:1403] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.235s	user 0.026s	sys 0.009s
I20260709 12:22:36.648052 20075 raft_consensus.cc:2393] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86ad94e539f24675ba7226e7371cec9b in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:36.653229 19853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
W20260709 12:22:36.654531 20572 log.cc:927] Time spent T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:22:36.655498 19931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5fc07ed3b34983a19659aac8863a06" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:36.663569 19931 raft_consensus.cc:3060] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.666258 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:36.667155 20081 raft_consensus.cc:2393] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86ad94e539f24675ba7226e7371cec9b in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:36.644245 20540 raft_consensus.cc:2804] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:36.668244 20540 raft_consensus.cc:697] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:36.669085 20540 consensus_queue.cc:237] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:36.652557 19901 leader_election.cc:304] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:36.674778 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
W20260709 12:22:36.677035 19975 leader_election.cc:343] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.659808 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f157aabf5bdd4201a3677151f9ccc1de" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:36.680984 20004 raft_consensus.cc:2468] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:36.660633 20551 raft_consensus.cc:697] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:36.682588 20551 consensus_queue.cc:237] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:36.661085 20127 tablet_bootstrap.cc:654] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.691753 20007 raft_consensus.cc:2393] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:36.693220 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
W20260709 12:22:36.693667 19975 leader_election.cc:343] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:36.695128 20130 raft_consensus.cc:359] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.738125 20130 raft_consensus.cc:385] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.697803 19759 catalog_manager.cc:5697] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:36.699019 19931 raft_consensus.cc:2468] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:36.738473 20130 raft_consensus.cc:740] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.709007 20128 tablet_bootstrap.cc:492] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:36.697839 20554 raft_consensus.cc:515] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.739487 20128 ts_tablet_manager.cc:1403] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.380s	user 0.006s	sys 0.011s
I20260709 12:22:36.739327 20130 consensus_queue.cc:260] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
W20260709 12:22:36.738144 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 44511.7us
I20260709 12:22:36.741816 20130 ts_tablet_manager.cc:1434] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.000s
I20260709 12:22:36.742365 20128 raft_consensus.cc:359] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.743108 20128 raft_consensus.cc:385] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.743753 20536 raft_consensus.cc:2764] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:22:36.738458 20004 raft_consensus.cc:2393] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eafc6cb9dfb7468581367b29682ec024 in current term 1: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:36.749894 19827 leader_election.cc:304] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:36.753517 20535 raft_consensus.cc:2749] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.755484 20128 raft_consensus.cc:740] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.756667 20554 leader_election.cc:290] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:36.756493 20128 consensus_queue.cc:260] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.730921 20005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
W20260709 12:22:36.730580 19806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:36.742769 20130 tablet_bootstrap.cc:492] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
W20260709 12:22:36.679581 20049 leader_election.cc:343] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:36.781494 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 101933us
I20260709 12:22:36.787412 20130 tablet_bootstrap.cc:654] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.791606 20128 ts_tablet_manager.cc:1434] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:22:36.793385 20128 tablet_bootstrap.cc:492] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
W20260709 12:22:36.800463 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 73008.4us
I20260709 12:22:36.803650 20130 tablet_bootstrap.cc:492] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:36.733603 20129 raft_consensus.cc:359] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:36.804162 20129 raft_consensus.cc:385] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.804486 20129 raft_consensus.cc:740] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.805251 20129 consensus_queue.cc:260] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:36.780203 20005 raft_consensus.cc:2393] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eafc6cb9dfb7468581367b29682ec024 in current term 1: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:36.773739 19975 leader_election.cc:304] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:36.804172 20130 ts_tablet_manager.cc:1403] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.000s
I20260709 12:22:36.809619 20550 raft_consensus.cc:2749] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.811591 19975 leader_election.cc:304] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:36.811887 20130 raft_consensus.cc:359] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.812727 20130 raft_consensus.cc:385] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.812986 20130 raft_consensus.cc:740] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.827589 20050 leader_election.cc:304] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:36.828706 20546 raft_consensus.cc:2749] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.829342 20050 leader_election.cc:304] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:36.829679 20130 consensus_queue.cc:260] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.830374 20546 raft_consensus.cc:2749] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.831346 20130 ts_tablet_manager.cc:1434] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:22:36.831995 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f157aabf5bdd4201a3677151f9ccc1de" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:36.832408 20130 tablet_bootstrap.cc:492] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:36.832993 20004 raft_consensus.cc:3060] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.840615 20004 raft_consensus.cc:2468] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:36.845561 20129 ts_tablet_manager.cc:1434] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.221s	user 0.007s	sys 0.001s
I20260709 12:22:36.846662 20128 tablet_bootstrap.cc:654] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.847754 20129 tablet_bootstrap.cc:492] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:36.848498 20540 raft_consensus.cc:2749] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:36.847611 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f157aabf5bdd4201a3677151f9ccc1de" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:36.848044 20130 tablet_bootstrap.cc:654] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.852147 19932 raft_consensus.cc:3060] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.857623 20129 tablet_bootstrap.cc:654] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.861552 20130 tablet_bootstrap.cc:492] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:36.862030 20130 ts_tablet_manager.cc:1403] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 12:22:36.863632 20551 consensus_queue.cc:1048] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:36.867554 20130 raft_consensus.cc:359] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:36.868312 20130 raft_consensus.cc:385] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.868629 20130 raft_consensus.cc:740] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.870138 20129 tablet_bootstrap.cc:492] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:36.870719 20129 ts_tablet_manager.cc:1403] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.002s
I20260709 12:22:36.874045 20129 raft_consensus.cc:359] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:36.874755 20129 raft_consensus.cc:385] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.874886 20535 raft_consensus.cc:493] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.875092 20129 raft_consensus.cc:740] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.876683 20535 raft_consensus.cc:515] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.882799 20535 leader_election.cc:290] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:36.883834 20128 tablet_bootstrap.cc:492] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:36.884465 20128 ts_tablet_manager.cc:1403] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.004s
I20260709 12:22:36.876022 20129 consensus_queue.cc:260] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:36.889194 20129 ts_tablet_manager.cc:1434] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:22:36.889847 20127 tablet_bootstrap.cc:492] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:36.890379 20127 ts_tablet_manager.cc:1403] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.380s	user 0.013s	sys 0.008s
I20260709 12:22:36.890468 20129 tablet_bootstrap.cc:492] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024: Bootstrap starting.
I20260709 12:22:36.899859 20129 tablet_bootstrap.cc:654] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.882918 19932 raft_consensus.cc:2468] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:36.899876 20127 raft_consensus.cc:359] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:36.904327 20127 raft_consensus.cc:385] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.904601 20127 raft_consensus.cc:740] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.906458 20128 raft_consensus.cc:359] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:36.909989 20130 consensus_queue.cc:260] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:36.913700 20130 ts_tablet_manager.cc:1434] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:22:36.914667 20130 tablet_bootstrap.cc:492] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:36.915699 20127 consensus_queue.cc:260] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:36.916927 20128 raft_consensus.cc:385] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.917347 20128 raft_consensus.cc:740] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.920647 20130 tablet_bootstrap.cc:654] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.928975 20049 leader_election.cc:304] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:36.929742 20129 tablet_bootstrap.cc:492] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024: No bootstrap required, opened a new log
I20260709 12:22:36.937846 20129 ts_tablet_manager.cc:1403] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.005s
I20260709 12:22:36.938730 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:36.939595 20081 raft_consensus.cc:2393] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:36.929878 20127 ts_tablet_manager.cc:1434] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.001s
I20260709 12:22:36.943040 20127 tablet_bootstrap.cc:492] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b: Bootstrap starting.
I20260709 12:22:36.927415 20128 consensus_queue.cc:260] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:36.931677 19759 catalog_manager.cc:5697] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 1 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.943519 20282 raft_consensus.cc:2804] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:36.944101 20282 raft_consensus.cc:697] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:36.944926 20282 consensus_queue.cc:237] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:36.948933 20129 raft_consensus.cc:359] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.949683 20129 raft_consensus.cc:385] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.949947 20129 raft_consensus.cc:740] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.950585 20129 consensus_queue.cc:260] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:36.952438 20127 tablet_bootstrap.cc:654] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.953504 20129 ts_tablet_manager.cc:1434] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:22:36.937117 20130 tablet_bootstrap.cc:492] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5: No bootstrap required, opened a new log
I20260709 12:22:36.954202 20130 ts_tablet_manager.cc:1403] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.002s
I20260709 12:22:36.971632 20535 consensus_queue.cc:1048] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:36.974900 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:36.975852 20004 raft_consensus.cc:2393] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0521760b9b9046b6a1dfd0886aa228f5 in current term 1: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:36.998780 20127 tablet_bootstrap.cc:492] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b: No bootstrap required, opened a new log
I20260709 12:22:36.969445 20128 ts_tablet_manager.cc:1434] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.000s
I20260709 12:22:37.002672 20128 tablet_bootstrap.cc:492] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:37.002527 19827 leader_election.cc:304] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5; no voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:37.004825 20551 raft_consensus.cc:3060] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.008625 20128 tablet_bootstrap.cc:654] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.015862 20551 raft_consensus.cc:2749] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.018771 20130 raft_consensus.cc:359] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:37.021186 20130 raft_consensus.cc:385] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.021672 20130 raft_consensus.cc:740] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.999387 20127 ts_tablet_manager.cc:1403] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.003s
I20260709 12:22:37.022655 20130 consensus_queue.cc:260] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:37.020313 20128 tablet_bootstrap.cc:492] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:37.023818 20128 ts_tablet_manager.cc:1403] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 12:22:37.025359 20130 ts_tablet_manager.cc:1434] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 12:22:37.026584 20128 raft_consensus.cc:359] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:37.027252 20128 raft_consensus.cc:385] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.027648 20128 raft_consensus.cc:740] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.028378 20128 consensus_queue.cc:260] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:37.030714 20127 raft_consensus.cc:359] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:37.031448 20127 raft_consensus.cc:385] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.031723 20127 raft_consensus.cc:740] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.032521 20128 ts_tablet_manager.cc:1434] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:37.032331 20127 consensus_queue.cc:260] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:37.033460 20128 tablet_bootstrap.cc:492] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb: Bootstrap starting.
I20260709 12:22:37.034471 20127 ts_tablet_manager.cc:1434] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:22:37.040201 20128 tablet_bootstrap.cc:654] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.041882 19758 catalog_manager.cc:5697] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.049381 20128 tablet_bootstrap.cc:492] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb: No bootstrap required, opened a new log
I20260709 12:22:37.050029 20128 ts_tablet_manager.cc:1403] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 12:22:37.053009 20128 raft_consensus.cc:359] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:37.053762 20128 raft_consensus.cc:385] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.054087 20128 raft_consensus.cc:740] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.054821 20128 consensus_queue.cc:260] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:37.057026 20128 ts_tablet_manager.cc:1434] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:37.062515 19756 catalog_manager.cc:5697] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.077646 20571 raft_consensus.cc:493] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.078174 20571 raft_consensus.cc:515] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:37.081349 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:37.081456 20571 leader_election.cc:290] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:37.082218 20075 raft_consensus.cc:2393] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:37.081364 20005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:37.083307 20005 raft_consensus.cc:2393] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 1: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:37.084492 19902 leader_election.cc:304] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:37.085332 20571 raft_consensus.cc:3060] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.085842 20554 raft_consensus.cc:493] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.086386 20554 raft_consensus.cc:515] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:37.089172 20554 leader_election.cc:290] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:37.091034 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67375288ddd4f70b9d2b85894e64783" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:37.091802 19856 raft_consensus.cc:2468] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:37.092916 20049 leader_election.cc:304] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:37.093765 20554 raft_consensus.cc:2804] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.094194 20554 raft_consensus.cc:493] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.094583 20554 raft_consensus.cc:3060] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.094812 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67375288ddd4f70b9d2b85894e64783" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:37.095566 19930 raft_consensus.cc:2468] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:37.101226 20571 raft_consensus.cc:2749] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.104238 20554 raft_consensus.cc:515] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:37.107514 20554 leader_election.cc:290] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:37.110239 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67375288ddd4f70b9d2b85894e64783" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:37.110961 19856 raft_consensus.cc:3060] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.118986 19856 raft_consensus.cc:2468] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:37.125473 20049 leader_election.cc:304] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:37.127990 20554 raft_consensus.cc:2804] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.128559 20554 raft_consensus.cc:697] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:37.129652 20554 consensus_queue.cc:237] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:37.136476 20540 consensus_queue.cc:1048] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.134450 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67375288ddd4f70b9d2b85894e64783" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:37.140883 19932 raft_consensus.cc:3060] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.150440 20540 consensus_queue.cc:1048] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.157135 19755 catalog_manager.cc:5697] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.164877 19932 raft_consensus.cc:2468] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:37.190716 20535 raft_consensus.cc:493] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.191320 20535 raft_consensus.cc:515] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:37.193245 20554 raft_consensus.cc:493] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.193835 20554 raft_consensus.cc:515] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:37.199616 20554 leader_election.cc:290] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:37.201270 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b2d93090d64da389b15b3b5b736ae2" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:37.202014 19932 raft_consensus.cc:2468] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:37.202943 20049 leader_election.cc:304] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:37.203723 20554 raft_consensus.cc:2804] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.204097 20554 raft_consensus.cc:493] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.204150 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b2d93090d64da389b15b3b5b736ae2" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:37.204689 20554 raft_consensus.cc:3060] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.205001 19860 raft_consensus.cc:2468] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 0.
I20260709 12:22:37.206115 20551 consensus_queue.cc:1048] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.204969 20005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacfd09289c4d5a8b72e5391c896c26" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:37.208051 20005 raft_consensus.cc:2468] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:37.211707 19827 leader_election.cc:304] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:37.212587 20569 raft_consensus.cc:493] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.217653 20569 raft_consensus.cc:515] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:37.221227 20569 leader_election.cc:290] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:37.213336 20547 consensus_queue.cc:1048] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:22:37.223548 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebcd105158424342b29d433430a26086" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:37.224573 20004 raft_consensus.cc:2468] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:37.226212 19902 leader_election.cc:304] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:37.227173 20569 raft_consensus.cc:2804] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.227646 20569 raft_consensus.cc:493] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.227710 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacfd09289c4d5a8b72e5391c896c26" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:37.228150 20569 raft_consensus.cc:3060] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.225818 20554 raft_consensus.cc:515] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:37.228458 20075 raft_consensus.cc:2468] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 0.
I20260709 12:22:37.230196 20554 leader_election.cc:290] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:37.213585 20551 raft_consensus.cc:2804] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.233287 20551 raft_consensus.cc:493] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.233650 20551 raft_consensus.cc:3060] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.238031 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebcd105158424342b29d433430a26086" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:37.239099 19860 raft_consensus.cc:2468] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 0.
I20260709 12:22:37.239784 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b2d93090d64da389b15b3b5b736ae2" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:37.240460 19932 raft_consensus.cc:3060] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.244277 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b2d93090d64da389b15b3b5b736ae2" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:37.245005 19856 raft_consensus.cc:3060] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.217408 20535 leader_election.cc:290] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:37.264968 19856 raft_consensus.cc:2468] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:37.265796 19932 raft_consensus.cc:2468] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:37.266497 20049 leader_election.cc:304] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:37.267485 20554 raft_consensus.cc:2804] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.268162 20554 raft_consensus.cc:697] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:37.269140 20554 consensus_queue.cc:237] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:37.265940 20551 raft_consensus.cc:515] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:37.273631 20569 raft_consensus.cc:515] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:37.275590 20551 leader_election.cc:290] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:37.276592 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacfd09289c4d5a8b72e5391c896c26" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:37.277252 20004 raft_consensus.cc:3060] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.281605 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacfd09289c4d5a8b72e5391c896c26" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:37.282280 20075 raft_consensus.cc:3060] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.284650 20004 raft_consensus.cc:2468] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:37.285961 19827 leader_election.cc:304] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:37.286983 20547 raft_consensus.cc:2804] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.287588 20547 raft_consensus.cc:697] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:37.288146 20569 leader_election.cc:290] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:37.288455 20547 consensus_queue.cc:237] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:37.289773 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebcd105158424342b29d433430a26086" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:37.290419 19856 raft_consensus.cc:3060] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.295799 20075 raft_consensus.cc:2468] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 1.
I20260709 12:22:37.300745 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebcd105158424342b29d433430a26086" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:37.301503 20004 raft_consensus.cc:3060] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.311348 19856 raft_consensus.cc:2468] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:37.311183 19759 catalog_manager.cc:5697] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.312747 19901 leader_election.cc:304] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:37.313730 20569 raft_consensus.cc:2804] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.314424 20569 raft_consensus.cc:697] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:37.315048 20004 raft_consensus.cc:2468] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:37.315274 20569 consensus_queue.cc:237] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:37.324461 19755 catalog_manager.cc:5697] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 1, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 1 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.329876 19759 catalog_manager.cc:5697] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 0 to 1, leader changed from <none> to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 1 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.466758 20554 consensus_queue.cc:1048] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.481525 20282 consensus_queue.cc:1048] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.617084 20554 consensus_queue.cc:1048] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.637249 20610 consensus_queue.cc:1048] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.665231 20610 consensus_queue.cc:1048] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.677757 20554 consensus_queue.cc:1048] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.710246 20571 consensus_queue.cc:1048] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.731643 20571 consensus_queue.cc:1048] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.749076 20547 consensus_queue.cc:1048] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.760969 20551 consensus_queue.cc:1048] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:37.823838 19806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:38.183666 20546 raft_consensus.cc:493] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.184216 20546 raft_consensus.cc:515] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:38.185962 20546 leader_election.cc:290] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:38.186923 20005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:38.187031 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:38.187832 20005 raft_consensus.cc:2468] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:38.187930 19856 raft_consensus.cc:2468] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:38.189035 20050 leader_election.cc:304] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:38.189793 20546 raft_consensus.cc:2804] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:38.190152 20546 raft_consensus.cc:493] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.190479 20546 raft_consensus.cc:3060] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.197642 20546 raft_consensus.cc:515] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:38.200073 20005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:38.200258 19856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:38.199338 20546 leader_election.cc:290] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:38.200755 20005 raft_consensus.cc:3060] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.201113 19856 raft_consensus.cc:3060] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.207006 19856 raft_consensus.cc:2468] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:38.207278 20005 raft_consensus.cc:2468] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:38.208310 20049 leader_election.cc:304] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:38.208951 20546 raft_consensus.cc:2804] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:38.209494 20546 raft_consensus.cc:697] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:38.210296 20546 consensus_queue.cc:237] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:38.222927 19758 catalog_manager.cc:5697] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 2, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 2 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.625281 20282 raft_consensus.cc:493] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.626935 20282 raft_consensus.cc:515] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:38.642760 20282 leader_election.cc:290] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:38.646345 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:38.643534 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:38.650336 19859 raft_consensus.cc:2468] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:38.655273 20049 leader_election.cc:304] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:38.656771 20546 raft_consensus.cc:2804] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:38.657301 20546 raft_consensus.cc:493] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.657771 20546 raft_consensus.cc:3060] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.650341 20004 raft_consensus.cc:2468] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:38.684072 20546 raft_consensus.cc:515] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:38.696969 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:38.697813 20004 raft_consensus.cc:3060] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.705721 20546 leader_election.cc:290] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:38.707079 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f4a78b032347e688bf751ec532d805" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:38.708060 19859 raft_consensus.cc:3060] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.714265 20004 raft_consensus.cc:2468] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:38.715962 20050 leader_election.cc:304] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:38.719718 20546 raft_consensus.cc:2804] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:38.720402 20546 raft_consensus.cc:697] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:38.720716 19859 raft_consensus.cc:2468] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:38.721948 20546 consensus_queue.cc:237] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:38.773268 19758 catalog_manager.cc:5697] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 0 to 2, leader changed from <none> to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 2 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.785277 19860 raft_consensus.cc:1275] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:38.802563 20621 raft_consensus.cc:493] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.803686 20621 raft_consensus.cc:515] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:38.805730 20546 consensus_queue.cc:1048] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:38.812556 20005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:38.813476 20005 raft_consensus.cc:2468] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:38.814733 20621 leader_election.cc:290] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:38.823309 20004 raft_consensus.cc:1275] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:38.823889 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:38.824750 20079 raft_consensus.cc:2468] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:38.849617 20282 consensus_queue.cc:1048] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:38.852139 19902 leader_election.cc:304] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:38.854336 20630 raft_consensus.cc:2804] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:38.854933 20630 raft_consensus.cc:493] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.855378 20630 raft_consensus.cc:3060] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.866845 20630 raft_consensus.cc:515] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:38.870782 20630 leader_election.cc:290] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:38.882206 20005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:38.883031 20005 raft_consensus.cc:3060] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:38.883852 19901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 69113.8us
I20260709 12:22:38.888602 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:38.889343 20075 raft_consensus.cc:3060] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.902544 20005 raft_consensus.cc:2468] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:38.903905 19902 leader_election.cc:304] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:38.906176 20621 raft_consensus.cc:2804] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:38.906769 20621 raft_consensus.cc:697] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:38.907999 20621 consensus_queue.cc:237] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:38.949543 19755 catalog_manager.cc:5697] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 0 to 2, leader changed from <none> to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 2 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.984911 20075 raft_consensus.cc:2468] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:39.124214 11916 tablet_server.cc:179] TabletServer@127.11.163.1:0 shutting down...
W20260709 12:22:39.138265 20049 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:39.144261 20049 consensus_peers.cc:597] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.174310 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:39.175566 11916 tablet_replica.cc:333] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.176723 11916 raft_consensus.cc:2243] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.177239 11916 raft_consensus.cc:2272] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.179941 11916 tablet_replica.cc:333] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.180980 11916 raft_consensus.cc:2243] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.181420 11916 raft_consensus.cc:2272] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.183980 11916 tablet_replica.cc:333] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.184762 11916 raft_consensus.cc:2243] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.185204 11916 raft_consensus.cc:2272] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.190222 11916 tablet_replica.cc:333] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.191006 11916 raft_consensus.cc:2243] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.192091 11916 raft_consensus.cc:2272] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.194227 11916 tablet_replica.cc:333] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.195000 11916 raft_consensus.cc:2243] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.196291 11916 raft_consensus.cc:2272] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:39.199064 20049 consensus_peers.cc:597] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.199751 11916 tablet_replica.cc:333] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.200517 11916 raft_consensus.cc:2243] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.201121 11916 raft_consensus.cc:2272] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.203979 11916 tablet_replica.cc:333] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.205039 11916 raft_consensus.cc:2243] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.206241 11916 raft_consensus.cc:2272] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.208957 11916 tablet_replica.cc:333] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.209920 11916 raft_consensus.cc:2243] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.210457 11916 raft_consensus.cc:2272] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.212857 11916 tablet_replica.cc:333] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.213665 11916 raft_consensus.cc:2243] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.214785 11916 raft_consensus.cc:2272] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.217638 11916 tablet_replica.cc:333] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.218377 11916 raft_consensus.cc:2243] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.218963 11916 raft_consensus.cc:2272] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:39.219707 20049 consensus_peers.cc:597] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.222162 11916 tablet_replica.cc:333] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.222852 11916 raft_consensus.cc:2243] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.223671 11916 raft_consensus.cc:2272] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.226646 11916 tablet_replica.cc:333] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.227408 11916 raft_consensus.cc:2243] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.228276 11916 raft_consensus.cc:2272] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.231333 11916 tablet_replica.cc:333] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.232416 11916 raft_consensus.cc:2243] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.233031 11916 raft_consensus.cc:2272] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:39.233425 20049 consensus_peers.cc:597] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.236518 11916 tablet_replica.cc:333] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
W20260709 12:22:39.238696 19975 consensus_peers.cc:597] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.239061 11916 raft_consensus.cc:2243] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.240396 11916 raft_consensus.cc:2272] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:39.240851 19901 consensus_peers.cc:597] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.243040 11916 tablet_replica.cc:333] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.243772 11916 raft_consensus.cc:2243] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.244239 11916 raft_consensus.cc:2272] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.246502 11916 tablet_replica.cc:333] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.247094 11916 raft_consensus.cc:2243] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.247608 11916 raft_consensus.cc:2272] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.250449 11916 tablet_replica.cc:333] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.251148 11916 raft_consensus.cc:2243] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.251664 11916 raft_consensus.cc:2272] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:39.252612 19975 consensus_peers.cc:597] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.254110 11916 tablet_replica.cc:333] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.254761 11916 raft_consensus.cc:2243] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.255229 11916 raft_consensus.cc:2272] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.258296 11916 tablet_replica.cc:333] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.259202 11916 raft_consensus.cc:2243] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:22:39.259876 19901 consensus_peers.cc:597] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.260281 11916 raft_consensus.cc:2272] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.262547 11916 tablet_replica.cc:333] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.263599 11916 raft_consensus.cc:2243] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.264307 11916 raft_consensus.cc:2272] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.265326 20004 raft_consensus.cc:1275] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:39.268736 11916 tablet_replica.cc:333] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.269731 11916 raft_consensus.cc:2243] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.270344 11916 raft_consensus.cc:2272] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:39.272413 20049 consensus_peers.cc:597] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.267154 20554 consensus_queue.cc:1048] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:22:39.273763 11916 tablet_replica.cc:333] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.274576 11916 raft_consensus.cc:2243] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.275143 11916 raft_consensus.cc:2272] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.278890 11916 tablet_replica.cc:333] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.279831 11916 raft_consensus.cc:2243] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.280988 11916 raft_consensus.cc:2272] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.285771 11916 tablet_replica.cc:333] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.286657 11916 raft_consensus.cc:2243] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.287787 11916 raft_consensus.cc:2272] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.291126 11916 tablet_replica.cc:333] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.291952 11916 raft_consensus.cc:2243] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.293146 11916 raft_consensus.cc:2272] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:39.293965 20049 consensus_peers.cc:597] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.296216 11916 tablet_replica.cc:333] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.297086 11916 raft_consensus.cc:2243] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.297657 11916 raft_consensus.cc:2272] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.301497 11916 tablet_replica.cc:333] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.302042 11916 raft_consensus.cc:2243] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:39.302596 19901 consensus_peers.cc:597] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.302624 11916 raft_consensus.cc:2272] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.305855 11916 tablet_replica.cc:333] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.306448 11916 raft_consensus.cc:2243] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.306926 11916 raft_consensus.cc:2272] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.309885 11916 tablet_replica.cc:333] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
W20260709 12:22:39.310448 19901 consensus_peers.cc:597] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.310541 11916 raft_consensus.cc:2243] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.311968 11916 raft_consensus.cc:2272] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.314004 11916 tablet_replica.cc:333] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.314527 11916 raft_consensus.cc:2243] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.314890 11916 raft_consensus.cc:2272] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.317476 11916 tablet_replica.cc:333] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.318418 11916 raft_consensus.cc:2243] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.319561 11916 raft_consensus.cc:2272] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.322679 11916 tablet_replica.cc:333] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.323446 11916 raft_consensus.cc:2243] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.323954 11916 raft_consensus.cc:2272] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:39.324301 19975 consensus_peers.cc:597] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.326335 11916 tablet_replica.cc:333] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.326928 11916 raft_consensus.cc:2243] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.327332 11916 raft_consensus.cc:2272] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.329335 11916 tablet_replica.cc:333] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.329854 11916 raft_consensus.cc:2243] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.330236 11916 raft_consensus.cc:2272] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.332252 11916 tablet_replica.cc:333] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.332844 11916 raft_consensus.cc:2243] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.333281 11916 raft_consensus.cc:2272] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.336019 11916 tablet_replica.cc:333] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.336786 11916 raft_consensus.cc:2243] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.337361 11916 raft_consensus.cc:2272] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.339510 11916 tablet_replica.cc:333] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.340193 11916 raft_consensus.cc:2243] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.340662 11916 raft_consensus.cc:2272] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.342728 11916 tablet_replica.cc:333] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.343390 11916 raft_consensus.cc:2243] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.344475 11916 raft_consensus.cc:2272] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.346980 11916 tablet_replica.cc:333] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.347577 11916 raft_consensus.cc:2243] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.348093 11916 raft_consensus.cc:2272] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.350768 11916 tablet_replica.cc:333] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
W20260709 12:22:39.351369 19975 consensus_peers.cc:597] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.351497 11916 raft_consensus.cc:2243] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:39.352947 11916 raft_consensus.cc:2272] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.356681 11916 tablet_replica.cc:333] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
W20260709 12:22:39.356665 19901 consensus_peers.cc:597] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.357594 11916 raft_consensus.cc:2243] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.358314 11916 raft_consensus.cc:2272] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:39.358425 20049 consensus_peers.cc:597] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.361550 11916 tablet_replica.cc:333] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.362298 11916 raft_consensus.cc:2243] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.362854 11916 raft_consensus.cc:2272] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.365917 11916 tablet_replica.cc:333] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.366590 11916 raft_consensus.cc:2243] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.367130 11916 raft_consensus.cc:2272] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.370144 11916 tablet_replica.cc:333] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
W20260709 12:22:39.370221 19975 consensus_peers.cc:597] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.371332 11916 raft_consensus.cc:2243] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:22:39.372618 20049 consensus_peers.cc:597] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.372633 11916 raft_consensus.cc:2272] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:39.374478 19975 consensus_peers.cc:597] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.376394 11916 tablet_replica.cc:333] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5: stopping tablet replica
I20260709 12:22:39.377204 11916 raft_consensus.cc:2243] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:39.377324 20075 raft_consensus.cc:1275] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:39.377843 11916 raft_consensus.cc:2272] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:39.379220 20642 consensus_queue.cc:1048] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:39.387173 20049 consensus_peers.cc:597] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:39.406884 20049 consensus_peers.cc:597] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.410120 20004 raft_consensus.cc:1275] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:39.411749 20621 consensus_queue.cc:1048] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:39.423727 19975 consensus_peers.cc:597] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:39.442950 20049 consensus_peers.cc:597] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.479969 11916 tablet_server.cc:196] TabletServer@127.11.163.1:0 shutdown complete.
W20260709 12:22:39.481611 19901 consensus_peers.cc:597] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:39.482250 19901 consensus_peers.cc:597] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:39.485014 19975 consensus_peers.cc:597] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.560609 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:39.571063 20658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:39.569875 20657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:39.584308 19901 consensus_peers.cc:597] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.592841 11916 server_base.cc:1061] running on GCE node
W20260709 12:22:39.593714 20049 consensus_peers.cc:597] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:39.593736 20660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:39.597666 19975 consensus_peers.cc:597] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.598759 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:39.599092 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:39.599318 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599759599300 us; error 0 us; skew 500 ppm
I20260709 12:22:39.600100 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:39.606088 11916 webserver.cc:533] Webserver started at http://127.11.163.1:34089/ using document root <none> and password file <none>
I20260709 12:22:39.606766 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:39.607013 11916 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:22:39.614360 11916 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.005s	sys 0.000s
W20260709 12:22:39.618007 19901 consensus_peers.cc:597] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:39.620872 20049 consensus_peers.cc:597] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.624601 20666 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.625525 11916 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:22:39.625972 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-0-root
uuid: "0521760b9b9046b6a1dfd0886aa228f5"
format_stamp: "Formatted at 2026-07-09 12:22:26 on dist-test-slave-z9f9"
I20260709 12:22:39.626343 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599438829268-11916-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:39.653796 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:39.655293 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:39.657044 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:39.662596 20673 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:22:39.948915 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:22:39.949267 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.288s	user 0.008s	sys 0.001s
I20260709 12:22:39.949623 11916 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:22:39.955201 20673 tablet_bootstrap.cc:492] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:39.973857 20673 tablet_bootstrap.cc:492] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:39.974671 20673 tablet_bootstrap.cc:492] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:39.975243 20673 ts_tablet_manager.cc:1403] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:22:39.978000 20673 raft_consensus.cc:359] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:39.978685 20673 raft_consensus.cc:740] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.979377 20673 consensus_queue.cc:260] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:39.986085 20673 ts_tablet_manager.cc:1434] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:22:39.987083 20673 tablet_bootstrap.cc:492] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:39.999010 20673 tablet_bootstrap.cc:492] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:39.999768 20673 tablet_bootstrap.cc:492] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.000329 20673 ts_tablet_manager.cc:1403] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 12:22:40.002112 20673 raft_consensus.cc:359] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.002622 20673 raft_consensus.cc:740] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.003201 20673 consensus_queue.cc:260] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.005020 20673 ts_tablet_manager.cc:1434] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:22:40.005910 20673 tablet_bootstrap.cc:492] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.035794 20673 tablet_bootstrap.cc:492] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.043151 20673 tablet_bootstrap.cc:492] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.043855 20673 ts_tablet_manager.cc:1403] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.008s
I20260709 12:22:40.046417 20673 raft_consensus.cc:359] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.047609 20673 raft_consensus.cc:740] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.048288 20673 consensus_queue.cc:260] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.050386 20673 ts_tablet_manager.cc:1434] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:40.051177 20673 tablet_bootstrap.cc:492] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.080157 20673 tablet_bootstrap.cc:492] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.081112 20673 tablet_bootstrap.cc:492] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.081743 20673 ts_tablet_manager.cc:1403] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.011s
I20260709 12:22:40.084218 20673 raft_consensus.cc:359] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.084893 20673 raft_consensus.cc:740] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.085673 20673 consensus_queue.cc:260] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.087611 20673 ts_tablet_manager.cc:1434] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:40.088385 20673 tablet_bootstrap.cc:492] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.114265 20673 tablet_bootstrap.cc:492] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.115226 20673 tablet_bootstrap.cc:492] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.115902 20673 ts_tablet_manager.cc:1403] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.012s
I20260709 12:22:40.118737 20673 raft_consensus.cc:359] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.119379 20673 raft_consensus.cc:740] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.120136 20673 consensus_queue.cc:260] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.122107 20673 ts_tablet_manager.cc:1434] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:40.122881 20673 tablet_bootstrap.cc:492] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.155668 20673 tablet_bootstrap.cc:492] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.156407 20673 tablet_bootstrap.cc:492] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.156948 20673 ts_tablet_manager.cc:1403] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.008s
I20260709 12:22:40.159157 20673 raft_consensus.cc:359] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.159838 20673 raft_consensus.cc:740] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.160540 20673 consensus_queue.cc:260] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.162607 20673 ts_tablet_manager.cc:1434] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:40.163376 20673 tablet_bootstrap.cc:492] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.176707 20673 tablet_bootstrap.cc:492] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.177722 20673 tablet_bootstrap.cc:492] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.178406 20673 ts_tablet_manager.cc:1403] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:22:40.181242 20673 raft_consensus.cc:359] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.182029 20673 raft_consensus.cc:740] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.182763 20673 consensus_queue.cc:260] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.185142 20673 ts_tablet_manager.cc:1434] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:40.186030 20673 tablet_bootstrap.cc:492] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.205539 20673 tablet_bootstrap.cc:492] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.206610 20673 tablet_bootstrap.cc:492] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.207288 20673 ts_tablet_manager.cc:1403] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:22:40.210115 20673 raft_consensus.cc:359] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.210853 20673 raft_consensus.cc:740] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.211750 20673 consensus_queue.cc:260] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.214018 20673 ts_tablet_manager.cc:1434] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:40.214859 20673 tablet_bootstrap.cc:492] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.232178 20673 tablet_bootstrap.cc:492] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.233186 20673 tablet_bootstrap.cc:492] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.233807 20673 ts_tablet_manager.cc:1403] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:22:40.236321 20673 raft_consensus.cc:359] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.236969 20673 raft_consensus.cc:740] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.237668 20673 consensus_queue.cc:260] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.238704 11916 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:22:40.239061 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.289s	user 0.254s	sys 0.000s
I20260709 12:22:40.239578 20673 ts_tablet_manager.cc:1434] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:22:40.240496 20673 tablet_bootstrap.cc:492] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.257146 20673 tablet_bootstrap.cc:492] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.258054 20673 tablet_bootstrap.cc:492] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.258697 20673 ts_tablet_manager.cc:1403] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:22:40.262146 20673 raft_consensus.cc:359] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.262953 20673 raft_consensus.cc:740] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.263906 20673 consensus_queue.cc:260] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.266471 20673 ts_tablet_manager.cc:1434] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:22:40.267583 20673 tablet_bootstrap.cc:492] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.287322 20673 tablet_bootstrap.cc:492] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.288509 20673 tablet_bootstrap.cc:492] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.289374 20673 ts_tablet_manager.cc:1403] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 12:22:40.292647 20673 raft_consensus.cc:359] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.293573 20673 raft_consensus.cc:740] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.294493 20673 consensus_queue.cc:260] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.297130 20673 ts_tablet_manager.cc:1434] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:40.298184 20673 tablet_bootstrap.cc:492] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.318738 20673 tablet_bootstrap.cc:492] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.320034 20673 tablet_bootstrap.cc:492] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.320892 20673 ts_tablet_manager.cc:1403] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 12:22:40.321228 20550 raft_consensus.cc:493] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.321924 20550 raft_consensus.cc:515] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.324331 20550 leader_election.cc:290] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.324509 20673 raft_consensus.cc:359] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.326340 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacfd09289c4d5a8b72e5391c896c26" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:40.325585 20673 raft_consensus.cc:740] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.329103 20673 consensus_queue.cc:260] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.333851 20673 ts_tablet_manager.cc:1434] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
W20260709 12:22:40.334669 19975 leader_election.cc:336] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111)
I20260709 12:22:40.334893 20673 tablet_bootstrap.cc:492] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.335390 19975 leader_election.cc:304] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:40.336426 20674 raft_consensus.cc:2749] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:40.337527 20282 raft_consensus.cc:493] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.338145 20282 raft_consensus.cc:515] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.340319 20282 leader_election.cc:290] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:40.344133 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
W20260709 12:22:40.347071 20049 leader_election.cc:336] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111)
I20260709 12:22:40.347586 20049 leader_election.cc:304] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:40.348250 20282 raft_consensus.cc:2749] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:40.355121 20673 tablet_bootstrap.cc:492] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.356024 20673 tablet_bootstrap.cc:492] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.356675 20673 ts_tablet_manager.cc:1403] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.012s
I20260709 12:22:40.359371 20282 raft_consensus.cc:493] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.359601 20673 raft_consensus.cc:359] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.359984 20282 raft_consensus.cc:515] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.360337 20673 raft_consensus.cc:740] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.362049 20282 leader_election.cc:290] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:40.361284 20673 consensus_queue.cc:260] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.364856 20673 ts_tablet_manager.cc:1434] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:40.364710 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ae825dd7c04568bd5e70cd1433e282" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:40.365680 20673 tablet_bootstrap.cc:492] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
W20260709 12:22:40.374172 20049 leader_election.cc:336] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111)
I20260709 12:22:40.374689 20049 leader_election.cc:304] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:40.375535 20282 raft_consensus.cc:2749] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:40.376467 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.1:39037
I20260709 12:22:40.376777 20745 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.1:39037 every 8 connection(s)
I20260709 12:22:40.381484 20673 tablet_bootstrap.cc:492] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.381652 20621 raft_consensus.cc:493] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.382231 20621 raft_consensus.cc:515] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.382799 20673 tablet_bootstrap.cc:492] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.383512 20673 ts_tablet_manager.cc:1403] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:22:40.384405 20621 leader_election.cc:290] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.387598 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ae825dd7c04568bd5e70cd1433e282" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:40.388345 20079 raft_consensus.cc:2468] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:40.388080 20673 raft_consensus.cc:359] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.388924 20673 raft_consensus.cc:740] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.389904 19901 leader_election.cc:304] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:40.390929 20630 raft_consensus.cc:2804] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.391407 20630 raft_consensus.cc:493] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.392001 20630 raft_consensus.cc:3060] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.389736 20673 consensus_queue.cc:260] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.393654 20673 ts_tablet_manager.cc:1434] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:22:40.394491 20673 tablet_bootstrap.cc:492] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.395956 20621 raft_consensus.cc:493] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.396545 20621 raft_consensus.cc:515] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.400804 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:40.403440 20621 leader_election.cc:290] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.418304 20642 raft_consensus.cc:493] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.418953 20642 raft_consensus.cc:515] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.421474 20642 leader_election.cc:290] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.422775 20642 raft_consensus.cc:493] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.423386 20642 raft_consensus.cc:515] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.425623 20673 tablet_bootstrap.cc:492] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.425824 20642 leader_election.cc:290] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.426868 20673 tablet_bootstrap.cc:492] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.427481 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:40.427788 20673 ts_tablet_manager.cc:1403] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.005s
I20260709 12:22:40.428267 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:40.431526 20673 raft_consensus.cc:359] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.432500 20673 raft_consensus.cc:740] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.433372 20673 consensus_queue.cc:260] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.436015 20673 ts_tablet_manager.cc:1434] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:40.437129 20673 tablet_bootstrap.cc:492] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.415191 20630 raft_consensus.cc:515] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.450311 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ae825dd7c04568bd5e70cd1433e282" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:40.451231 20075 raft_consensus.cc:3060] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.459342 20554 raft_consensus.cc:493] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.460032 20554 raft_consensus.cc:515] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.460740 20075 raft_consensus.cc:2468] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:40.462178 19901 leader_election.cc:304] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:40.463653 20554 leader_election.cc:290] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.464299 20621 raft_consensus.cc:2804] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.465034 20630 leader_election.cc:290] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.464949 20673 tablet_bootstrap.cc:492] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.466466 20621 raft_consensus.cc:697] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:40.467247 20673 tablet_bootstrap.cc:492] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.468477 20673 ts_tablet_manager.cc:1403] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.008s
I20260709 12:22:40.459458 20282 raft_consensus.cc:493] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.467715 20621 consensus_queue.cc:237] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.470103 20282 raft_consensus.cc:515] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.472656 20673 raft_consensus.cc:359] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.473323 20282 leader_election.cc:290] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:40.473697 20673 raft_consensus.cc:740] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.474304 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:40.496637 19930 raft_consensus.cc:2468] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:40.496486 20673 consensus_queue.cc:260] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.498898 20049 leader_election.cc:304] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:40.482898 20674 raft_consensus.cc:493] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.500582 20674 raft_consensus.cc:515] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.503947 20674 leader_election.cc:290] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.499221 20673 ts_tablet_manager.cc:1434] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:22:40.499984 20546 raft_consensus.cc:2804] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:40.490267 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 64544.3us
I20260709 12:22:40.504076 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:40.504779 20546 raft_consensus.cc:493] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.505270 20673 tablet_bootstrap.cc:492] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.505208 20075 raft_consensus.cc:2468] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:40.505196 20546 raft_consensus.cc:3060] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.507125 20005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:40.507891 20005 raft_consensus.cc:2468] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:40.503820 20554 raft_consensus.cc:493] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.509739 19975 leader_election.cc:304] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:40.510260 20554 raft_consensus.cc:515] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.513546 20674 raft_consensus.cc:2804] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.514147 20674 raft_consensus.cc:493] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.514544 20554 leader_election.cc:290] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.514648 20674 raft_consensus.cc:3060] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.515511 20282 raft_consensus.cc:493] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.515972 20282 raft_consensus.cc:515] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.517904 20282 leader_election.cc:290] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:40.518898 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:40.519586 19930 raft_consensus.cc:2468] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:40.521157 20049 leader_election.cc:304] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:40.524272 20756 raft_consensus.cc:2804] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.526583 20756 raft_consensus.cc:493] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.526947 20756 raft_consensus.cc:3060] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.527058 20709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.535718 20050 leader_election.cc:304] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:40.540750 20282 raft_consensus.cc:2804] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.541201 20282 raft_consensus.cc:493] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.541824 20282 raft_consensus.cc:3060] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:40.554206 19901 leader_election.cc:343] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.554764 19901 leader_election.cc:304] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:40.554859 20718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ae825dd7c04568bd5e70cd1433e282" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.557415 20673 tablet_bootstrap.cc:492] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:40.558132 20719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.558594 20673 tablet_bootstrap.cc:492] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.559110 20719 raft_consensus.cc:2468] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:40.559523 20673 ts_tablet_manager.cc:1403] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.012s
I20260709 12:22:40.561796 20711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ae825dd7c04568bd5e70cd1433e282" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.562870 20673 raft_consensus.cc:359] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.563583 20621 raft_consensus.cc:2749] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:40.563781 20673 raft_consensus.cc:740] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.564896 20673 consensus_queue.cc:260] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.566845 20673 ts_tablet_manager.cc:1434] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:40.566682 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6778cad39436ab0a260f86049592f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:40.568174 20673 tablet_bootstrap.cc:492] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:40.557090 20710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.545154 20709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.570814 20674 raft_consensus.cc:515] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.573278 19758 catalog_manager.cc:5697] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 2 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:40.571966 19901 leader_election.cc:343] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.578001 20709 raft_consensus.cc:2468] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:40.563603 20714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.579777 20183 raft_consensus.cc:493] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.580430 20183 raft_consensus.cc:515] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.582607 20183 leader_election.cc:290] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
W20260709 12:22:40.583459 19901 leader_election.cc:343] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.583735 20546 raft_consensus.cc:515] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.584666 19901 leader_election.cc:304] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:40.585629 20621 raft_consensus.cc:2804] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.586222 20621 raft_consensus.cc:493] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.586611 20674 leader_election.cc:290] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.586685 20621 raft_consensus.cc:3060] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.596707 20713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6778cad39436ab0a260f86049592f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.597455 20713 raft_consensus.cc:2468] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:40.594756 20758 raft_consensus.cc:493] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.593124 20711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.598604 20758 raft_consensus.cc:515] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
W20260709 12:22:40.602593 19901 leader_election.cc:343] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.603253 19901 leader_election.cc:304] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:40.586920 20546 leader_election.cc:290] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:40.600961 20758 leader_election.cc:290] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.608335 20759 raft_consensus.cc:2749] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:40.616356 20049 leader_election.cc:343] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.617956 20049 leader_election.cc:304] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
W20260709 12:22:40.618760 20049 leader_election.cc:343] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.618929 20765 raft_consensus.cc:2804] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.619488 20765 raft_consensus.cc:493] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.619875 20765 raft_consensus.cc:3060] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.622870 20747 heartbeater.cc:344] Connected to a master server at 127.11.163.62:41995
I20260709 12:22:40.623368 20747 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:40.624338 20747 heartbeater.cc:507] Master 127.11.163.62:41995 requested a full tablet report, sending...
I20260709 12:22:40.626137 20714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.626981 20714 raft_consensus.cc:3060] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.615098 20710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0efb7c87754b739cb88f4e13cb66c6" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.627872 20710 raft_consensus.cc:2468] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:40.629222 19901 leader_election.cc:304] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:40.630255 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:40.630046 20630 raft_consensus.cc:493] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.632915 20630 raft_consensus.cc:515] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.634712 20554 raft_consensus.cc:493] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.635455 20758 raft_consensus.cc:2804] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.635967 20758 raft_consensus.cc:493] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.636314 20758 raft_consensus.cc:3060] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.636266 20710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16c8dbaaffb4ff58286d705232636e3" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
W20260709 12:22:40.637884 19901 leader_election.cc:343] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.639499 20554 raft_consensus.cc:515] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.642194 20554 leader_election.cc:290] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
W20260709 12:22:40.642843 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:36799, user_credentials={real_user=slave}} blocked reactor thread for 103289us
I20260709 12:22:40.646588 20282 raft_consensus.cc:515] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.651038 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0efb7c87754b739cb88f4e13cb66c6" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:40.651937 20079 raft_consensus.cc:2468] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:40.653007 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:40.653401 20710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.654155 20710 raft_consensus.cc:2468] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:40.657673 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:40.658720 20075 raft_consensus.cc:2393] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86ad94e539f24675ba7226e7371cec9b in current term 2: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:40.663590 19931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16c8dbaaffb4ff58286d705232636e3" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:40.664309 19931 raft_consensus.cc:2468] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:40.672612 20282 leader_election.cc:290] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.661123 20630 leader_election.cc:290] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:40.677961 20642 raft_consensus.cc:493] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.678695 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16c8dbaaffb4ff58286d705232636e3" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:40.682081 20756 raft_consensus.cc:515] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.683935 20758 raft_consensus.cc:515] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.655637 20554 raft_consensus.cc:493] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.693274 20282 raft_consensus.cc:493] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.694061 20282 raft_consensus.cc:515] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.702908 20282 leader_election.cc:290] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.682915 20621 raft_consensus.cc:515] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.716866 19930 raft_consensus.cc:2393] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eafc6cb9dfb7468581367b29682ec024 in current term 2: Already voted for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in this term.
I20260709 12:22:40.718469 20763 raft_consensus.cc:493] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.698767 20004 raft_consensus.cc:2468] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:40.698220 20554 raft_consensus.cc:515] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.723668 20763 raft_consensus.cc:515] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.726428 20554 leader_election.cc:290] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.726508 20763 leader_election.cc:290] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:40.731796 20756 leader_election.cc:290] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:40.733258 19902 leader_election.cc:304] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:40.692535 20642 raft_consensus.cc:515] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.724141 20755 raft_consensus.cc:493] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.743551 20755 raft_consensus.cc:515] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.745234 20642 leader_election.cc:290] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.751928 20773 raft_consensus.cc:493] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.752595 20773 raft_consensus.cc:515] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.754984 20773 leader_election.cc:290] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.750454 20673 tablet_bootstrap.cc:492] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:22:40.759967 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 98676.5us
I20260709 12:22:40.734573 20759 raft_consensus.cc:493] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.764631 20759 raft_consensus.cc:515] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.761540 20049 leader_election.cc:304] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:40.762393 20716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.763217 20711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0efb7c87754b739cb88f4e13cb66c6" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.742503 20630 raft_consensus.cc:2804] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.768771 20630 raft_consensus.cc:493] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.763880 20710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.748935 20714 raft_consensus.cc:2468] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:40.769224 20630 raft_consensus.cc:3060] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.769438 20713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.771811 20713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacfd09289c4d5a8b72e5391c896c26" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.774029 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:40.774762 20079 raft_consensus.cc:2468] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:40.775776 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0efb7c87754b739cb88f4e13cb66c6" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:40.775887 20710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.774967 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:40.776376 20075 raft_consensus.cc:3060] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.777102 20716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.777817 20716 raft_consensus.cc:2468] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:40.778119 20709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0301806b41464a5b8e873701b04451df" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.768404 20756 raft_consensus.cc:2804] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.747689 20758 leader_election.cc:290] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.779009 20709 raft_consensus.cc:2393] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 2: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:40.749841 20621 leader_election.cc:290] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.780251 20081 raft_consensus.cc:2393] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 2: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:40.776273 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:40.782011 20713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.782142 20765 raft_consensus.cc:515] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.776510 20711 raft_consensus.cc:3060] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.746100 20755 leader_election.cc:290] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:40.779982 20759 leader_election.cc:290] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.778806 20756 raft_consensus.cc:493] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.776306 20049 leader_election.cc:304] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
W20260709 12:22:40.786258 19901 leader_election.cc:343] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.786757 20673 tablet_bootstrap.cc:492] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:40.784883 20756 raft_consensus.cc:3060] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:40.787412 20049 leader_election.cc:343] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:40.798305 20049 leader_election.cc:343] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.799046 20049 leader_election.cc:304] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:40.801013 20546 raft_consensus.cc:2804] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.801422 20546 raft_consensus.cc:493] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.801790 20546 raft_consensus.cc:3060] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:40.787406 19902 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 54278.8us
I20260709 12:22:40.787734 20774 raft_consensus.cc:2804] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.803269 20765 leader_election.cc:290] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.791138 20673 ts_tablet_manager.cc:1403] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.223s	user 0.014s	sys 0.016s
W20260709 12:22:40.787372 19901 leader_election.cc:343] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.808669 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:40.804738 20774 raft_consensus.cc:697] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:40.808987 19901 leader_election.cc:304] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:40.809206 20711 raft_consensus.cc:2468] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:40.809489 20004 raft_consensus.cc:2468] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:40.810629 20776 raft_consensus.cc:2804] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.810480 20774 consensus_queue.cc:237] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.801797 20713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.812044 20713 raft_consensus.cc:2468] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:40.811040 20776 raft_consensus.cc:493] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.812883 20776 raft_consensus.cc:3060] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.797128 20075 raft_consensus.cc:2468] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:40.814973 19901 leader_election.cc:304] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:40.790904 20630 raft_consensus.cc:515] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
W20260709 12:22:40.815891 20049 leader_election.cc:343] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:40.824129 20049 leader_election.cc:343] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.827234 20711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6778cad39436ab0a260f86049592f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.827956 20711 raft_consensus.cc:3060] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.809249 20546 raft_consensus.cc:515] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.832849 19902 leader_election.cc:304] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:40.833323 20546 leader_election.cc:290] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.796296 20756 raft_consensus.cc:515] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.836776 20080 raft_consensus.cc:2393] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 2: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:40.837603 20756 leader_election.cc:290] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:40.838838 20755 raft_consensus.cc:2804] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.842267 20755 raft_consensus.cc:493] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.842856 20755 raft_consensus.cc:3060] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.819657 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:40.843605 19932 raft_consensus.cc:3060] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.818424 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:40.849040 19930 raft_consensus.cc:2468] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:40.839884 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:40.850526 20004 raft_consensus.cc:2393] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eafc6cb9dfb7468581367b29682ec024 in current term 2: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:40.817683 20759 raft_consensus.cc:2804] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.851100 20003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6778cad39436ab0a260f86049592f" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:40.851387 20759 raft_consensus.cc:493] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.851922 20003 raft_consensus.cc:3060] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.817822 19901 leader_election.cc:304] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:40.823365 20630 leader_election.cc:290] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:40.843475 20005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:40.859277 20005 raft_consensus.cc:2468] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:40.860160 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16c8dbaaffb4ff58286d705232636e3" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:40.860867 20004 raft_consensus.cc:3060] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.851964 20759 raft_consensus.cc:3060] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.861704 20710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.862391 20710 raft_consensus.cc:3060] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.860285 20621 raft_consensus.cc:2804] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.839948 20770 raft_consensus.cc:493] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.863229 20621 raft_consensus.cc:697] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:40.863564 20770 raft_consensus.cc:515] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.864374 20621 consensus_queue.cc:237] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.866182 20770 leader_election.cc:290] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:40.867864 20713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.868582 20713 raft_consensus.cc:3060] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.851750 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024" is_pre_election: true
I20260709 12:22:40.871991 20078 raft_consensus.cc:2393] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86ad94e539f24675ba7226e7371cec9b in current term 2: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:40.816426 20673 raft_consensus.cc:359] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.842671 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacfd09289c4d5a8b72e5391c896c26" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:40.881536 20010 raft_consensus.cc:2468] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:40.858340 20642 raft_consensus.cc:493] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.882540 20642 raft_consensus.cc:515] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.860028 20716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16c8dbaaffb4ff58286d705232636e3" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.885007 20716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.885612 20776 raft_consensus.cc:515] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.854274 19901 leader_election.cc:304] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:40.888150 20642 leader_election.cc:290] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:40.888764 20776 leader_election.cc:290] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.890813 20005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:40.891255 20709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.891508 20005 raft_consensus.cc:3060] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.894176 20049 leader_election.cc:304] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:40.895932 20673 raft_consensus.cc:740] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.896994 20673 consensus_queue.cc:260] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
W20260709 12:22:40.898197 19901 leader_election.cc:343] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.901861 20673 ts_tablet_manager.cc:1434] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.001s
I20260709 12:22:40.903602 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:40.884526 20759 raft_consensus.cc:515] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.916493 20050 leader_election.cc:304] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:40.920849 19932 raft_consensus.cc:2468] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:40.922581 20710 raft_consensus.cc:2468] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:40.924602 20714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16c8dbaaffb4ff58286d705232636e3" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.926741 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:40.927747 20010 raft_consensus.cc:2468] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 1.
I20260709 12:22:40.902745 20546 raft_consensus.cc:2804] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.930394 20546 raft_consensus.cc:493] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.930925 20546 raft_consensus.cc:3060] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.932170 20049 leader_election.cc:304] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:40.933079 20050 leader_election.cc:304] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:40.888780 20642 raft_consensus.cc:2749] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:40.934860 20049 leader_election.cc:304] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:40.935688 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:40.936281 20080 raft_consensus.cc:1275] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:40.937484 20765 raft_consensus.cc:2804] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.931084 20003 raft_consensus.cc:2468] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:40.938025 20716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.938606 20711 raft_consensus.cc:2468] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:40.939353 20005 raft_consensus.cc:2468] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:40.939443 20768 raft_consensus.cc:2804] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:40.950374 20768 raft_consensus.cc:493] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:40.950860 20768 raft_consensus.cc:3060] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.941982 19930 raft_consensus.cc:2393] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eafc6cb9dfb7468581367b29682ec024 in current term 2: Already voted for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in this term.
I20260709 12:22:40.936395 20078 raft_consensus.cc:3060] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:40.942399 20004 raft_consensus.cc:2468] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:40.938058 20765 raft_consensus.cc:697] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:40.944175 20715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98432926ed9c4d049f84b4d657eb940f" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:40.934252 20756 raft_consensus.cc:2749] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:40.946488 20716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:40.946940 20673 tablet_bootstrap.cc:492] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
W20260709 12:22:40.958814 19901 leader_election.cc:343] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:40.959592 19901 leader_election.cc:343] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:40.960870 20713 raft_consensus.cc:2468] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:40.949177 20282 raft_consensus.cc:2804] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.962491 20282 raft_consensus.cc:697] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:40.963619 20282 consensus_queue.cc:237] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.949622 19755 ts_manager.cc:194] Re-registered known tserver with Master: 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.966063 20078 raft_consensus.cc:2468] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:40.949558 20758 consensus_queue.cc:1048] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:40.969671 20049 leader_election.cc:304] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:40.956677 20765 consensus_queue.cc:237] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.971151 19901 leader_election.cc:304] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:40.972904 20049 leader_election.cc:304] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
W20260709 12:22:40.977209 19975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.4:45345, user_credentials={real_user=slave}} blocked reactor thread for 77624.7us
I20260709 12:22:40.979187 20758 raft_consensus.cc:2804] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.976837 20554 raft_consensus.cc:2804] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.988386 20758 raft_consensus.cc:697] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:40.989689 20758 consensus_queue.cc:237] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.990526 20755 raft_consensus.cc:515] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:40.992146 20759 leader_election.cc:290] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:40.995564 20769 raft_consensus.cc:2804] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:40.996294 20554 raft_consensus.cc:697] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:40.997668 20554 consensus_queue.cc:237] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:40.999442 20769 raft_consensus.cc:697] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:40.997355 20546 raft_consensus.cc:515] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:40.986487 19975 leader_election.cc:304] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
W20260709 12:22:41.003830 19902 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 79897.5us
I20260709 12:22:41.008495 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:41.010247 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
W20260709 12:22:41.010823 19901 consensus_peers.cc:597] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:41.010953 19930 raft_consensus.cc:2468] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:41.012782 20713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:41.006606 20770 raft_consensus.cc:2764] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:22:41.024289 19902 leader_election.cc:304] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:41.028283 19902 leader_election.cc:304] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:41.029227 20546 leader_election.cc:290] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:41.006835 20711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9721080ec054fdebd8303f5a8cc8b70" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:41.033625 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
W20260709 12:22:41.033874 19975 leader_election.cc:343] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.034312 19935 raft_consensus.cc:3060] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:41.037196 19975 leader_election.cc:304] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:41.031776 20642 raft_consensus.cc:2804] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:41.038664 19975 leader_election.cc:343] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.038695 20642 raft_consensus.cc:493] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
W20260709 12:22:41.039659 19975 leader_election.cc:343] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.040078 19975 leader_election.cc:304] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:41.032593 20759 raft_consensus.cc:2804] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:41.044797 20711 raft_consensus.cc:2393] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 2: Already voted for candidate eafc6cb9dfb7468581367b29682ec024 in this term.
I20260709 12:22:41.045485 20716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:41.046123 19901 leader_election.cc:304] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024
I20260709 12:22:41.046891 20783 raft_consensus.cc:2749] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:41.042253 20782 raft_consensus.cc:2749] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:41.047150 20716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:41.047538 20755 leader_election.cc:290] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:41.049537 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb16fbe1d984b77949f632328ba99fb" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:41.052065 20004 raft_consensus.cc:3060] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:41.053680 20621 raft_consensus.cc:2749] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:41.053558 20769 consensus_queue.cc:237] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
W20260709 12:22:41.055203 20049 leader_election.cc:343] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:41.042215 19975 leader_election.cc:343] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.039350 20642 raft_consensus.cc:3060] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:41.067667 19975 leader_election.cc:304] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:41.073259 20550 raft_consensus.cc:2804] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:41.073735 20550 raft_consensus.cc:493] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:41.074126 20550 raft_consensus.cc:3060] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:41.091733 19901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 45698.9us
W20260709 12:22:41.092995 19901 leader_election.cc:343] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.096467 19935 raft_consensus.cc:2468] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:41.112566 20004 raft_consensus.cc:2468] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:41.080030 20768 raft_consensus.cc:515] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:41.143100 20550 raft_consensus.cc:515] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:41.144186 20768 leader_election.cc:290] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:41.145941 20550 leader_election.cc:290] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:41.155138 20049 leader_election.cc:304] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:41.166342 20642 raft_consensus.cc:515] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:41.167654 20711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:41.169554 20673 tablet_bootstrap.cc:492] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:22:41.169853 19975 leader_election.cc:343] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.170459 20546 raft_consensus.cc:2804] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:41.171886 20546 raft_consensus.cc:697] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:41.172518 19931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:41.173398 20546 consensus_queue.cc:237] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
W20260709 12:22:41.181774 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 112246us
I20260709 12:22:41.183485 20673 tablet_bootstrap.cc:492] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:41.184334 20673 ts_tablet_manager.cc:1403] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.238s	user 0.015s	sys 0.028s
I20260709 12:22:41.173789 20716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacfd09289c4d5a8b72e5391c896c26" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:41.189332 20642 leader_election.cc:290] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:41.173425 19931 raft_consensus.cc:2393] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86ad94e539f24675ba7226e7371cec9b in current term 2: Already voted for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in this term.
I20260709 12:22:41.187228 20673 raft_consensus.cc:359] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.200156 20673 raft_consensus.cc:740] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
W20260709 12:22:41.200160 19902 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:42705, user_credentials={real_user=slave}} blocked reactor thread for 46180us
I20260709 12:22:41.204200 19902 leader_election.cc:304] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:41.196220 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aacfd09289c4d5a8b72e5391c896c26" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:41.210819 19975 leader_election.cc:304] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:41.207151 20709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:41.211030 20004 raft_consensus.cc:3060] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:41.201102 20673 consensus_queue.cc:260] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.213977 20783 raft_consensus.cc:2749] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:41.215972 20789 raft_consensus.cc:2804] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:22:41.215986 19901 leader_election.cc:343] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:41.199137 20049 leader_election.cc:343] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.222528 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:41.223815 20010 raft_consensus.cc:2393] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 791fd9f5b6bc4d4486f11e87140e9ecb in current term 2: Already voted for candidate 86ad94e539f24675ba7226e7371cec9b in this term.
I20260709 12:22:41.233685 20789 raft_consensus.cc:697] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:41.239800 19902 leader_election.cc:304] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:41.240833 20787 raft_consensus.cc:2749] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:41.235002 20789 consensus_queue.cc:237] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:41.244148 19930 raft_consensus.cc:1275] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.246654 20673 ts_tablet_manager.cc:1434] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 12:22:41.247795 20673 tablet_bootstrap.cc:492] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:41.201289 20759 raft_consensus.cc:697] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:41.254349 20004 raft_consensus.cc:2468] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:41.262023 20769 consensus_queue.cc:1048] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:41.264050 20050 leader_election.cc:304] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:41.278247 20554 raft_consensus.cc:2804] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:41.278867 20554 raft_consensus.cc:697] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:41.278975 20759 consensus_queue.cc:237] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:41.279875 20554 consensus_queue.cc:237] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:41.281873 19759 catalog_manager.cc:5697] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 2 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.319671 19758 catalog_manager.cc:5697] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 2 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.321593 20673 tablet_bootstrap.cc:492] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:41.321760 19758 catalog_manager.cc:5697] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 2 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:41.322799 20673 tablet_bootstrap.cc:492] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:41.323745 20673 ts_tablet_manager.cc:1403] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.000s
I20260709 12:22:41.329146 19758 catalog_manager.cc:5697] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 2 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:41.333778 20673 raft_consensus.cc:359] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:41.335716 20673 raft_consensus.cc:740] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.336540 20673 consensus_queue.cc:260] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:41.338801 20673 ts_tablet_manager.cc:1434] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:22:41.339740 20673 tablet_bootstrap.cc:492] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:41.343192 19755 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38220
I20260709 12:22:41.351955 20709 raft_consensus.cc:1275] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.352313 20747 heartbeater.cc:499] Master 127.11.163.62:41995 was elected leader, sending a full tablet report...
I20260709 12:22:41.356156 20673 tablet_bootstrap.cc:492] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:41.357206 20673 tablet_bootstrap.cc:492] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:41.357893 20673 ts_tablet_manager.cc:1403] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:22:41.358595 20554 consensus_queue.cc:1048] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:41.360774 20673 raft_consensus.cc:359] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.361557 20673 raft_consensus.cc:740] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.362336 20673 consensus_queue.cc:260] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.364887 20673 ts_tablet_manager.cc:1434] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:41.381326 19755 catalog_manager.cc:5697] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 2 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.383383 19755 catalog_manager.cc:5697] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 2 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.392174 19755 catalog_manager.cc:5697] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 2 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.394789 19755 catalog_manager.cc:5697] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 2 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.396505 19755 catalog_manager.cc:5697] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 2 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.398186 19755 catalog_manager.cc:5697] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 2 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.392932 20078 raft_consensus.cc:1275] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.401026 20759 consensus_queue.cc:1048] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:41.439313 20716 raft_consensus.cc:1275] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.440642 20673 tablet_bootstrap.cc:492] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:41.441263 20759 consensus_queue.cc:1048] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:22:41.464200 20004 raft_consensus.cc:1275] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.466415 20768 consensus_queue.cc:1048] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:41.485421 19758 catalog_manager.cc:5697] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 1 to 2, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 2 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.511806 19931 raft_consensus.cc:1275] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.517274 20711 raft_consensus.cc:1275] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.520167 20716 raft_consensus.cc:1275] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.522121 20554 consensus_queue.cc:1048] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:41.536748 20768 consensus_queue.cc:1048] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:41.537853 20078 raft_consensus.cc:1275] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.540226 20769 consensus_queue.cc:1048] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:41.544488 20711 raft_consensus.cc:1275] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.552747 19931 raft_consensus.cc:1275] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.548990 20758 consensus_queue.cc:1048] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:22:41.585462 20673 tablet_bootstrap.cc:492] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:41.586701 20673 tablet_bootstrap.cc:492] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:41.592284 20673 ts_tablet_manager.cc:1403] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.147s	user 0.055s	sys 0.048s
I20260709 12:22:41.595247 20673 raft_consensus.cc:359] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.596091 20673 raft_consensus.cc:740] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.596848 20673 consensus_queue.cc:260] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.599473 20673 ts_tablet_manager.cc:1434] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:41.600391 20673 tablet_bootstrap.cc:492] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:41.622496 20716 raft_consensus.cc:3060] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:41.624415 20673 tablet_bootstrap.cc:492] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:41.625543 20673 tablet_bootstrap.cc:492] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
W20260709 12:22:41.626456 20049 consensus_peers.cc:597] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:41.626760 20554 consensus_queue.cc:1048] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:22:41.631495 20049 consensus_peers.cc:597] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:41.635833 20768 consensus_queue.cc:1048] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:41.641955 20004 raft_consensus.cc:1275] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.627154 20673 ts_tablet_manager.cc:1403] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 12:22:41.635871 20716 raft_consensus.cc:1275] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.661362 20004 raft_consensus.cc:1275] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:41.663293 20049 consensus_peers.cc:597] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:41.665570 20049 consensus_peers.cc:597] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:41.648056 20768 consensus_queue.cc:1048] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:22:41.682313 20789 consensus_queue.cc:1048] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:41.684031 20789 consensus_queue.cc:1048] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:41.691337 20673 raft_consensus.cc:359] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:41.693957 20673 raft_consensus.cc:740] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.694739 20673 consensus_queue.cc:260] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:41.701166 20673 ts_tablet_manager.cc:1434] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.004s
I20260709 12:22:41.754822 20673 tablet_bootstrap.cc:492] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
W20260709 12:22:41.759780 19901 consensus_peers.cc:597] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:41.762343 20005 raft_consensus.cc:1275] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.764060 20787 consensus_queue.cc:1048] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:41.767356 19901 consensus_peers.cc:597] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:41.788975 19901 consensus_peers.cc:597] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:41.793365 20049 consensus_peers.cc:597] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:41.795240 19901 consensus_peers.cc:597] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:41.798496 19901 consensus_peers.cc:597] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:41.808944 20004 raft_consensus.cc:1275] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.810614 20769 consensus_queue.cc:1048] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:41.833461 19931 raft_consensus.cc:1275] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:41.835255 20769 consensus_queue.cc:1048] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:41.846761 20049 consensus_peers.cc:597] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:41.868391 19975 consensus_peers.cc:597] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:41.880721 20673 tablet_bootstrap.cc:492] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:41.881800 20673 tablet_bootstrap.cc:492] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:41.882498 20673 ts_tablet_manager.cc:1403] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.131s	user 0.016s	sys 0.016s
I20260709 12:22:41.885519 20673 raft_consensus.cc:359] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.886276 20673 raft_consensus.cc:740] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.887040 20673 consensus_queue.cc:260] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.889305 20673 ts_tablet_manager.cc:1434] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:41.892040 20673 tablet_bootstrap.cc:492] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:41.909991 20673 tablet_bootstrap.cc:492] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:41.910982 20673 tablet_bootstrap.cc:492] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:41.911783 20673 ts_tablet_manager.cc:1403] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:22:41.914028 20673 raft_consensus.cc:359] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:41.914729 20673 raft_consensus.cc:740] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.915565 20673 consensus_queue.cc:260] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:41.917572 20673 ts_tablet_manager.cc:1434] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:41.918888 20673 tablet_bootstrap.cc:492] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
W20260709 12:22:41.924825 19901 consensus_peers.cc:597] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:41.935473 19975 consensus_peers.cc:597] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:41.938781 20673 tablet_bootstrap.cc:492] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:41.939792 20673 tablet_bootstrap.cc:492] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:41.940485 20673 ts_tablet_manager.cc:1403] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
W20260709 12:22:41.942775 20049 consensus_peers.cc:597] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:41.942896 20673 raft_consensus.cc:359] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.943658 20673 raft_consensus.cc:740] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.944357 20673 consensus_queue.cc:260] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.946094 20673 ts_tablet_manager.cc:1434] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:41.947108 20673 tablet_bootstrap.cc:492] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:41.964499 20673 tablet_bootstrap.cc:492] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:41.965562 20673 tablet_bootstrap.cc:492] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:41.966320 20673 ts_tablet_manager.cc:1403] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 12:22:41.968869 20673 raft_consensus.cc:359] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.969578 20673 raft_consensus.cc:740] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.970270 20673 consensus_queue.cc:260] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:41.972698 20673 ts_tablet_manager.cc:1434] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:41.975183 20673 tablet_bootstrap.cc:492] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:41.991134 20673 tablet_bootstrap.cc:492] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:41.992136 20673 tablet_bootstrap.cc:492] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:41.992663 20673 ts_tablet_manager.cc:1403] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:22:41.995316 20673 raft_consensus.cc:359] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:41.996078 20673 raft_consensus.cc:740] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.996908 20673 consensus_queue.cc:260] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:41.999042 20673 ts_tablet_manager.cc:1434] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:42.000041 20673 tablet_bootstrap.cc:492] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.003163 20713 raft_consensus.cc:3060] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.016048 20673 tablet_bootstrap.cc:492] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.017045 20673 tablet_bootstrap.cc:492] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.017673 20673 ts_tablet_manager.cc:1403] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:22:42.020186 20673 raft_consensus.cc:359] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.020756 20673 raft_consensus.cc:740] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.021493 20673 consensus_queue.cc:260] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.024016 20673 ts_tablet_manager.cc:1434] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:22:42.025220 20673 tablet_bootstrap.cc:492] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.039851 20673 tablet_bootstrap.cc:492] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.040652 20673 tablet_bootstrap.cc:492] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.041257 20673 ts_tablet_manager.cc:1403] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:22:42.043916 20673 raft_consensus.cc:359] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:42.044852 20673 raft_consensus.cc:740] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.045656 20673 consensus_queue.cc:260] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:42.048107 20673 ts_tablet_manager.cc:1434] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:42.048947 20673 tablet_bootstrap.cc:492] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.063090 20673 tablet_bootstrap.cc:492] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.063938 20673 tablet_bootstrap.cc:492] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.064529 20673 ts_tablet_manager.cc:1403] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:22:42.066768 20673 raft_consensus.cc:359] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.067610 20673 raft_consensus.cc:740] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.068436 20673 consensus_queue.cc:260] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.070312 20673 ts_tablet_manager.cc:1434] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:42.071295 20673 tablet_bootstrap.cc:492] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.087255 20673 tablet_bootstrap.cc:492] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.088402 20673 tablet_bootstrap.cc:492] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.089195 20673 ts_tablet_manager.cc:1403] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:22:42.092021 20673 raft_consensus.cc:359] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.093430 20673 raft_consensus.cc:740] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.094113 20673 consensus_queue.cc:260] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.096043 20673 ts_tablet_manager.cc:1434] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:42.097316 20673 tablet_bootstrap.cc:492] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.126405 20673 tablet_bootstrap.cc:492] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.127492 20673 tablet_bootstrap.cc:492] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.128242 20673 ts_tablet_manager.cc:1403] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.007s
I20260709 12:22:42.130373 20673 raft_consensus.cc:359] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.130925 20673 raft_consensus.cc:740] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.131673 20673 consensus_queue.cc:260] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.133725 20673 ts_tablet_manager.cc:1434] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:42.134894 20673 tablet_bootstrap.cc:492] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.157989 20673 tablet_bootstrap.cc:492] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.159070 20673 tablet_bootstrap.cc:492] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.159849 20673 ts_tablet_manager.cc:1403] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 12:22:42.163071 20673 raft_consensus.cc:359] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:42.163868 20673 raft_consensus.cc:740] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.164635 20673 consensus_queue.cc:260] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:42.166790 20673 ts_tablet_manager.cc:1434] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:42.167922 20673 tablet_bootstrap.cc:492] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
W20260709 12:22:42.170495 19975 consensus_peers.cc:597] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:42.181744 20673 tablet_bootstrap.cc:492] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.182555 20673 tablet_bootstrap.cc:492] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.183099 20673 ts_tablet_manager.cc:1403] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:22:42.185452 20673 raft_consensus.cc:359] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.186117 20673 raft_consensus.cc:740] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.186781 20673 consensus_queue.cc:260] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.188866 20673 ts_tablet_manager.cc:1434] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:42.189661 20673 tablet_bootstrap.cc:492] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.196539 20713 raft_consensus.cc:3060] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:42.219602 19901 consensus_peers.cc:597] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:42.220360 20673 tablet_bootstrap.cc:492] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.221253 20673 tablet_bootstrap.cc:492] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.221894 20673 ts_tablet_manager.cc:1403] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.012s
I20260709 12:22:42.224653 20673 raft_consensus.cc:359] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.225322 20673 raft_consensus.cc:740] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.226006 20673 consensus_queue.cc:260] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.228749 20673 ts_tablet_manager.cc:1434] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:22:42.229908 20673 tablet_bootstrap.cc:492] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.245990 20673 tablet_bootstrap.cc:492] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.247051 20673 tablet_bootstrap.cc:492] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.247814 20673 ts_tablet_manager.cc:1403] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 12:22:42.250232 20673 raft_consensus.cc:359] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.250835 20673 raft_consensus.cc:740] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.251581 20673 consensus_queue.cc:260] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.253579 20673 ts_tablet_manager.cc:1434] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:42.254449 20673 tablet_bootstrap.cc:492] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.272306 20673 tablet_bootstrap.cc:492] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.273277 20673 tablet_bootstrap.cc:492] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.274060 20673 ts_tablet_manager.cc:1403] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 12:22:42.276854 20673 raft_consensus.cc:359] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.277527 20673 raft_consensus.cc:740] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.278218 20673 consensus_queue.cc:260] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.280685 20673 ts_tablet_manager.cc:1434] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 12:22:42.281529 20673 tablet_bootstrap.cc:492] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.301141 20673 tablet_bootstrap.cc:492] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.301863 20673 tablet_bootstrap.cc:492] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.302367 20673 ts_tablet_manager.cc:1403] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 12:22:42.304188 20673 raft_consensus.cc:359] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.304644 20673 raft_consensus.cc:740] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.305186 20673 consensus_queue.cc:260] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.306623 20673 ts_tablet_manager.cc:1434] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:42.307974 20673 tablet_bootstrap.cc:492] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.323967 20716 raft_consensus.cc:3060] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.365193 20673 tablet_bootstrap.cc:492] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.369011 20673 tablet_bootstrap.cc:492] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.369813 20673 ts_tablet_manager.cc:1403] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.062s	user 0.036s	sys 0.019s
I20260709 12:22:42.373117 20673 raft_consensus.cc:359] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.373867 20673 raft_consensus.cc:740] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.374888 20673 consensus_queue.cc:260] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.376633 20673 ts_tablet_manager.cc:1434] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:42.377475 20673 tablet_bootstrap.cc:492] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.385720 20716 raft_consensus.cc:3060] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.455420 20673 tablet_bootstrap.cc:492] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.456753 20673 tablet_bootstrap.cc:492] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.457417 20673 ts_tablet_manager.cc:1403] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.080s	user 0.023s	sys 0.040s
I20260709 12:22:42.474591 20673 raft_consensus.cc:359] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.475170 20673 raft_consensus.cc:740] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.477694 20673 consensus_queue.cc:260] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.479854 20673 ts_tablet_manager.cc:1434] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:22:42.480567 20673 tablet_bootstrap.cc:492] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.492514 20673 tablet_bootstrap.cc:492] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.493253 20673 tablet_bootstrap.cc:492] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.493777 20673 ts_tablet_manager.cc:1403] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 12:22:42.495846 20673 raft_consensus.cc:359] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.496380 20673 raft_consensus.cc:740] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.497037 20673 consensus_queue.cc:260] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.498423 20673 ts_tablet_manager.cc:1434] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:42.499353 20673 tablet_bootstrap.cc:492] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.515739 20713 raft_consensus.cc:3060] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.521893 20673 tablet_bootstrap.cc:492] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.523095 20673 tablet_bootstrap.cc:492] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.523785 20673 ts_tablet_manager.cc:1403] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 12:22:42.525936 20673 raft_consensus.cc:359] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:42.526466 20673 raft_consensus.cc:740] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.527190 20673 consensus_queue.cc:260] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:42.529495 20673 ts_tablet_manager.cc:1434] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:42.530289 20673 tablet_bootstrap.cc:492] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.552224 20673 tablet_bootstrap.cc:492] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.553185 20673 tablet_bootstrap.cc:492] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.554294 20673 ts_tablet_manager.cc:1403] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.003s
I20260709 12:22:42.556762 20673 raft_consensus.cc:359] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.557406 20673 raft_consensus.cc:740] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.557986 20673 consensus_queue.cc:260] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.560017 20673 ts_tablet_manager.cc:1434] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:22:42.561995 20673 tablet_bootstrap.cc:492] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap starting.
I20260709 12:22:42.577174 20673 tablet_bootstrap.cc:492] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:42.578244 20673 tablet_bootstrap.cc:492] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5: Bootstrap complete.
I20260709 12:22:42.578971 20673 ts_tablet_manager.cc:1403] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:22:42.581787 20673 raft_consensus.cc:359] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.582527 20673 raft_consensus.cc:740] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Initialized, Role: FOLLOWER
I20260709 12:22:42.583304 20673 consensus_queue.cc:260] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.585865 20673 ts_tablet_manager.cc:1434] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:22:42.698082 20713 raft_consensus.cc:3060] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.954892 20766 raft_consensus.cc:493] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.955476 20766 raft_consensus.cc:515] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.957937 20766 leader_election.cc:290] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:42.959471 20715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:42.960153 20715 raft_consensus.cc:2468] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 1.
I20260709 12:22:42.959842 19931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" is_pre_election: true
I20260709 12:22:42.961342 19931 raft_consensus.cc:2468] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 2.
I20260709 12:22:42.961687 19975 leader_election.cc:304] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:42.962553 20766 raft_consensus.cc:2804] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:42.962941 20766 raft_consensus.cc:493] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.963270 20766 raft_consensus.cc:3060] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:42.968256 20769 raft_consensus.cc:493] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.968878 20769 raft_consensus.cc:515] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:42.971513 20766 raft_consensus.cc:515] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:42.971987 20769 leader_election.cc:290] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:42.973639 20766 leader_election.cc:290] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 3 election: Requested vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:42.973564 20715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5" is_pre_election: true
I20260709 12:22:42.974387 20715 raft_consensus.cc:2468] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 1.
I20260709 12:22:42.975224 20713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:42.975594 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9eef48cb44a5c90e59f965bf16d75" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:42.975922 20713 raft_consensus.cc:3060] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:42.976244 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b" is_pre_election: true
I20260709 12:22:42.976904 20004 raft_consensus.cc:2468] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 2.
I20260709 12:22:42.976956 20049 leader_election.cc:304] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:42.978127 20554 raft_consensus.cc:2804] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:42.978499 20554 raft_consensus.cc:493] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.978811 20554 raft_consensus.cc:3060] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:42.986932 20713 raft_consensus.cc:2468] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 3.
I20260709 12:22:42.976300 19932 raft_consensus.cc:3060] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:42.988543 19975 leader_election.cc:304] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:42.989570 20766 raft_consensus.cc:2804] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:42.990700 20766 raft_consensus.cc:697] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 3 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:43.006186 20766 consensus_queue.cc:237] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:43.015404 20554 raft_consensus.cc:515] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:43.025027 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:43.025624 20004 raft_consensus.cc:3060] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.033004 20004 raft_consensus.cc:2468] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 3.
I20260709 12:22:43.035077 20050 leader_election.cc:304] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:43.035478 19932 raft_consensus.cc:2468] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 3.
I20260709 12:22:43.036057 20768 raft_consensus.cc:2804] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:43.036585 20768 raft_consensus.cc:697] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 3 LEADER]: Becoming Leader. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:43.036827 20554 leader_election.cc:290] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 3 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037)
I20260709 12:22:43.037993 20768 consensus_queue.cc:237] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:43.038921 20715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4169ab4a7eee4ce587af1e7350f8629e" candidate_uuid: "eafc6cb9dfb7468581367b29682ec024" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
I20260709 12:22:43.039665 20715 raft_consensus.cc:3060] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.043551 19758 catalog_manager.cc:5697] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 1 to 3, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 3 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.048648 20715 raft_consensus.cc:2468] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eafc6cb9dfb7468581367b29682ec024 in term 3.
I20260709 12:22:43.050954 19755 catalog_manager.cc:5697] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 reported cstate change: term changed from 1 to 3, leader changed from 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1) to eafc6cb9dfb7468581367b29682ec024 (127.11.163.4). New cstate: current_term: 3 leader_uuid: "eafc6cb9dfb7468581367b29682ec024" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.485641 20004 raft_consensus.cc:1275] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:43.486912 20769 consensus_queue.cc:1048] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:43.503260 20713 raft_consensus.cc:1275] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Refusing update from remote peer eafc6cb9dfb7468581367b29682ec024: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:43.505297 20282 consensus_queue.cc:1048] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:43.526364 19932 raft_consensus.cc:1275] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Refusing update from remote peer 86ad94e539f24675ba7226e7371cec9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:43.527992 20674 consensus_queue.cc:1048] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:22:43.538811 20713 raft_consensus.cc:1275] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Refusing update from remote peer 86ad94e539f24675ba7226e7371cec9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:43.540529 20766 consensus_queue.cc:1048] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:48.924018 19901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:39037, user_credentials={real_user=slave}} blocked reactor thread for 79610.9us
I20260709 12:22:50.382064 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:50.447736 20004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2956c270268242f88a839bc03d3d5d62"
dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
mode: GRACEFUL
new_leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
 from {username='slave'} at 127.0.0.1:57938
I20260709 12:22:50.448432 20004 raft_consensus.cc:606] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Received request to transfer leadership to TS 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:50.463865 20078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f"
dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:50032
I20260709 12:22:50.464541 20078 raft_consensus.cc:606] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:50.477908 19931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04"
dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:45198
I20260709 12:22:50.478540 19931 raft_consensus.cc:606] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:50.481421 20004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa5fc07ed3b34983a19659aac8863a06"
dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:57938
I20260709 12:22:50.481948 20004 raft_consensus.cc:606] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:50.484609 20004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6f762ace6474e3d8514494a97777505"
dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:57938
I20260709 12:22:50.485121 20004 raft_consensus.cc:606] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:50.487540 20004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f153ead7b64c4983b271c2c190b7d2fc"
dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
mode: GRACEFUL
new_leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
 from {username='slave'} at 127.0.0.1:57938
I20260709 12:22:50.487991 20004 raft_consensus.cc:606] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Received request to transfer leadership to TS 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:50.489166 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:22:50.491039 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:50.492277 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:50.523212 20766 raft_consensus.cc:993] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b: : Instructing follower 791fd9f5b6bc4d4486f11e87140e9ecb to start an election
I20260709 12:22:50.523878 20766 raft_consensus.cc:1081] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Signalling peer 791fd9f5b6bc4d4486f11e87140e9ecb to start an election
I20260709 12:22:50.525889 19931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f153ead7b64c4983b271c2c190b7d2fc"
dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
 from {username='slave'} at 127.0.0.1:42618
I20260709 12:22:50.526585 19931 raft_consensus.cc:493] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.527087 19931 raft_consensus.cc:3060] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.545907 19931 raft_consensus.cc:515] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:50.548101 19931 leader_election.cc:290] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:50.549201 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f153ead7b64c4983b271c2c190b7d2fc" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:50.549206 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f153ead7b64c4983b271c2c190b7d2fc" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:50.549988 20004 raft_consensus.cc:3055] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:50.550125 20078 raft_consensus.cc:3060] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.550285 20004 raft_consensus.cc:740] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:50.551326 20004 consensus_queue.cc:260] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:50.552776 20004 raft_consensus.cc:3060] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.557435 20776 raft_consensus.cc:993] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:50.557989 20776 raft_consensus.cc:1081] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:50.557888 20078 raft_consensus.cc:2468] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:50.559473 19901 leader_election.cc:304] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:50.560389 20716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56910
I20260709 12:22:50.560583 20889 raft_consensus.cc:2804] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:50.561048 20716 raft_consensus.cc:493] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.561476 20716 raft_consensus.cc:3060] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.561175 20889 raft_consensus.cc:697] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:50.567231 20889 consensus_queue.cc:237] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:50.570046 20716 raft_consensus.cc:515] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:50.561169 20004 raft_consensus.cc:2468] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:50.573412 20716 leader_election.cc:290] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:50.583729 19755 catalog_manager.cc:5697] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 1 to 2, leader changed from 86ad94e539f24675ba7226e7371cec9b (127.11.163.3) to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 2 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:50.594362 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:50.595106 20078 raft_consensus.cc:3060] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.602737 20078 raft_consensus.cc:2468] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:50.604198 20669 leader_election.cc:304] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:50.605237 20886 raft_consensus.cc:993] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b: : Instructing follower 791fd9f5b6bc4d4486f11e87140e9ecb to start an election
I20260709 12:22:50.609850 20886 raft_consensus.cc:1081] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Signalling peer 791fd9f5b6bc4d4486f11e87140e9ecb to start an election
I20260709 12:22:50.612320 19931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2956c270268242f88a839bc03d3d5d62"
dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
 from {username='slave'} at 127.0.0.1:42618
I20260709 12:22:50.612855 19931 raft_consensus.cc:493] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.613212 19931 raft_consensus.cc:3060] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.615414 20901 raft_consensus.cc:2804] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:50.618212 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78284f7a2a9440b5a5d708cd128f3b04" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:50.618866 19930 raft_consensus.cc:3055] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:50.619136 19930 raft_consensus.cc:740] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:50.619993 19930 consensus_queue.cc:260] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:50.621412 19930 raft_consensus.cc:3060] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.622633 19931 raft_consensus.cc:515] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:50.628257 19931 leader_election.cc:290] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:50.628877 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956c270268242f88a839bc03d3d5d62" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:50.629264 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956c270268242f88a839bc03d3d5d62" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:50.629727 20004 raft_consensus.cc:3055] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:50.629825 20078 raft_consensus.cc:3060] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.630118 20004 raft_consensus.cc:740] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:50.631002 20004 consensus_queue.cc:260] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:50.631392 20901 raft_consensus.cc:697] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:50.632373 20004 raft_consensus.cc:3060] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.632612 20901 consensus_queue.cc:237] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:50.630059 19930 raft_consensus.cc:2468] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:50.641932 20004 raft_consensus.cc:2468] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:50.642970 19902 leader_election.cc:304] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:50.643953 20902 raft_consensus.cc:2804] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:50.644564 20902 raft_consensus.cc:697] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:50.647007 20902 consensus_queue.cc:237] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:50.653887 20886 raft_consensus.cc:993] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:50.654647 20900 raft_consensus.cc:1081] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:50.656805 20713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa5fc07ed3b34983a19659aac8863a06"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56908
I20260709 12:22:50.657451 20713 raft_consensus.cc:493] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.657804 20713 raft_consensus.cc:3060] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.656791 20078 raft_consensus.cc:2468] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:50.672009 20713 raft_consensus.cc:515] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:50.676535 20713 leader_election.cc:290] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:50.677186 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5fc07ed3b34983a19659aac8863a06" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:50.677883 19930 raft_consensus.cc:3060] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.689392 19930 raft_consensus.cc:2468] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:50.690531 20669 leader_election.cc:304] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:50.692309 20901 raft_consensus.cc:2804] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:50.692829 20901 raft_consensus.cc:697] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:50.693001 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5fc07ed3b34983a19659aac8863a06" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:50.693687 20004 raft_consensus.cc:3055] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:50.693964 20004 raft_consensus.cc:740] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:50.693898 20901 consensus_queue.cc:237] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:50.696790 19758 catalog_manager.cc:5697] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 1 to 2, leader changed from 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:50.699041 20004 consensus_queue.cc:260] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:50.700490 20004 raft_consensus.cc:3060] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.706250 20004 raft_consensus.cc:2468] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:50.710572 19755 catalog_manager.cc:5697] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 1 to 2, leader changed from 86ad94e539f24675ba7226e7371cec9b (127.11.163.3) to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 2 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:50.712855 20887 raft_consensus.cc:993] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:50.713397 20887 raft_consensus.cc:1081] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:50.715744 20711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56916
I20260709 12:22:50.716284 20711 raft_consensus.cc:493] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.716629 20711 raft_consensus.cc:3060] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:50.724713 20711 raft_consensus.cc:515] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:50.725039 19758 catalog_manager.cc:5697] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 1 to 2, leader changed from 86ad94e539f24675ba7226e7371cec9b (127.11.163.3) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:50.727022 20711 leader_election.cc:290] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 3 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:50.727608 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:50.727980 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fa7ab6ac204f20991d64236150e97f" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:50.728396 20004 raft_consensus.cc:3060] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:50.728647 20078 raft_consensus.cc:3055] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:50.729004 20078 raft_consensus.cc:740] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:50.729777 20078 consensus_queue.cc:260] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:50.731617 20078 raft_consensus.cc:3060] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:50.736748 20004 raft_consensus.cc:2468] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 3.
I20260709 12:22:50.738229 20670 leader_election.cc:304] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:50.738497 20886 raft_consensus.cc:993] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:50.739032 20886 raft_consensus.cc:1081] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:50.739092 20901 raft_consensus.cc:2804] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:50.739709 20901 raft_consensus.cc:697] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:50.740214 20078 raft_consensus.cc:2468] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 3.
I20260709 12:22:50.740706 20901 consensus_queue.cc:237] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:50.741204 20711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6f762ace6474e3d8514494a97777505"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56908
I20260709 12:22:50.741888 20711 raft_consensus.cc:493] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.742206 20711 raft_consensus.cc:3060] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.748834 20711 raft_consensus.cc:515] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:50.751420 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f762ace6474e3d8514494a97777505" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:50.751682 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f762ace6474e3d8514494a97777505" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:50.752058 19930 raft_consensus.cc:3060] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.752214 20004 raft_consensus.cc:3055] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:50.752502 20004 raft_consensus.cc:740] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:50.753185 20004 consensus_queue.cc:260] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:50.752723 19758 catalog_manager.cc:5697] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 2 to 3, leader changed from eafc6cb9dfb7468581367b29682ec024 (127.11.163.4) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:50.754072 20004 raft_consensus.cc:3060] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.759158 19930 raft_consensus.cc:2468] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:50.760366 20004 raft_consensus.cc:2468] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:50.760756 20669 leader_election.cc:304] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:50.751180 20711 leader_election.cc:290] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:50.761788 20901 raft_consensus.cc:2804] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:50.762270 20901 raft_consensus.cc:697] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:50.763212 20901 consensus_queue.cc:237] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:50.780511 19758 catalog_manager.cc:5697] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 1 to 2, leader changed from 86ad94e539f24675ba7226e7371cec9b (127.11.163.3) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:51.029721 20080 raft_consensus.cc:1275] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.030920 20902 consensus_queue.cc:1048] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:51.042189 20078 raft_consensus.cc:1275] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.046927 20776 consensus_queue.cc:1048] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:51.051409 20010 raft_consensus.cc:1275] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.056627 20776 consensus_queue.cc:1048] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:51.061398 19930 raft_consensus.cc:1275] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.063222 20901 consensus_queue.cc:1048] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:51.068996 20005 raft_consensus.cc:1275] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.072629 20889 consensus_queue.cc:1048] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:51.091370 20078 raft_consensus.cc:1275] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.102905 20901 consensus_queue.cc:1048] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:51.137718 19932 raft_consensus.cc:1275] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.157208 20901 consensus_queue.cc:1048] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:51.198824 20004 raft_consensus.cc:1275] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:51.206779 20901 consensus_queue.cc:1048] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:22:51.276021 20005 raft_consensus.cc:1275] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.277874 20903 consensus_queue.cc:1048] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:51.296433 20075 raft_consensus.cc:1275] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:51.299803 20925 consensus_queue.cc:1048] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:51.322196 20004 raft_consensus.cc:1275] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.325559 20925 consensus_queue.cc:1048] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:51.341887 19932 raft_consensus.cc:1275] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.347263 20925 consensus_queue.cc:1048] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:51.541250 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:51.582592 20080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74"
dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:50032
I20260709 12:22:51.583184 20080 raft_consensus.cc:606] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:51.586086 20080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e6b3c311ea54efba7ed246f0ccd9c2e"
dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:50032
I20260709 12:22:51.586587 20080 raft_consensus.cc:606] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:51.588996 19932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43"
dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
mode: GRACEFUL
new_leader_uuid: "86ad94e539f24675ba7226e7371cec9b"
 from {username='slave'} at 127.0.0.1:45198
I20260709 12:22:51.589480 19932 raft_consensus.cc:606] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Received request to transfer leadership to TS 86ad94e539f24675ba7226e7371cec9b
I20260709 12:22:51.591810 19932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a19aff8bcdbb4bd29e22cb5f7f4cc1e6"
dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:45198
I20260709 12:22:51.592245 19932 raft_consensus.cc:606] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:51.595745 20080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f157aabf5bdd4201a3677151f9ccc1de"
dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
mode: GRACEFUL
new_leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
 from {username='slave'} at 127.0.0.1:50032
I20260709 12:22:51.596308 20080 raft_consensus.cc:606] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Received request to transfer leadership to TS 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:51.597461 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:51.600207 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:51.601070 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:51.606225 20929 raft_consensus.cc:993] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:51.606921 20880 raft_consensus.cc:1081] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:51.608855 20711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e6b3c311ea54efba7ed246f0ccd9c2e"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56916
I20260709 12:22:51.609503 20711 raft_consensus.cc:493] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.609930 20711 raft_consensus.cc:3060] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.618302 20711 raft_consensus.cc:515] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:51.621061 20711 leader_election.cc:290] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:51.621675 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6b3c311ea54efba7ed246f0ccd9c2e" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:51.622344 20010 raft_consensus.cc:3060] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.630553 20010 raft_consensus.cc:2468] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:51.631875 20670 leader_election.cc:304] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:51.632682 20925 raft_consensus.cc:2804] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:51.633190 20925 raft_consensus.cc:697] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:51.634087 20925 consensus_queue.cc:237] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:51.641029 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6b3c311ea54efba7ed246f0ccd9c2e" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:51.641671 20075 raft_consensus.cc:3055] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:51.641956 20075 raft_consensus.cc:740] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:51.643553 20075 consensus_queue.cc:260] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:51.644915 20075 raft_consensus.cc:3060] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.653128 20075 raft_consensus.cc:2468] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:51.659053 19755 catalog_manager.cc:5697] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 1 to 2, leader changed from eafc6cb9dfb7468581367b29682ec024 (127.11.163.4) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:51.669900 20929 raft_consensus.cc:993] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:51.670490 20880 raft_consensus.cc:1081] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:51.672137 20711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56916
I20260709 12:22:51.672737 20711 raft_consensus.cc:493] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.673072 20711 raft_consensus.cc:3060] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:51.678966 20711 raft_consensus.cc:515] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:51.681236 20711 leader_election.cc:290] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 3 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:51.681661 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:51.682262 20075 raft_consensus.cc:3055] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:51.682539 20075 raft_consensus.cc:740] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:51.682484 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1d3bf6702e45d280388eaf43d70e74" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:51.683336 19932 raft_consensus.cc:3060] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:51.683684 20075 consensus_queue.cc:260] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:51.685052 20075 raft_consensus.cc:3060] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:51.689347 19932 raft_consensus.cc:2468] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 3.
I20260709 12:22:51.689993 20075 raft_consensus.cc:2468] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 3.
I20260709 12:22:51.690613 20669 leader_election.cc:304] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:51.691573 20925 raft_consensus.cc:2804] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:51.692063 20925 raft_consensus.cc:697] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:51.692924 20925 consensus_queue.cc:237] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:51.704470 19755 catalog_manager.cc:5697] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 2 to 3, leader changed from eafc6cb9dfb7468581367b29682ec024 (127.11.163.4) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:51.887205 20889 raft_consensus.cc:993] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb: : Instructing follower 86ad94e539f24675ba7226e7371cec9b to start an election
I20260709 12:22:51.887794 20902 raft_consensus.cc:1081] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Signalling peer 86ad94e539f24675ba7226e7371cec9b to start an election
I20260709 12:22:51.889447 20010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43"
dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
 from {username='slave'} at 127.0.0.1:35158
I20260709 12:22:51.890097 20010 raft_consensus.cc:493] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.890484 20010 raft_consensus.cc:3060] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:51.897506 20010 raft_consensus.cc:515] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:51.899210 20010 leader_election.cc:290] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 3 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:51.900238 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:51.899915 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0a72abd201421e9bde4dcd6e8a3d43" candidate_uuid: "86ad94e539f24675ba7226e7371cec9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:51.901032 20075 raft_consensus.cc:3060] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:51.901142 19932 raft_consensus.cc:3055] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:51.901523 19932 raft_consensus.cc:740] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:51.902266 19932 consensus_queue.cc:260] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:51.903486 19932 raft_consensus.cc:3060] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:51.907773 20075 raft_consensus.cc:2468] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 3.
I20260709 12:22:51.909088 19975 leader_election.cc:304] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ad94e539f24675ba7226e7371cec9b, eafc6cb9dfb7468581367b29682ec024; no voters: 
I20260709 12:22:51.909842 20889 raft_consensus.cc:993] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:51.909889 20886 raft_consensus.cc:2804] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:51.910274 19932 raft_consensus.cc:2468] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86ad94e539f24675ba7226e7371cec9b in term 3.
I20260709 12:22:51.910651 20886 raft_consensus.cc:697] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 3 LEADER]: Becoming Leader. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:51.910594 20918 raft_consensus.cc:1081] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:51.911715 20886 consensus_queue.cc:237] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:51.913008 20713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a19aff8bcdbb4bd29e22cb5f7f4cc1e6"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56910
I20260709 12:22:51.913563 20713 raft_consensus.cc:493] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.913894 20713 raft_consensus.cc:3060] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.933302 20713 raft_consensus.cc:515] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:51.939711 20713 leader_election.cc:290] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:51.941165 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19aff8bcdbb4bd29e22cb5f7f4cc1e6" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:51.941742 20010 raft_consensus.cc:3060] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.942912 19755 catalog_manager.cc:5697] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b reported cstate change: term changed from 2 to 3, leader changed from 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2) to 86ad94e539f24675ba7226e7371cec9b (127.11.163.3). New cstate: current_term: 3 leader_uuid: "86ad94e539f24675ba7226e7371cec9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:51.944141 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19aff8bcdbb4bd29e22cb5f7f4cc1e6" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:51.944824 19932 raft_consensus.cc:3055] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:51.945133 19932 raft_consensus.cc:740] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:51.947229 19932 consensus_queue.cc:260] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:51.948653 19932 raft_consensus.cc:3060] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.949028 20010 raft_consensus.cc:2468] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:51.950335 20670 leader_election.cc:304] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:51.951169 20925 raft_consensus.cc:2804] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:51.951714 20925 raft_consensus.cc:697] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:51.952678 20925 consensus_queue.cc:237] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:51.955535 19932 raft_consensus.cc:2468] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:51.966572 19755 catalog_manager.cc:5697] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 1 to 2, leader changed from 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:51.976406 20880 raft_consensus.cc:993] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024: : Instructing follower 791fd9f5b6bc4d4486f11e87140e9ecb to start an election
I20260709 12:22:51.976990 20929 raft_consensus.cc:1081] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Signalling peer 791fd9f5b6bc4d4486f11e87140e9ecb to start an election
I20260709 12:22:51.978669 19931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f157aabf5bdd4201a3677151f9ccc1de"
dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
 from {username='slave'} at 127.0.0.1:42620
I20260709 12:22:51.979226 19931 raft_consensus.cc:493] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.979699 19931 raft_consensus.cc:3060] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.986060 19931 raft_consensus.cc:515] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:51.988329 19931 leader_election.cc:290] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:51.989423 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f157aabf5bdd4201a3677151f9ccc1de" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:51.989434 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f157aabf5bdd4201a3677151f9ccc1de" candidate_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:51.990061 20010 raft_consensus.cc:3060] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.990089 20075 raft_consensus.cc:3055] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:51.990480 20075 raft_consensus.cc:740] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:51.991079 20075 consensus_queue.cc:260] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:51.992230 20075 raft_consensus.cc:3060] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.995100 20010 raft_consensus.cc:2468] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:51.996131 19902 leader_election.cc:304] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 791fd9f5b6bc4d4486f11e87140e9ecb, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:51.996867 20918 raft_consensus.cc:2804] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:51.997061 20075 raft_consensus.cc:2468] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 791fd9f5b6bc4d4486f11e87140e9ecb in term 2.
I20260709 12:22:51.997394 20918 raft_consensus.cc:697] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Becoming Leader. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:51.998256 20918 consensus_queue.cc:237] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } }
I20260709 12:22:52.009536 19755 catalog_manager.cc:5697] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb reported cstate change: term changed from 1 to 2, leader changed from eafc6cb9dfb7468581367b29682ec024 (127.11.163.4) to 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2). New cstate: current_term: 2 leader_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.106218 20010 raft_consensus.cc:1275] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:52.107578 20925 consensus_queue.cc:1048] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:52.123863 20075 raft_consensus.cc:1275] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:52.125268 20925 consensus_queue.cc:1048] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:52.216002 20075 raft_consensus.cc:1275] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:52.217453 20925 consensus_queue.cc:1048] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:52.226729 19931 raft_consensus.cc:1275] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:52.228607 20903 consensus_queue.cc:1048] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:52.372277 19931 raft_consensus.cc:1275] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Refusing update from remote peer 86ad94e539f24675ba7226e7371cec9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:52.373749 20927 consensus_queue.cc:1048] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:52.375324 20010 raft_consensus.cc:1275] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:52.376644 20903 consensus_queue.cc:1048] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:52.386798 20075 raft_consensus.cc:1275] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Refusing update from remote peer 86ad94e539f24675ba7226e7371cec9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:52.388638 20927 consensus_queue.cc:1048] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:52.397871 19932 raft_consensus.cc:1275] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:52.399346 20925 consensus_queue.cc:1048] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:52.425283 20004 raft_consensus.cc:1275] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:52.426911 20918 consensus_queue.cc:1048] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:52.448510 20075 raft_consensus.cc:1275] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 791fd9f5b6bc4d4486f11e87140e9ecb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:52.450783 20918 consensus_queue.cc:1048] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:52.658708 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:52.694996 19932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692"
dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:45198
I20260709 12:22:52.695580 19932 raft_consensus.cc:606] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:52.698402 20080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40d5f2bc032946c286131fbde1598003"
dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:50032
I20260709 12:22:52.698941 20080 raft_consensus.cc:606] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:52.702589 20004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ce5ba2a49a949ec95fb5e6a9627f1f7"
dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:57938
I20260709 12:22:52.703182 20004 raft_consensus.cc:606] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:52.705667 20080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf3cb77b38fa4d559fd0dbf6852f150d"
dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:50032
I20260709 12:22:52.706377 20080 raft_consensus.cc:606] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:52.708914 20080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd"
dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:50032
I20260709 12:22:52.709515 20080 raft_consensus.cc:606] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:52.710757 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:52.712399 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:52.713132 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:52.843930 20886 raft_consensus.cc:993] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:52.844473 20927 raft_consensus.cc:1081] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:52.845907 20711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ce5ba2a49a949ec95fb5e6a9627f1f7"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56908
I20260709 12:22:52.846319 20711 raft_consensus.cc:493] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:52.846541 20711 raft_consensus.cc:3060] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:52.851322 20711 raft_consensus.cc:515] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:52.853004 20711 leader_election.cc:290] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Requested vote from peers 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799), 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705)
I20260709 12:22:52.853834 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce5ba2a49a949ec95fb5e6a9627f1f7" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:52.854125 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce5ba2a49a949ec95fb5e6a9627f1f7" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:52.854560 19932 raft_consensus.cc:3060] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:52.854739 20004 raft_consensus.cc:3055] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:52.855122 20004 raft_consensus.cc:740] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86ad94e539f24675ba7226e7371cec9b, State: Running, Role: LEADER
I20260709 12:22:52.855741 20004 consensus_queue.cc:260] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:52.856807 20004 raft_consensus.cc:3060] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:52.862715 19932 raft_consensus.cc:2468] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:52.864099 20669 leader_election.cc:304] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:52.865005 20925 raft_consensus.cc:2804] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:52.865553 20925 raft_consensus.cc:697] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:52.865824 20004 raft_consensus.cc:2468] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:52.866503 20925 consensus_queue.cc:237] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } }
I20260709 12:22:52.876902 19758 catalog_manager.cc:5697] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 1 to 2, leader changed from 86ad94e539f24675ba7226e7371cec9b (127.11.163.3) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.942900 20929 raft_consensus.cc:993] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:52.943593 20929 raft_consensus.cc:1081] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:52.945035 20711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf3cb77b38fa4d559fd0dbf6852f150d"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56916
I20260709 12:22:52.945514 20711 raft_consensus.cc:493] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:52.945806 20711 raft_consensus.cc:3060] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:52.951035 20711 raft_consensus.cc:515] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:52.952670 20711 leader_election.cc:290] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:52.953510 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf3cb77b38fa4d559fd0dbf6852f150d" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:52.953745 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf3cb77b38fa4d559fd0dbf6852f150d" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:52.954234 20004 raft_consensus.cc:3060] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:52.954378 20075 raft_consensus.cc:3055] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:52.954859 20075 raft_consensus.cc:740] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:52.955498 20075 consensus_queue.cc:260] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:52.956568 20075 raft_consensus.cc:3060] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:52.962623 20004 raft_consensus.cc:2468] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:52.963891 20670 leader_election.cc:304] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:52.966171 20925 raft_consensus.cc:2804] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:52.966697 20925 raft_consensus.cc:697] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:52.967763 20925 consensus_queue.cc:237] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:52.984730 19758 catalog_manager.cc:5697] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 1 to 2, leader changed from eafc6cb9dfb7468581367b29682ec024 (127.11.163.4) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.985556 20075 raft_consensus.cc:2468] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:53.013379 20929 raft_consensus.cc:993] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:53.013952 20950 raft_consensus.cc:1081] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:53.015515 20711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56916
I20260709 12:22:53.015969 20711 raft_consensus.cc:493] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.016247 20711 raft_consensus.cc:3060] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:53.021080 20711 raft_consensus.cc:515] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:53.024552 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:53.024197 20711 leader_election.cc:290] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 3 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345)
I20260709 12:22:53.024991 20929 raft_consensus.cc:993] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:53.025332 20004 raft_consensus.cc:3060] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:53.025077 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18a0228a3d644a5a20f80ded25c4edd" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:53.025933 20929 raft_consensus.cc:1081] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:53.026065 20075 raft_consensus.cc:3055] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:53.026453 20075 raft_consensus.cc:740] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:53.027711 20711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40d5f2bc032946c286131fbde1598003"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56916
I20260709 12:22:53.027258 20075 consensus_queue.cc:260] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:53.028299 20711 raft_consensus.cc:493] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.028719 20711 raft_consensus.cc:3060] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.028910 20075 raft_consensus.cc:3060] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:53.035054 20711 raft_consensus.cc:515] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:53.036389 20075 raft_consensus.cc:2468] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 3.
I20260709 12:22:53.037571 20711 leader_election.cc:290] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:53.038487 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d5f2bc032946c286131fbde1598003" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:53.039059 19930 raft_consensus.cc:3060] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.039547 20004 raft_consensus.cc:2468] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 3.
I20260709 12:22:53.041194 20670 leader_election.cc:304] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:53.042018 20925 raft_consensus.cc:2804] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:53.042493 20925 raft_consensus.cc:697] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:53.043111 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d5f2bc032946c286131fbde1598003" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:53.043380 20925 consensus_queue.cc:237] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:53.044610 20080 raft_consensus.cc:3055] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.045686 20080 raft_consensus.cc:740] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:53.046239 19930 raft_consensus.cc:2468] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:53.046588 20080 consensus_queue.cc:260] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:53.048413 20080 raft_consensus.cc:3060] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.052451 20669 leader_election.cc:304] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:53.053758 20903 raft_consensus.cc:2804] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.054414 20903 raft_consensus.cc:697] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:53.055497 20903 consensus_queue.cc:237] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:53.056689 20080 raft_consensus.cc:2468] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:53.080554 19758 catalog_manager.cc:5697] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 2 to 3, leader changed from eafc6cb9dfb7468581367b29682ec024 (127.11.163.4) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:53.100528 19758 catalog_manager.cc:5697] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 1 to 2, leader changed from eafc6cb9dfb7468581367b29682ec024 (127.11.163.4) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.101266 20918 raft_consensus.cc:993] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:53.101976 20957 raft_consensus.cc:1081] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:53.104897 20711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56910
I20260709 12:22:53.105407 20711 raft_consensus.cc:493] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.105746 20711 raft_consensus.cc:3060] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.113389 20711 raft_consensus.cc:515] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:53.115010 20711 leader_election.cc:290] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Requested vote from peers 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:53.115883 20004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86ad94e539f24675ba7226e7371cec9b"
I20260709 12:22:53.116461 20004 raft_consensus.cc:3060] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.116510 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df0d91742ce445ba27b3b21ed1b1692" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:53.117259 19930 raft_consensus.cc:3055] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.117528 19930 raft_consensus.cc:740] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 791fd9f5b6bc4d4486f11e87140e9ecb, State: Running, Role: LEADER
I20260709 12:22:53.118132 19930 consensus_queue.cc:260] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:53.119318 19930 raft_consensus.cc:3060] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.121657 20004 raft_consensus.cc:2468] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:53.122871 20670 leader_election.cc:304] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 86ad94e539f24675ba7226e7371cec9b; no voters: 
I20260709 12:22:53.123636 20925 raft_consensus.cc:2804] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.124162 20925 raft_consensus.cc:697] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:53.125144 20925 consensus_queue.cc:237] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } }
I20260709 12:22:53.129714 19930 raft_consensus.cc:2468] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:53.134940 19758 catalog_manager.cc:5697] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 1 to 2, leader changed from 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:53.330790 19930 raft_consensus.cc:1275] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.332298 20903 consensus_queue.cc:1048] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.357882 20004 raft_consensus.cc:1275] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.359597 20925 consensus_queue.cc:1048] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.405478 20004 raft_consensus.cc:1275] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.406708 20903 consensus_queue.cc:1048] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.420229 20075 raft_consensus.cc:1275] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.422344 20926 consensus_queue.cc:1048] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.482573 20004 raft_consensus.cc:1275] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:53.483773 20925 consensus_queue.cc:1048] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:53.493573 20080 raft_consensus.cc:1275] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:53.495322 20925 consensus_queue.cc:1048] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:53.557292 19930 raft_consensus.cc:1275] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.558791 20925 consensus_queue.cc:1048] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.568110 20075 raft_consensus.cc:1275] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.569451 20903 consensus_queue.cc:1048] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.637342 20004 raft_consensus.cc:1275] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.638645 20903 consensus_queue.cc:1048] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ad94e539f24675ba7226e7371cec9b" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.648274 19930 raft_consensus.cc:1275] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.650270 20903 consensus_queue.cc:1048] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.763659 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:53.800747 20075 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10bb95b2a5614ee7b33bf343c88fdf34"
dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:50032
I20260709 12:22:53.801399 20075 raft_consensus.cc:606] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:53.810038 20080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1"
dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
mode: GRACEFUL
new_leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:50032
I20260709 12:22:53.810534 20080 raft_consensus.cc:606] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Received request to transfer leadership to TS 0521760b9b9046b6a1dfd0886aa228f5
I20260709 12:22:53.811506 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:53.812796 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:53.813411 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:53.888950 20977 raft_consensus.cc:993] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:53.889547 20929 raft_consensus.cc:1081] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:53.891155 20716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56916
I20260709 12:22:53.891746 20716 raft_consensus.cc:493] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.892095 20716 raft_consensus.cc:3060] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:53.898811 20716 raft_consensus.cc:515] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:53.900398 20716 leader_election.cc:290] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 3 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:53.901127 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:53.901278 19932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e23ef51791b4a54986be21fcd6b36b1" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:53.901682 20080 raft_consensus.cc:3055] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:53.901862 19932 raft_consensus.cc:3060] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:53.901999 20080 raft_consensus.cc:740] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:53.902878 20080 consensus_queue.cc:260] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:53.904101 20080 raft_consensus.cc:3060] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:53.908936 19932 raft_consensus.cc:2468] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 3.
I20260709 12:22:53.910164 20669 leader_election.cc:304] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:53.910810 20080 raft_consensus.cc:2468] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 3.
I20260709 12:22:53.911073 20982 raft_consensus.cc:2804] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:53.912111 20982 raft_consensus.cc:697] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:53.913082 20982 consensus_queue.cc:237] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:53.925110 19758 catalog_manager.cc:5697] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 2 to 3, leader changed from eafc6cb9dfb7468581367b29682ec024 (127.11.163.4) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 3 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.980234 20977 raft_consensus.cc:993] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024: : Instructing follower 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:53.980690 20929 raft_consensus.cc:1081] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Signalling peer 0521760b9b9046b6a1dfd0886aa228f5 to start an election
I20260709 12:22:53.982229 20711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10bb95b2a5614ee7b33bf343c88fdf34"
dest_uuid: "0521760b9b9046b6a1dfd0886aa228f5"
 from {username='slave'} at 127.0.0.1:56916
I20260709 12:22:53.982700 20711 raft_consensus.cc:493] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.982951 20711 raft_consensus.cc:3060] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.990585 20711 raft_consensus.cc:515] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:53.994470 20711 leader_election.cc:290] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Requested vote from peers eafc6cb9dfb7468581367b29682ec024 (127.11.163.4:45345), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
I20260709 12:22:53.997226 19930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bb95b2a5614ee7b33bf343c88fdf34" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb"
I20260709 12:22:53.997926 19930 raft_consensus.cc:3060] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.002607 20075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bb95b2a5614ee7b33bf343c88fdf34" candidate_uuid: "0521760b9b9046b6a1dfd0886aa228f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eafc6cb9dfb7468581367b29682ec024"
I20260709 12:22:54.003304 20075 raft_consensus.cc:3055] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:54.003681 20075 raft_consensus.cc:740] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eafc6cb9dfb7468581367b29682ec024, State: Running, Role: LEADER
I20260709 12:22:54.004349 20075 consensus_queue.cc:260] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:54.005620 20075 raft_consensus.cc:3060] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.011205 19930 raft_consensus.cc:2468] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:54.014185 20669 leader_election.cc:304] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb; no voters: 
I20260709 12:22:54.015488 20982 raft_consensus.cc:2804] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:54.016052 20982 raft_consensus.cc:697] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Becoming Leader. State: Replica: 0521760b9b9046b6a1dfd0886aa228f5, State: Running, Role: LEADER
I20260709 12:22:54.017397 20982 consensus_queue.cc:237] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:54.021355 20075 raft_consensus.cc:2468] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0521760b9b9046b6a1dfd0886aa228f5 in term 2.
I20260709 12:22:54.029809 19758 catalog_manager.cc:5697] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 reported cstate change: term changed from 1 to 2, leader changed from eafc6cb9dfb7468581367b29682ec024 (127.11.163.4) to 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "0521760b9b9046b6a1dfd0886aa228f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:54.415796 20075 raft_consensus.cc:1275] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:54.417019 20982 consensus_queue.cc:1048] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:54.432960 19932 raft_consensus.cc:1275] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:54.438182 20982 consensus_queue.cc:1048] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:54.577961 19932 raft_consensus.cc:1275] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.579563 20925 consensus_queue.cc:1048] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.593534 20080 raft_consensus.cc:1275] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Refusing update from remote peer 0521760b9b9046b6a1dfd0886aa228f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.600919 20903 consensus_queue.cc:1048] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.848729 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:54.886461 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:54.887768 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:54.888360 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:54.923475 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:54.961341 11916 tablet_server.cc:179] TabletServer@127.11.163.1:39037 shutting down...
W20260709 12:22:54.978765 19975 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 79 similar messages]
W20260709 12:22:55.000245 19975 consensus_peers.cc:597] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.017149 19901 consensus_peers.cc:597] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.022845 20049 consensus_peers.cc:597] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.026403 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:55.027562 11916 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:55.028246 19901 consensus_peers.cc:597] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.028637 11916 raft_consensus.cc:2243] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.029567 11916 raft_consensus.cc:2272] T 52fa7ab6ac204f20991d64236150e97f P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.032127 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.032817 11916 raft_consensus.cc:2243] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.033301 11916 raft_consensus.cc:2272] T 21c9eef48cb44a5c90e59f965bf16d75 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.035777 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.036693 11916 raft_consensus.cc:2243] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.037245 11916 raft_consensus.cc:2272] T b16c8dbaaffb4ff58286d705232636e3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.040663 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.041458 11916 raft_consensus.cc:2243] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.042276 11916 raft_consensus.cc:2272] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.044780 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.045354 11916 raft_consensus.cc:2243] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.045822 11916 raft_consensus.cc:2272] T 4169ab4a7eee4ce587af1e7350f8629e P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.048067 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.048660 11916 raft_consensus.cc:2243] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.049117 11916 raft_consensus.cc:2272] T 3d1caa8a675041d28e2eb5045f7e6a4a P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.052059 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.052876 11916 raft_consensus.cc:2243] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.053298 11916 raft_consensus.cc:2272] T ebcd105158424342b29d433430a26086 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.056160 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.056855 11916 raft_consensus.cc:2243] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.057291 11916 raft_consensus.cc:2272] T f383be5926e94960a9e3a9481d19e8d9 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.059767 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.060487 11916 raft_consensus.cc:2243] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.060938 11916 raft_consensus.cc:2272] T 0fb16fbe1d984b77949f632328ba99fb P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.063520 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.064227 11916 raft_consensus.cc:2243] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.064685 11916 raft_consensus.cc:2272] T a8fd600b97cc4962a0c2aa0ea2192e27 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.067243 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.067832 11916 raft_consensus.cc:2243] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.068238 11916 raft_consensus.cc:2272] T 2b19f486bdbe4ad6ad645409c3a27940 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.070319 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.070925 11916 raft_consensus.cc:2243] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.071729 11916 raft_consensus.cc:2272] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.073657 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.074224 11916 raft_consensus.cc:2243] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.074729 11916 raft_consensus.cc:2272] T 22ae825dd7c04568bd5e70cd1433e282 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.077067 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.077672 11916 raft_consensus.cc:2243] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.078084 11916 raft_consensus.cc:2272] T 4b3835bda54b4d75a4985b5f514743a4 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.080090 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.080641 11916 raft_consensus.cc:2243] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.081049 11916 raft_consensus.cc:2272] T f67375288ddd4f70b9d2b85894e64783 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.082981 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.083662 11916 raft_consensus.cc:2243] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.084193 11916 raft_consensus.cc:2272] T 551cd77f8f81497eaf0336d9004c56cd P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.086843 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.087671 11916 raft_consensus.cc:2243] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.088276 11916 raft_consensus.cc:2272] T 39f4a78b032347e688bf751ec532d805 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.091343 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.092271 11916 raft_consensus.cc:2243] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.092814 11916 raft_consensus.cc:2272] T 9aacfd09289c4d5a8b72e5391c896c26 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.095664 11916 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:55.095904 20049 consensus_peers.cc:597] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.096491 11916 raft_consensus.cc:2243] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.097390 11916 raft_consensus.cc:2272] T 78284f7a2a9440b5a5d708cd128f3b04 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.100214 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.100972 11916 raft_consensus.cc:2243] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.101534 11916 raft_consensus.cc:2272] T e552c7773ca94ad597485fb7683e0ec2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.104578 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.105396 11916 raft_consensus.cc:2243] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.106454 11916 raft_consensus.cc:2272] T 40d5f2bc032946c286131fbde1598003 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.109333 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.110289 11916 raft_consensus.cc:2243] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.110855 11916 raft_consensus.cc:2272] T b3d5cc1a80804da78ba578ecc962897f P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.111290 19975 consensus_peers.cc:597] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.114262 11916 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:55.114830 20049 consensus_peers.cc:597] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.115291 11916 raft_consensus.cc:2243] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.116701 11916 raft_consensus.cc:2272] T 6deec39d0e7447fe9d7802f05466f079 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.119542 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.120342 11916 raft_consensus.cc:2243] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.121368 11916 raft_consensus.cc:2272] T aa5fc07ed3b34983a19659aac8863a06 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.122298 20049 consensus_peers.cc:597] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.124135 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.125456 11916 raft_consensus.cc:2243] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.126278 11916 raft_consensus.cc:2272] T 2f3b7cf591de4141825ccc578837bdb3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.130466 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.131516 11916 raft_consensus.cc:2243] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.132215 11916 raft_consensus.cc:2272] T f9721080ec054fdebd8303f5a8cc8b70 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.135545 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.136440 11916 raft_consensus.cc:2243] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.137023 11916 raft_consensus.cc:2272] T d318a253a656405f809d73600a4fab9b P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.140071 11916 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:55.140679 19901 consensus_peers.cc:597] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.140889 11916 raft_consensus.cc:2243] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.141520 11916 raft_consensus.cc:2272] T 43b2d93090d64da389b15b3b5b736ae2 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.144734 11916 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:55.145404 19901 consensus_peers.cc:597] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.145519 11916 raft_consensus.cc:2243] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.146477 11916 raft_consensus.cc:2272] T cf3cb77b38fa4d559fd0dbf6852f150d P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.148689 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.149400 11916 raft_consensus.cc:2243] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.149822 11916 raft_consensus.cc:2272] T d943a11750804b61969f012e4f945c2d P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.152061 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.152624 11916 raft_consensus.cc:2243] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.153067 11916 raft_consensus.cc:2272] T 0301806b41464a5b8e873701b04451df P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.155692 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.156497 11916 raft_consensus.cc:2243] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.157084 11916 raft_consensus.cc:2272] T 8d0efb7c87754b739cb88f4e13cb66c6 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.159849 20049 consensus_peers.cc:597] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.160097 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.161155 11916 raft_consensus.cc:2243] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.162127 11916 raft_consensus.cc:2272] T 0d1d3bf6702e45d280388eaf43d70e74 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.162654 19901 consensus_peers.cc:597] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.164724 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.165524 11916 raft_consensus.cc:2243] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.166477 11916 raft_consensus.cc:2272] T 5e23ef51791b4a54986be21fcd6b36b1 P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.169310 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.170105 11916 raft_consensus.cc:2243] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.171175 11916 raft_consensus.cc:2272] T e6f762ace6474e3d8514494a97777505 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.173583 20049 consensus_peers.cc:597] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.174044 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.174685 11916 raft_consensus.cc:2243] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.175082 11916 raft_consensus.cc:2272] T 371a360baa8343b796acd184956f785e P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.177330 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.177857 11916 raft_consensus.cc:2243] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.178310 11916 raft_consensus.cc:2272] T d5b6778cad39436ab0a260f86049592f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.180491 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.181092 11916 raft_consensus.cc:2243] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.181456 11916 raft_consensus.cc:2272] T 94dee1529a574c56ad2cb367867c20b7 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.183614 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.184226 11916 raft_consensus.cc:2243] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.185070 11916 raft_consensus.cc:2272] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.187183 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.187762 11916 raft_consensus.cc:2243] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.188531 11916 raft_consensus.cc:2272] T f18a0228a3d644a5a20f80ded25c4edd P 0521760b9b9046b6a1dfd0886aa228f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.190901 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.191417 11916 raft_consensus.cc:2243] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.191867 11916 raft_consensus.cc:2272] T f7b3985b4c004f27b2636195c5870246 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.193917 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.194444 11916 raft_consensus.cc:2243] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.194904 11916 raft_consensus.cc:2272] T 98432926ed9c4d049f84b4d657eb940f P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.196954 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.197575 11916 raft_consensus.cc:2243] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.197983 11916 raft_consensus.cc:2272] T bd824adf5e1e4a799b2ed798ae40d3a3 P 0521760b9b9046b6a1dfd0886aa228f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.200420 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.201109 11916 raft_consensus.cc:2243] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:22:55.201330 19901 consensus_peers.cc:597] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.201954 11916 raft_consensus.cc:2272] T 0df0d91742ce445ba27b3b21ed1b1692 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.204208 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:55.204689 11916 raft_consensus.cc:2243] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.205436 11916 raft_consensus.cc:2272] T 10bb95b2a5614ee7b33bf343c88fdf34 P 0521760b9b9046b6a1dfd0886aa228f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.216681 20049 consensus_peers.cc:597] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.218312 19975 consensus_peers.cc:597] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.219671 20049 consensus_peers.cc:597] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.253959 20049 consensus_peers.cc:597] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.261169 19901 consensus_peers.cc:597] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.285372 11916 tablet_server.cc:196] TabletServer@127.11.163.1:39037 shutdown complete.
W20260709 12:22:55.290366 20049 consensus_peers.cc:597] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.290819 19975 consensus_peers.cc:597] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.296834 19975 consensus_peers.cc:597] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.304709 19975 consensus_peers.cc:597] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.308677 20049 consensus_peers.cc:597] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.332742 19901 consensus_peers.cc:597] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.350286 19901 consensus_peers.cc:597] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.374046 11916 tablet_server.cc:179] TabletServer@127.11.163.2:0 shutting down...
W20260709 12:22:55.383661 19975 consensus_peers.cc:597] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.401815 20049 consensus_peers.cc:597] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.408013 19901 consensus_peers.cc:597] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.409996 19975 consensus_peers.cc:597] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.415664 19901 consensus_peers.cc:597] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.430214 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:55.431200 11916 tablet_replica.cc:333] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.432044 11916 raft_consensus.cc:2243] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.432579 11916 raft_consensus.cc:2272] T 43b2d93090d64da389b15b3b5b736ae2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.434958 11916 tablet_replica.cc:333] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.435758 11916 raft_consensus.cc:2243] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.436691 11916 raft_consensus.cc:2272] T ebcd105158424342b29d433430a26086 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.439567 11916 tablet_replica.cc:333] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.440534 11916 raft_consensus.cc:2243] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.441092 11916 raft_consensus.cc:2272] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.443222 20049 consensus_peers.cc:597] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 -> Peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Couldn't send request to peer 0521760b9b9046b6a1dfd0886aa228f5. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.443980 11916 tablet_replica.cc:333] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
W20260709 12:22:55.444173 20049 consensus_peers.cc:597] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.445103 11916 raft_consensus.cc:2243] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.446400 11916 raft_consensus.cc:2272] T f157aabf5bdd4201a3677151f9ccc1de P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.448925 11916 tablet_replica.cc:333] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.449620 11916 raft_consensus.cc:2243] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.450085 11916 raft_consensus.cc:2272] T aa5fc07ed3b34983a19659aac8863a06 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.452466 11916 tablet_replica.cc:333] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.453133 11916 raft_consensus.cc:2243] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.453686 11916 raft_consensus.cc:2272] T 0301806b41464a5b8e873701b04451df P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.456508 11916 tablet_replica.cc:333] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.457549 11916 raft_consensus.cc:2243] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.458214 11916 raft_consensus.cc:2272] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.460469 11916 tablet_replica.cc:333] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.461090 11916 raft_consensus.cc:2243] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.461951 11916 raft_consensus.cc:2272] T 98432926ed9c4d049f84b4d657eb940f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.463945 11916 tablet_replica.cc:333] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.464550 11916 raft_consensus.cc:2243] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.464998 11916 raft_consensus.cc:2272] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.467139 11916 tablet_replica.cc:333] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.467825 11916 raft_consensus.cc:2243] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.468698 11916 raft_consensus.cc:2272] T 22ae825dd7c04568bd5e70cd1433e282 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.470813 11916 tablet_replica.cc:333] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.471503 11916 raft_consensus.cc:2243] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.472348 11916 raft_consensus.cc:2272] T b16c8dbaaffb4ff58286d705232636e3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.474509 11916 tablet_replica.cc:333] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.475076 11916 raft_consensus.cc:2243] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.475975 11916 raft_consensus.cc:2272] T 8d0efb7c87754b739cb88f4e13cb66c6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.478727 11916 tablet_replica.cc:333] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.479370 11916 raft_consensus.cc:2243] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.479874 11916 raft_consensus.cc:2272] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.480834 19975 consensus_peers.cc:597] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.483258 11916 tablet_replica.cc:333] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.484638 11916 raft_consensus.cc:2243] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.486234 11916 raft_consensus.cc:2272] T 0fb16fbe1d984b77949f632328ba99fb P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.489398 11916 tablet_replica.cc:333] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.490089 11916 raft_consensus.cc:2243] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.491040 11916 raft_consensus.cc:2272] T a8fd600b97cc4962a0c2aa0ea2192e27 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.493930 11916 tablet_replica.cc:333] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.494596 11916 raft_consensus.cc:2243] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.495709 11916 raft_consensus.cc:2272] T 2b19f486bdbe4ad6ad645409c3a27940 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.496202 20049 consensus_peers.cc:597] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.498631 11916 tablet_replica.cc:333] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.499498 11916 raft_consensus.cc:2243] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.500008 11916 raft_consensus.cc:2272] T e6f762ace6474e3d8514494a97777505 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.501983 19975 consensus_peers.cc:597] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.502774 11916 tablet_replica.cc:333] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.503576 11916 raft_consensus.cc:2243] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.504000 11916 raft_consensus.cc:2272] T 0d1d3bf6702e45d280388eaf43d70e74 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.506209 11916 tablet_replica.cc:333] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.506843 11916 raft_consensus.cc:2243] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.507306 11916 raft_consensus.cc:2272] T 5e23ef51791b4a54986be21fcd6b36b1 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.509951 11916 tablet_replica.cc:333] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
W20260709 12:22:55.510470 19975 consensus_peers.cc:597] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.510766 11916 raft_consensus.cc:2243] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.511324 11916 raft_consensus.cc:2272] T ce7e36fa79c74c6c9f841770de353a62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.514037 11916 tablet_replica.cc:333] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.514884 11916 raft_consensus.cc:2243] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:55.514978 20049 consensus_peers.cc:597] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.515393 11916 raft_consensus.cc:2272] T 10bb95b2a5614ee7b33bf343c88fdf34 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.518112 11916 tablet_replica.cc:333] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.518875 11916 raft_consensus.cc:2243] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.519371 11916 raft_consensus.cc:2272] T 94dee1529a574c56ad2cb367867c20b7 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.522017 11916 tablet_replica.cc:333] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.522703 11916 raft_consensus.cc:2243] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.523159 11916 raft_consensus.cc:2272] T f67375288ddd4f70b9d2b85894e64783 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.525965 11916 tablet_replica.cc:333] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
W20260709 12:22:55.526301 19975 consensus_peers.cc:597] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.526772 11916 raft_consensus.cc:2243] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.527829 11916 raft_consensus.cc:2272] T 4b3835bda54b4d75a4985b5f514743a4 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.531277 11916 tablet_replica.cc:333] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.532104 11916 raft_consensus.cc:2243] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.532658 11916 raft_consensus.cc:2272] T b26bba3e147042a9bc03b848a9e13780 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.532946 19975 consensus_peers.cc:597] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.535184 11916 tablet_replica.cc:333] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.536026 11916 raft_consensus.cc:2243] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.536504 11916 raft_consensus.cc:2272] T b3d5cc1a80804da78ba578ecc962897f P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.538656 11916 tablet_replica.cc:333] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.539201 11916 raft_consensus.cc:2243] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.539659 11916 raft_consensus.cc:2272] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.541760 11916 tablet_replica.cc:333] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.542330 11916 raft_consensus.cc:2243] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.542727 11916 raft_consensus.cc:2272] T 40d5f2bc032946c286131fbde1598003 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.544812 11916 tablet_replica.cc:333] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.545459 11916 raft_consensus.cc:2243] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.546351 11916 raft_consensus.cc:2272] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.548468 11916 tablet_replica.cc:333] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.549041 11916 raft_consensus.cc:2243] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.549535 11916 raft_consensus.cc:2272] T d318a253a656405f809d73600a4fab9b P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.552173 11916 tablet_replica.cc:333] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.552868 11916 raft_consensus.cc:2243] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.553351 11916 raft_consensus.cc:2272] T f9721080ec054fdebd8303f5a8cc8b70 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.556046 11916 tablet_replica.cc:333] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.556849 11916 raft_consensus.cc:2243] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.557971 11916 raft_consensus.cc:2272] T 2f3b7cf591de4141825ccc578837bdb3 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.560722 11916 tablet_replica.cc:333] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
W20260709 12:22:55.561170 19975 consensus_peers.cc:597] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.561522 11916 raft_consensus.cc:2243] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.562675 11916 raft_consensus.cc:2272] T 6deec39d0e7447fe9d7802f05466f079 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.566049 11916 tablet_replica.cc:333] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.566805 11916 raft_consensus.cc:2243] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.567411 11916 raft_consensus.cc:2272] T 4498a59f91364174bc407d6d3adb80dd P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.570458 11916 tablet_replica.cc:333] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.571242 11916 raft_consensus.cc:2243] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.571786 11916 raft_consensus.cc:2272] T 52d17d263a1240d09b5735c7adad3e3c P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.574457 11916 tablet_replica.cc:333] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.575237 11916 raft_consensus.cc:2243] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.575811 11916 raft_consensus.cc:2272] T 096a550b72b246c3b15fd4b627f51174 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.578605 11916 tablet_replica.cc:333] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.579401 11916 raft_consensus.cc:2243] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.580492 11916 raft_consensus.cc:2272] T f153ead7b64c4983b271c2c190b7d2fc P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.583016 11916 tablet_replica.cc:333] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.583639 11916 raft_consensus.cc:2243] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.584153 11916 raft_consensus.cc:2272] T bd522cd408c24f868f5c1c4ab9d026b6 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.587189 11916 tablet_replica.cc:333] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.587896 11916 raft_consensus.cc:2243] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.588392 11916 raft_consensus.cc:2272] T 0df0d91742ce445ba27b3b21ed1b1692 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.588557 20049 consensus_peers.cc:597] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.590791 11916 tablet_replica.cc:333] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.591572 11916 raft_consensus.cc:2243] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.592046 11916 raft_consensus.cc:2272] T 3237b68a928849c2b369e32505a6e4a8 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.592172 20049 consensus_peers.cc:597] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.594000 11916 tablet_replica.cc:333] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.594635 11916 raft_consensus.cc:2243] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.595045 11916 raft_consensus.cc:2272] T f383be5926e94960a9e3a9481d19e8d9 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.597170 11916 tablet_replica.cc:333] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.597707 11916 raft_consensus.cc:2243] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.598163 11916 raft_consensus.cc:2272] T 21c9eef48cb44a5c90e59f965bf16d75 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.600416 11916 tablet_replica.cc:333] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.600958 11916 raft_consensus.cc:2243] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:55.601207 20049 consensus_peers.cc:597] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.601470 11916 raft_consensus.cc:2272] T 78284f7a2a9440b5a5d708cd128f3b04 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.603754 11916 tablet_replica.cc:333] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb: stopping tablet replica
I20260709 12:22:55.604214 11916 raft_consensus.cc:2243] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.605032 11916 raft_consensus.cc:2272] T 2956c270268242f88a839bc03d3d5d62 P 791fd9f5b6bc4d4486f11e87140e9ecb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:55.608995 19975 consensus_peers.cc:597] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.648831 19975 consensus_peers.cc:597] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.682646 20049 consensus_peers.cc:597] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:36799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.687988 11916 tablet_server.cc:196] TabletServer@127.11.163.2:0 shutdown complete.
W20260709 12:22:55.751021 19975 consensus_peers.cc:597] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:36799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.776289 19975 consensus_peers.cc:597] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:36799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.781527 11916 tablet_server.cc:179] TabletServer@127.11.163.3:0 shutting down...
W20260709 12:22:55.816856 20050 consensus_peers.cc:597] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 -> Peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Couldn't send request to peer 86ad94e539f24675ba7226e7371cec9b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:55.829959 20049 consensus_peers.cc:597] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 -> Peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Couldn't send request to peer 791fd9f5b6bc4d4486f11e87140e9ecb. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:36799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.843143 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:55.844022 11916 tablet_replica.cc:333] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.844730 11916 raft_consensus.cc:2243] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.845248 11916 raft_consensus.cc:2272] T ebcd105158424342b29d433430a26086 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.847409 11916 tablet_replica.cc:333] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.848057 11916 raft_consensus.cc:2243] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.848803 11916 raft_consensus.cc:2272] T 9c0a72abd201421e9bde4dcd6e8a3d43 P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.850595 11916 tablet_replica.cc:333] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.851181 11916 raft_consensus.cc:2243] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.851641 11916 raft_consensus.cc:2272] T aa5fc07ed3b34983a19659aac8863a06 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.853528 11916 tablet_replica.cc:333] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.854072 11916 raft_consensus.cc:2243] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.854480 11916 raft_consensus.cc:2272] T f157aabf5bdd4201a3677151f9ccc1de P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.856266 11916 tablet_replica.cc:333] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.856808 11916 raft_consensus.cc:2243] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.857204 11916 raft_consensus.cc:2272] T 52fa7ab6ac204f20991d64236150e97f P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.859253 11916 tablet_replica.cc:333] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.859844 11916 raft_consensus.cc:2243] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.860257 11916 raft_consensus.cc:2272] T 7ce5ba2a49a949ec95fb5e6a9627f1f7 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.862110 11916 tablet_replica.cc:333] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.862653 11916 raft_consensus.cc:2243] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.863509 11916 raft_consensus.cc:2272] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.865406 11916 tablet_replica.cc:333] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.865959 11916 raft_consensus.cc:2243] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.866830 11916 raft_consensus.cc:2272] T f7b3985b4c004f27b2636195c5870246 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.869556 11916 tablet_replica.cc:333] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.870355 11916 raft_consensus.cc:2243] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.870915 11916 raft_consensus.cc:2272] T b16c8dbaaffb4ff58286d705232636e3 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.873716 11916 tablet_replica.cc:333] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.874441 11916 raft_consensus.cc:2243] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.874975 11916 raft_consensus.cc:2272] T 39f4a78b032347e688bf751ec532d805 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.877528 11916 tablet_replica.cc:333] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.878047 11916 raft_consensus.cc:2243] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.878751 11916 raft_consensus.cc:2272] T 551cd77f8f81497eaf0336d9004c56cd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.880688 11916 tablet_replica.cc:333] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.881178 11916 raft_consensus.cc:2243] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.881543 11916 raft_consensus.cc:2272] T 3d1caa8a675041d28e2eb5045f7e6a4a P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.883476 11916 tablet_replica.cc:333] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.883991 11916 raft_consensus.cc:2243] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.884334 11916 raft_consensus.cc:2272] T e552c7773ca94ad597485fb7683e0ec2 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.886243 11916 tablet_replica.cc:333] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.886754 11916 raft_consensus.cc:2243] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.887532 11916 raft_consensus.cc:2272] T 240e5e8e04aa4ce2bbff8d21eb78a76c P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.889634 11916 tablet_replica.cc:333] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.890156 11916 raft_consensus.cc:2243] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.890511 11916 raft_consensus.cc:2272] T a19aff8bcdbb4bd29e22cb5f7f4cc1e6 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.892306 11916 tablet_replica.cc:333] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.892807 11916 raft_consensus.cc:2243] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.893518 11916 raft_consensus.cc:2272] T 3237b68a928849c2b369e32505a6e4a8 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.895397 11916 tablet_replica.cc:333] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.895910 11916 raft_consensus.cc:2243] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.896621 11916 raft_consensus.cc:2272] T f383be5926e94960a9e3a9481d19e8d9 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.898746 11916 tablet_replica.cc:333] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.899585 11916 raft_consensus.cc:2243] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.900147 11916 raft_consensus.cc:2272] T 9aacfd09289c4d5a8b72e5391c896c26 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.902644 11916 tablet_replica.cc:333] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.903375 11916 raft_consensus.cc:2243] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.903883 11916 raft_consensus.cc:2272] T 2956c270268242f88a839bc03d3d5d62 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.906332 11916 tablet_replica.cc:333] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.907140 11916 raft_consensus.cc:2243] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.907699 11916 raft_consensus.cc:2272] T e6f762ace6474e3d8514494a97777505 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.910246 11916 tablet_replica.cc:333] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.910794 11916 raft_consensus.cc:2243] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.911715 11916 raft_consensus.cc:2272] T 371a360baa8343b796acd184956f785e P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.914212 11916 tablet_replica.cc:333] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.915110 11916 raft_consensus.cc:2243] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.915688 11916 raft_consensus.cc:2272] T d5b6778cad39436ab0a260f86049592f P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.918519 11916 tablet_replica.cc:333] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.919276 11916 raft_consensus.cc:2243] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.919836 11916 raft_consensus.cc:2272] T ce7e36fa79c74c6c9f841770de353a62 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.922533 11916 tablet_replica.cc:333] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.923099 11916 raft_consensus.cc:2243] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.923619 11916 raft_consensus.cc:2272] T 0fb16fbe1d984b77949f632328ba99fb P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.925614 11916 tablet_replica.cc:333] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.926254 11916 raft_consensus.cc:2243] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.926699 11916 raft_consensus.cc:2272] T a8fd600b97cc4962a0c2aa0ea2192e27 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.928759 11916 tablet_replica.cc:333] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.929356 11916 raft_consensus.cc:2243] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.929803 11916 raft_consensus.cc:2272] T 2f3b7cf591de4141825ccc578837bdb3 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.931866 11916 tablet_replica.cc:333] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.932416 11916 raft_consensus.cc:2243] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.932849 11916 raft_consensus.cc:2272] T 7dee8a7582284ad8a4edbc4d53c02cf2 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.934653 11916 tablet_replica.cc:333] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.935300 11916 raft_consensus.cc:2243] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.936275 11916 raft_consensus.cc:2272] T bd824adf5e1e4a799b2ed798ae40d3a3 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.938745 11916 tablet_replica.cc:333] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.939312 11916 raft_consensus.cc:2243] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.939822 11916 raft_consensus.cc:2272] T 0df0d91742ce445ba27b3b21ed1b1692 P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.941573 11916 tablet_replica.cc:333] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.942041 11916 raft_consensus.cc:2243] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.942799 11916 raft_consensus.cc:2272] T bd522cd408c24f868f5c1c4ab9d026b6 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.944792 11916 tablet_replica.cc:333] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.945277 11916 raft_consensus.cc:2243] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.945757 11916 raft_consensus.cc:2272] T 0e6b3c311ea54efba7ed246f0ccd9c2e P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.948275 11916 tablet_replica.cc:333] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.949014 11916 raft_consensus.cc:2243] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.949952 11916 raft_consensus.cc:2272] T 94dee1529a574c56ad2cb367867c20b7 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.952329 11916 tablet_replica.cc:333] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.952919 11916 raft_consensus.cc:2243] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.953342 11916 raft_consensus.cc:2272] T f18a0228a3d644a5a20f80ded25c4edd P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.955361 11916 tablet_replica.cc:333] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.955925 11916 raft_consensus.cc:2243] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.956333 11916 raft_consensus.cc:2272] T 4169ab4a7eee4ce587af1e7350f8629e P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.958256 11916 tablet_replica.cc:333] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.958798 11916 raft_consensus.cc:2243] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.959214 11916 raft_consensus.cc:2272] T cf3cb77b38fa4d559fd0dbf6852f150d P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.960990 11916 tablet_replica.cc:333] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.961521 11916 raft_consensus.cc:2243] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.961941 11916 raft_consensus.cc:2272] T d943a11750804b61969f012e4f945c2d P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.963831 11916 tablet_replica.cc:333] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.964345 11916 raft_consensus.cc:2243] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.965099 11916 raft_consensus.cc:2272] T 21c9eef48cb44a5c90e59f965bf16d75 P 86ad94e539f24675ba7226e7371cec9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.967132 11916 tablet_replica.cc:333] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.967720 11916 raft_consensus.cc:2243] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.968137 11916 raft_consensus.cc:2272] T 4b3835bda54b4d75a4985b5f514743a4 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.970029 11916 tablet_replica.cc:333] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.970662 11916 raft_consensus.cc:2243] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.971784 11916 raft_consensus.cc:2272] T b26bba3e147042a9bc03b848a9e13780 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.974015 11916 tablet_replica.cc:333] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.974522 11916 raft_consensus.cc:2243] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.975289 11916 raft_consensus.cc:2272] T 52d17d263a1240d09b5735c7adad3e3c P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.977407 11916 tablet_replica.cc:333] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.977952 11916 raft_consensus.cc:2243] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:55.978710 11916 raft_consensus.cc:2272] T 096a550b72b246c3b15fd4b627f51174 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.980535 11916 tablet_replica.cc:333] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.981045 11916 raft_consensus.cc:2243] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.981437 11916 raft_consensus.cc:2272] T f153ead7b64c4983b271c2c190b7d2fc P 86ad94e539f24675ba7226e7371cec9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.983326 11916 tablet_replica.cc:333] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.983793 11916 raft_consensus.cc:2243] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.984156 11916 raft_consensus.cc:2272] T 6deec39d0e7447fe9d7802f05466f079 P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:55.986073 11916 tablet_replica.cc:333] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b: stopping tablet replica
I20260709 12:22:55.986475 11916 raft_consensus.cc:2243] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:55.986820 11916 raft_consensus.cc:2272] T 4498a59f91364174bc407d6d3adb80dd P 86ad94e539f24675ba7226e7371cec9b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:56.060343 20050 consensus_peers.cc:597] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 -> Peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Couldn't send request to peer 86ad94e539f24675ba7226e7371cec9b. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.3:42705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:56.072918 11916 tablet_server.cc:196] TabletServer@127.11.163.3:0 shutdown complete.
I20260709 12:22:56.113492 21004 raft_consensus.cc:493] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0521760b9b9046b6a1dfd0886aa228f5)
I20260709 12:22:56.114071 21004 raft_consensus.cc:515] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafc6cb9dfb7468581367b29682ec024" member_type: VOTER last_known_addr { host: "127.11.163.4" port: 45345 } } peers { permanent_uuid: "0521760b9b9046b6a1dfd0886aa228f5" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39037 } } peers { permanent_uuid: "791fd9f5b6bc4d4486f11e87140e9ecb" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 36799 } }
I20260709 12:22:56.115850 21004 leader_election.cc:290] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037), 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799)
W20260709 12:22:56.120136 20049 leader_election.cc:336] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0521760b9b9046b6a1dfd0886aa228f5 (127.11.163.1:39037): Network error: Client connection negotiation failed: client connection to 127.11.163.1:39037: connect: Connection refused (error 111)
W20260709 12:22:56.120879 20049 leader_election.cc:336] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 791fd9f5b6bc4d4486f11e87140e9ecb (127.11.163.2:36799): Network error: Client connection negotiation failed: client connection to 127.11.163.2:36799: connect: Connection refused (error 111)
I20260709 12:22:56.121340 20049 leader_election.cc:304] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eafc6cb9dfb7468581367b29682ec024; no voters: 0521760b9b9046b6a1dfd0886aa228f5, 791fd9f5b6bc4d4486f11e87140e9ecb
I20260709 12:22:56.122167 21004 raft_consensus.cc:2749] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:56.127259 20050 consensus_peers.cc:597] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 -> Peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Couldn't send request to peer 86ad94e539f24675ba7226e7371cec9b. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.3:42705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:56.142186 20050 consensus_peers.cc:597] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 -> Peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Couldn't send request to peer 86ad94e539f24675ba7226e7371cec9b. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.3:42705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:56.150327 11916 tablet_server.cc:179] TabletServer@127.11.163.4:0 shutting down...
W20260709 12:22:56.159263 20050 consensus_peers.cc:597] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 -> Peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Couldn't send request to peer 86ad94e539f24675ba7226e7371cec9b. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.3:42705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:56.159813 20050 consensus_peers.cc:597] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 -> Peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Couldn't send request to peer 86ad94e539f24675ba7226e7371cec9b. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.3:42705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:56.174978 20050 consensus_peers.cc:597] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 -> Peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Couldn't send request to peer 86ad94e539f24675ba7226e7371cec9b. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.3:42705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:56.194762 20050 consensus_peers.cc:597] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 -> Peer 86ad94e539f24675ba7226e7371cec9b (127.11.163.3:42705): Couldn't send request to peer 86ad94e539f24675ba7226e7371cec9b. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.3:42705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:56.197008 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:56.197954 11916 tablet_replica.cc:333] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.198989 11916 raft_consensus.cc:2243] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.199476 11916 raft_consensus.cc:2272] T 9c0a72abd201421e9bde4dcd6e8a3d43 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.201381 11916 tablet_replica.cc:333] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.201936 11916 raft_consensus.cc:2243] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.202279 11916 raft_consensus.cc:2272] T f157aabf5bdd4201a3677151f9ccc1de P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.204377 11916 tablet_replica.cc:333] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.204895 11916 raft_consensus.cc:2243] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.205264 11916 raft_consensus.cc:2272] T 52fa7ab6ac204f20991d64236150e97f P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.207031 11916 tablet_replica.cc:333] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.207602 11916 raft_consensus.cc:2243] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.208307 11916 raft_consensus.cc:2272] T 0301806b41464a5b8e873701b04451df P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.210243 11916 tablet_replica.cc:333] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.210736 11916 raft_consensus.cc:2243] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.211089 11916 raft_consensus.cc:2272] T 3237b68a928849c2b369e32505a6e4a8 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.212865 11916 tablet_replica.cc:333] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.213348 11916 raft_consensus.cc:2243] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.213702 11916 raft_consensus.cc:2272] T 98432926ed9c4d049f84b4d657eb940f P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.215517 11916 tablet_replica.cc:333] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.216023 11916 raft_consensus.cc:2243] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.216377 11916 raft_consensus.cc:2272] T 8acee3c287d24c97ad0f5fcea4bbcaa9 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.218149 11916 tablet_replica.cc:333] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.218662 11916 raft_consensus.cc:2243] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.219027 11916 raft_consensus.cc:2272] T f7b3985b4c004f27b2636195c5870246 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.220882 11916 tablet_replica.cc:333] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.221379 11916 raft_consensus.cc:2243] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.221750 11916 raft_consensus.cc:2272] T 22ae825dd7c04568bd5e70cd1433e282 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.223651 11916 tablet_replica.cc:333] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.224161 11916 raft_consensus.cc:2243] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.224885 11916 raft_consensus.cc:2272] T 39f4a78b032347e688bf751ec532d805 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.226692 11916 tablet_replica.cc:333] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.227165 11916 raft_consensus.cc:2243] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.227594 11916 raft_consensus.cc:2272] T 551cd77f8f81497eaf0336d9004c56cd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.229259 11916 tablet_replica.cc:333] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.229739 11916 raft_consensus.cc:2243] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.230078 11916 raft_consensus.cc:2272] T 2b19f486bdbe4ad6ad645409c3a27940 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.231782 11916 tablet_replica.cc:333] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.232268 11916 raft_consensus.cc:2243] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.232961 11916 raft_consensus.cc:2272] T 43b2d93090d64da389b15b3b5b736ae2 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.234710 11916 tablet_replica.cc:333] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.235186 11916 raft_consensus.cc:2243] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.235598 11916 raft_consensus.cc:2272] T cf3cb77b38fa4d559fd0dbf6852f150d P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.237479 11916 tablet_replica.cc:333] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.238039 11916 raft_consensus.cc:2243] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.238762 11916 raft_consensus.cc:2272] T d943a11750804b61969f012e4f945c2d P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.240525 11916 tablet_replica.cc:333] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.241051 11916 raft_consensus.cc:2243] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.241446 11916 raft_consensus.cc:2272] T 0d1d3bf6702e45d280388eaf43d70e74 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.243279 11916 tablet_replica.cc:333] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.243834 11916 raft_consensus.cc:2243] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.244220 11916 raft_consensus.cc:2272] T 5e23ef51791b4a54986be21fcd6b36b1 P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.246050 11916 tablet_replica.cc:333] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.246557 11916 raft_consensus.cc:2243] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.246963 11916 raft_consensus.cc:2272] T 371a360baa8343b796acd184956f785e P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.248843 11916 tablet_replica.cc:333] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.249363 11916 raft_consensus.cc:2243] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.250106 11916 raft_consensus.cc:2272] T d5b6778cad39436ab0a260f86049592f P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.251921 11916 tablet_replica.cc:333] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.252429 11916 raft_consensus.cc:2243] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.253189 11916 raft_consensus.cc:2272] T ce7e36fa79c74c6c9f841770de353a62 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.255084 11916 tablet_replica.cc:333] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.255686 11916 raft_consensus.cc:2243] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.256107 11916 raft_consensus.cc:2272] T 0e6b3c311ea54efba7ed246f0ccd9c2e P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.257905 11916 tablet_replica.cc:333] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.258450 11916 raft_consensus.cc:2243] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.258846 11916 raft_consensus.cc:2272] T f18a0228a3d644a5a20f80ded25c4edd P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.260789 11916 tablet_replica.cc:333] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.261338 11916 raft_consensus.cc:2243] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.261760 11916 raft_consensus.cc:2272] T bd824adf5e1e4a799b2ed798ae40d3a3 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.263629 11916 tablet_replica.cc:333] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.264164 11916 raft_consensus.cc:2243] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.264577 11916 raft_consensus.cc:2272] T bd522cd408c24f868f5c1c4ab9d026b6 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.266434 11916 tablet_replica.cc:333] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.266990 11916 raft_consensus.cc:2243] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.267408 11916 raft_consensus.cc:2272] T 10bb95b2a5614ee7b33bf343c88fdf34 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.269307 11916 tablet_replica.cc:333] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.269865 11916 raft_consensus.cc:2243] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.270648 11916 raft_consensus.cc:2272] T b3d5cc1a80804da78ba578ecc962897f P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.272665 11916 tablet_replica.cc:333] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.273200 11916 raft_consensus.cc:2243] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.273957 11916 raft_consensus.cc:2272] T e552c7773ca94ad597485fb7683e0ec2 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.275853 11916 tablet_replica.cc:333] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.276490 11916 raft_consensus.cc:2243] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.276842 11916 raft_consensus.cc:2272] T 40d5f2bc032946c286131fbde1598003 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.278512 11916 tablet_replica.cc:333] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.278966 11916 raft_consensus.cc:2243] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.279347 11916 raft_consensus.cc:2272] T 240e5e8e04aa4ce2bbff8d21eb78a76c P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.281199 11916 tablet_replica.cc:333] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.281886 11916 raft_consensus.cc:2243] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.282320 11916 raft_consensus.cc:2272] T 7dee8a7582284ad8a4edbc4d53c02cf2 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.284107 11916 tablet_replica.cc:333] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.284683 11916 raft_consensus.cc:2243] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.285511 11916 raft_consensus.cc:2272] T f9721080ec054fdebd8303f5a8cc8b70 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.287498 11916 tablet_replica.cc:333] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.288062 11916 raft_consensus.cc:2243] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.288797 11916 raft_consensus.cc:2272] T d318a253a656405f809d73600a4fab9b P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.290613 11916 tablet_replica.cc:333] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.291150 11916 raft_consensus.cc:2243] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.291615 11916 raft_consensus.cc:2272] T 8d0efb7c87754b739cb88f4e13cb66c6 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.293352 11916 tablet_replica.cc:333] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.293860 11916 raft_consensus.cc:2243] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.294252 11916 raft_consensus.cc:2272] T 52d17d263a1240d09b5735c7adad3e3c P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.296089 11916 tablet_replica.cc:333] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.296595 11916 raft_consensus.cc:2243] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.296981 11916 raft_consensus.cc:2272] T 096a550b72b246c3b15fd4b627f51174 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.298794 11916 tablet_replica.cc:333] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.299294 11916 raft_consensus.cc:2243] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.299753 11916 raft_consensus.cc:2272] T f153ead7b64c4983b271c2c190b7d2fc P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.301538 11916 tablet_replica.cc:333] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.302073 11916 raft_consensus.cc:2243] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.302824 11916 raft_consensus.cc:2272] T 4498a59f91364174bc407d6d3adb80dd P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.304751 11916 tablet_replica.cc:333] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.305266 11916 raft_consensus.cc:2243] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.306013 11916 raft_consensus.cc:2272] T 3d1caa8a675041d28e2eb5045f7e6a4a P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.307873 11916 tablet_replica.cc:333] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.308378 11916 raft_consensus.cc:2243] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.309139 11916 raft_consensus.cc:2272] T f67375288ddd4f70b9d2b85894e64783 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.310943 11916 tablet_replica.cc:333] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.311480 11916 raft_consensus.cc:2243] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.311882 11916 raft_consensus.cc:2272] T b26bba3e147042a9bc03b848a9e13780 P eafc6cb9dfb7468581367b29682ec024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.313701 11916 tablet_replica.cc:333] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.314210 11916 raft_consensus.cc:2243] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.314955 11916 raft_consensus.cc:2272] T 9aacfd09289c4d5a8b72e5391c896c26 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.316741 11916 tablet_replica.cc:333] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.317231 11916 raft_consensus.cc:2243] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.317678 11916 raft_consensus.cc:2272] T 78284f7a2a9440b5a5d708cd128f3b04 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.319412 11916 tablet_replica.cc:333] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.319921 11916 raft_consensus.cc:2243] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.320338 11916 raft_consensus.cc:2272] T 2956c270268242f88a839bc03d3d5d62 P eafc6cb9dfb7468581367b29682ec024 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.322135 11916 tablet_replica.cc:333] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024: stopping tablet replica
I20260709 12:22:56.322582 11916 raft_consensus.cc:2243] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.323333 11916 raft_consensus.cc:2272] T 4169ab4a7eee4ce587af1e7350f8629e P eafc6cb9dfb7468581367b29682ec024 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.388072 11916 tablet_server.cc:196] TabletServer@127.11.163.4:0 shutdown complete.
I20260709 12:22:56.451632 11916 master.cc:562] Master@127.11.163.62:41995 shutting down...
I20260709 12:22:56.475167 11916 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.475791 11916 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.476126 11916 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1b7f3e2962e245da985b7f1114066e8f: stopping tablet replica
I20260709 12:22:56.497433 11916 master.cc:584] Master@127.11.163.62:41995 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (30548 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:22:56.587949 11916 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.163.62:36937
I20260709 12:22:56.589659 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:56.595598 21011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:56.596129 21013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:56.596052 21010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:56.597836 11916 server_base.cc:1061] running on GCE node
I20260709 12:22:56.598881 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:56.599088 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:56.599244 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599776599214 us; error 0 us; skew 500 ppm
I20260709 12:22:56.599817 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:56.602129 11916 webserver.cc:533] Webserver started at http://127.11.163.62:45169/ using document root <none> and password file <none>
I20260709 12:22:56.602638 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:56.602825 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:56.603101 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:56.604274 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/master-0-root/instance:
uuid: "c320fad0592c4ca4ab87a166d6bf4b45"
format_stamp: "Formatted at 2026-07-09 12:22:56 on dist-test-slave-z9f9"
I20260709 12:22:56.608939 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:56.612310 21018 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:56.613081 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:56.613389 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/master-0-root
uuid: "c320fad0592c4ca4ab87a166d6bf4b45"
format_stamp: "Formatted at 2026-07-09 12:22:56 on dist-test-slave-z9f9"
I20260709 12:22:56.613672 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:56.634266 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:56.635620 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:56.674829 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.62:36937
I20260709 12:22:56.674963 21069 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.62:36937 every 8 connection(s)
I20260709 12:22:56.678825 21070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.690138 21070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45: Bootstrap starting.
I20260709 12:22:56.695698 21070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.700063 21070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45: No bootstrap required, opened a new log
I20260709 12:22:56.702243 21070 raft_consensus.cc:359] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c320fad0592c4ca4ab87a166d6bf4b45" member_type: VOTER }
I20260709 12:22:56.702641 21070 raft_consensus.cc:385] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.702863 21070 raft_consensus.cc:740] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c320fad0592c4ca4ab87a166d6bf4b45, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.703544 21070 consensus_queue.cc:260] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c320fad0592c4ca4ab87a166d6bf4b45" member_type: VOTER }
I20260709 12:22:56.703997 21070 raft_consensus.cc:399] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:56.704210 21070 raft_consensus.cc:493] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:56.704473 21070 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.709156 21070 raft_consensus.cc:515] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c320fad0592c4ca4ab87a166d6bf4b45" member_type: VOTER }
I20260709 12:22:56.709651 21070 leader_election.cc:304] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c320fad0592c4ca4ab87a166d6bf4b45; no voters: 
I20260709 12:22:56.710846 21070 leader_election.cc:290] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:56.711175 21073 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:56.712742 21073 raft_consensus.cc:697] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [term 1 LEADER]: Becoming Leader. State: Replica: c320fad0592c4ca4ab87a166d6bf4b45, State: Running, Role: LEADER
I20260709 12:22:56.713433 21073 consensus_queue.cc:237] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c320fad0592c4ca4ab87a166d6bf4b45" member_type: VOTER }
I20260709 12:22:56.714015 21070 sys_catalog.cc:565] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:56.718608 21075 sys_catalog.cc:455] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c320fad0592c4ca4ab87a166d6bf4b45. Latest consensus state: current_term: 1 leader_uuid: "c320fad0592c4ca4ab87a166d6bf4b45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c320fad0592c4ca4ab87a166d6bf4b45" member_type: VOTER } }
I20260709 12:22:56.719017 21074 sys_catalog.cc:455] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c320fad0592c4ca4ab87a166d6bf4b45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c320fad0592c4ca4ab87a166d6bf4b45" member_type: VOTER } }
I20260709 12:22:56.719478 21075 sys_catalog.cc:458] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:56.719887 21074 sys_catalog.cc:458] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:56.722694 21080 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:56.727813 21080 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:56.731159 11916 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:56.736480 21080 catalog_manager.cc:1383] Generated new cluster ID: e28005131c744649a33529e64776c3b1
I20260709 12:22:56.736789 21080 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:56.753280 21080 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:56.754662 21080 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:56.771042 21080 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45: Generated new TSK 0
I20260709 12:22:56.771692 21080 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:56.798806 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:56.805529 21091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:56.806785 21092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:56.809686 21094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:56.809831 11916 server_base.cc:1061] running on GCE node
I20260709 12:22:56.811239 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:56.811496 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:56.811641 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599776811630 us; error 0 us; skew 500 ppm
I20260709 12:22:56.812140 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:56.814467 11916 webserver.cc:533] Webserver started at http://127.11.163.1:41703/ using document root <none> and password file <none>
I20260709 12:22:56.815022 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:56.815245 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:56.815563 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:56.816706 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-0-root/instance:
uuid: "222454fb0cb046ccb3f6d15aa35fd869"
format_stamp: "Formatted at 2026-07-09 12:22:56 on dist-test-slave-z9f9"
I20260709 12:22:56.821189 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:56.824548 21099 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:56.825352 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:22:56.825672 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-0-root
uuid: "222454fb0cb046ccb3f6d15aa35fd869"
format_stamp: "Formatted at 2026-07-09 12:22:56 on dist-test-slave-z9f9"
I20260709 12:22:56.825992 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:56.842741 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:56.844005 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:56.845474 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:56.847761 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:56.847975 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:56.848208 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:56.848398 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:56.888176 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.1:43827
I20260709 12:22:56.888280 21162 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.1:43827 every 8 connection(s)
I20260709 12:22:56.893874 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:56.901168 21167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:56.901988 21168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:56.904619 21170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:56.904882 11916 server_base.cc:1061] running on GCE node
I20260709 12:22:56.906018 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:56.906247 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:56.906428 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599776906412 us; error 0 us; skew 500 ppm
I20260709 12:22:56.906976 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:56.909349 21163 heartbeater.cc:344] Connected to a master server at 127.11.163.62:36937
I20260709 12:22:56.909708 21163 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:56.910008 11916 webserver.cc:533] Webserver started at http://127.11.163.2:44909/ using document root <none> and password file <none>
I20260709 12:22:56.910434 21163 heartbeater.cc:507] Master 127.11.163.62:36937 requested a full tablet report, sending...
I20260709 12:22:56.910573 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:56.910914 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:56.911192 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:56.912377 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-1-root/instance:
uuid: "106d5430f7134b50969e552dd855308d"
format_stamp: "Formatted at 2026-07-09 12:22:56 on dist-test-slave-z9f9"
I20260709 12:22:56.912703 21035 ts_manager.cc:194] Registered new tserver with Master: 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827)
I20260709 12:22:56.914414 21035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52752
I20260709 12:22:56.917502 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:22:56.921103 21175 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:56.921860 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:22:56.922184 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-1-root
uuid: "106d5430f7134b50969e552dd855308d"
format_stamp: "Formatted at 2026-07-09 12:22:56 on dist-test-slave-z9f9"
I20260709 12:22:56.922475 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:56.944032 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:56.945297 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:56.946801 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:56.949127 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:56.949349 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:56.949577 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:56.949744 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:56.989663 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.2:39363
I20260709 12:22:56.989786 21237 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.2:39363 every 8 connection(s)
I20260709 12:22:56.994652 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:57.001808 21241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:57.003835 21242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:57.009048 21238 heartbeater.cc:344] Connected to a master server at 127.11.163.62:36937
I20260709 12:22:57.009059 11916 server_base.cc:1061] running on GCE node
I20260709 12:22:57.009753 21238 heartbeater.cc:461] Registering TS with master...
W20260709 12:22:57.009873 21244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:57.010726 21238 heartbeater.cc:507] Master 127.11.163.62:36937 requested a full tablet report, sending...
I20260709 12:22:57.011205 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:57.011526 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:57.011756 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599777011737 us; error 0 us; skew 500 ppm
I20260709 12:22:57.012383 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:57.013099 21035 ts_manager.cc:194] Registered new tserver with Master: 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:57.015205 21035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52758
I20260709 12:22:57.015553 11916 webserver.cc:533] Webserver started at http://127.11.163.3:43611/ using document root <none> and password file <none>
I20260709 12:22:57.016253 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:57.016489 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:57.016819 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:57.018267 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-2-root/instance:
uuid: "8042cf42fb224a24aac0db5007ffb2e7"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-z9f9"
I20260709 12:22:57.022687 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:57.026109 21249 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.026968 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:57.027318 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-2-root
uuid: "8042cf42fb224a24aac0db5007ffb2e7"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-z9f9"
I20260709 12:22:57.027690 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:57.063625 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:57.064982 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:57.066612 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:57.069226 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:57.069474 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.069748 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:57.069937 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.112658 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.3:45513
I20260709 12:22:57.112762 21311 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.3:45513 every 8 connection(s)
I20260709 12:22:57.128319 21312 heartbeater.cc:344] Connected to a master server at 127.11.163.62:36937
I20260709 12:22:57.128767 21312 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:57.129601 21312 heartbeater.cc:507] Master 127.11.163.62:36937 requested a full tablet report, sending...
I20260709 12:22:57.132062 21035 ts_manager.cc:194] Registered new tserver with Master: 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:57.132489 11916 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016125375s
I20260709 12:22:57.133495 21035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52764
I20260709 12:22:57.162221 21035 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52772:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:57.165155 21035 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:57.265161 21128 tablet_service.cc:1511] Processing CreateTablet for tablet bfadb3ce5f1f45f0adb2dd7890737094 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:57.265671 21127 tablet_service.cc:1511] Processing CreateTablet for tablet 9c68c745025847329ecc9b974a3d49a1 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:57.266785 21128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfadb3ce5f1f45f0adb2dd7890737094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.267458 21127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c68c745025847329ecc9b974a3d49a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.268653 21202 tablet_service.cc:1511] Processing CreateTablet for tablet 9c68c745025847329ecc9b974a3d49a1 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:57.270190 21202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c68c745025847329ecc9b974a3d49a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.270803 21199 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa4ccaa51f6450283cdf3a3ce681842 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:57.272233 21199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa4ccaa51f6450283cdf3a3ce681842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.267323 21203 tablet_service.cc:1511] Processing CreateTablet for tablet bfadb3ce5f1f45f0adb2dd7890737094 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:57.276942 21203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfadb3ce5f1f45f0adb2dd7890737094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.276991 21126 tablet_service.cc:1511] Processing CreateTablet for tablet 48a238fdc89e4dcdb85b6a539480cf42 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:57.278352 21126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a238fdc89e4dcdb85b6a539480cf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.279873 21196 tablet_service.cc:1511] Processing CreateTablet for tablet 97632f21e76f4fea967399bdb6315eaf (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:57.280576 21201 tablet_service.cc:1511] Processing CreateTablet for tablet 48a238fdc89e4dcdb85b6a539480cf42 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:57.281279 21196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97632f21e76f4fea967399bdb6315eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.281921 21201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a238fdc89e4dcdb85b6a539480cf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.284451 21200 tablet_service.cc:1511] Processing CreateTablet for tablet 397fe6fe912a495bb0077b0f9f1281d4 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:57.285795 21200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397fe6fe912a495bb0077b0f9f1281d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.269048 21198 tablet_service.cc:1511] Processing CreateTablet for tablet 0ace82e19711478ca00a6a56c680068e (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:57.288970 21198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ace82e19711478ca00a6a56c680068e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.278043 21197 tablet_service.cc:1511] Processing CreateTablet for tablet e011141c23994d459c3cc61f3a996174 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:57.292315 21197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e011141c23994d459c3cc61f3a996174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.300119 21125 tablet_service.cc:1511] Processing CreateTablet for tablet 397fe6fe912a495bb0077b0f9f1281d4 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:57.304100 21125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397fe6fe912a495bb0077b0f9f1281d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.309386 21277 tablet_service.cc:1511] Processing CreateTablet for tablet bfadb3ce5f1f45f0adb2dd7890737094 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:57.311076 21277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfadb3ce5f1f45f0adb2dd7890737094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.309386 21124 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa4ccaa51f6450283cdf3a3ce681842 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:57.312816 21124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa4ccaa51f6450283cdf3a3ce681842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.315145 21122 tablet_service.cc:1511] Processing CreateTablet for tablet e011141c23994d459c3cc61f3a996174 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:57.316787 21276 tablet_service.cc:1511] Processing CreateTablet for tablet 9c68c745025847329ecc9b974a3d49a1 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:57.319278 21275 tablet_service.cc:1511] Processing CreateTablet for tablet 48a238fdc89e4dcdb85b6a539480cf42 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:57.321744 21274 tablet_service.cc:1511] Processing CreateTablet for tablet 397fe6fe912a495bb0077b0f9f1281d4 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:57.321945 21271 tablet_service.cc:1511] Processing CreateTablet for tablet e011141c23994d459c3cc61f3a996174 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:57.310593 21123 tablet_service.cc:1511] Processing CreateTablet for tablet 0ace82e19711478ca00a6a56c680068e (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:57.316843 21122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e011141c23994d459c3cc61f3a996174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.319278 21272 tablet_service.cc:1511] Processing CreateTablet for tablet 0ace82e19711478ca00a6a56c680068e (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:57.325551 21121 tablet_service.cc:1511] Processing CreateTablet for tablet 97632f21e76f4fea967399bdb6315eaf (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:57.335803 21272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ace82e19711478ca00a6a56c680068e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.326295 21273 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa4ccaa51f6450283cdf3a3ce681842 (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:57.333024 21269 tablet_service.cc:1511] Processing CreateTablet for tablet f9d9f3b4f37c40f79fa03d8356aa946e (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:57.327666 21270 tablet_service.cc:1511] Processing CreateTablet for tablet 97632f21e76f4fea967399bdb6315eaf (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:57.328037 21123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ace82e19711478ca00a6a56c680068e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.339656 21271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e011141c23994d459c3cc61f3a996174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.343118 21269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d9f3b4f37c40f79fa03d8356aa946e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.347800 21270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97632f21e76f4fea967399bdb6315eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.348374 21121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97632f21e76f4fea967399bdb6315eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.348989 21273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa4ccaa51f6450283cdf3a3ce681842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.352042 21275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a238fdc89e4dcdb85b6a539480cf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.355816 21276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c68c745025847329ecc9b974a3d49a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.356964 21274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397fe6fe912a495bb0077b0f9f1281d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.335023 21120 tablet_service.cc:1511] Processing CreateTablet for tablet 226c214fa28b43488c817dcc97e88ebc (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:57.361936 21327 tablet_bootstrap.cc:492] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:22:57.362339 21120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226c214fa28b43488c817dcc97e88ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.363850 21195 tablet_service.cc:1511] Processing CreateTablet for tablet 226c214fa28b43488c817dcc97e88ebc (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:57.365219 21195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226c214fa28b43488c817dcc97e88ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.365514 21268 tablet_service.cc:1511] Processing CreateTablet for tablet 226c214fa28b43488c817dcc97e88ebc (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:57.366837 21268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226c214fa28b43488c817dcc97e88ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.323998 21328 tablet_bootstrap.cc:492] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d: Bootstrap starting.
I20260709 12:22:57.334348 21203 tablet_service.cc:1511] Processing CreateTablet for tablet f9d9f3b4f37c40f79fa03d8356aa946e (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:57.369653 21203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d9f3b4f37c40f79fa03d8356aa946e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.335100 21125 tablet_service.cc:1511] Processing CreateTablet for tablet f9d9f3b4f37c40f79fa03d8356aa946e (DEFAULT_TABLE table=test-workload [id=f02682123900423880c2b4d1a3531668]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:57.397727 21125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d9f3b4f37c40f79fa03d8356aa946e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.408180 21328 tablet_bootstrap.cc:654] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.434567 21327 tablet_bootstrap.cc:654] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.462489 21329 tablet_bootstrap.cc:492] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7: Bootstrap starting.
I20260709 12:22:57.470515 21328 tablet_bootstrap.cc:492] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d: No bootstrap required, opened a new log
I20260709 12:22:57.471055 21328 ts_tablet_manager.cc:1403] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d: Time spent bootstrapping tablet: real 0.168s	user 0.009s	sys 0.003s
I20260709 12:22:57.473189 21327 tablet_bootstrap.cc:492] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869: No bootstrap required, opened a new log
I20260709 12:22:57.473737 21328 raft_consensus.cc:359] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:22:57.474617 21328 raft_consensus.cc:385] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.473762 21327 ts_tablet_manager.cc:1403] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.112s	user 0.005s	sys 0.012s
I20260709 12:22:57.475018 21328 raft_consensus.cc:740] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.475973 21328 consensus_queue.cc:260] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:22:57.477031 21329 tablet_bootstrap.cc:654] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.478255 21238 heartbeater.cc:499] Master 127.11.163.62:36937 was elected leader, sending a full tablet report...
I20260709 12:22:57.478729 21328 ts_tablet_manager.cc:1434] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:57.479271 21327 raft_consensus.cc:359] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:22:57.480245 21327 raft_consensus.cc:385] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.482191 21328 tablet_bootstrap.cc:492] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d: Bootstrap starting.
I20260709 12:22:57.480705 21327 raft_consensus.cc:740] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.485253 21327 consensus_queue.cc:260] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:22:57.489192 21328 tablet_bootstrap.cc:654] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.495522 21327 ts_tablet_manager.cc:1434] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.002s
I20260709 12:22:57.496268 21163 heartbeater.cc:499] Master 127.11.163.62:36937 was elected leader, sending a full tablet report...
I20260709 12:22:57.496814 21327 tablet_bootstrap.cc:492] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:22:57.498149 21329 tablet_bootstrap.cc:492] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7: No bootstrap required, opened a new log
I20260709 12:22:57.498694 21329 ts_tablet_manager.cc:1403] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.007s
I20260709 12:22:57.502156 21329 raft_consensus.cc:359] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:22:57.502941 21329 raft_consensus.cc:385] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.503255 21329 raft_consensus.cc:740] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.503916 21327 tablet_bootstrap.cc:654] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.504227 21329 consensus_queue.cc:260] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:22:57.514541 21328 tablet_bootstrap.cc:492] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d: No bootstrap required, opened a new log
I20260709 12:22:57.514739 21327 tablet_bootstrap.cc:492] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869: No bootstrap required, opened a new log
I20260709 12:22:57.515318 21328 ts_tablet_manager.cc:1403] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.004s
I20260709 12:22:57.515591 21327 ts_tablet_manager.cc:1403] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.001s
I20260709 12:22:57.520351 21328 raft_consensus.cc:359] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.521335 21327 raft_consensus.cc:359] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.521582 21328 raft_consensus.cc:385] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.522765 21327 raft_consensus.cc:385] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.523141 21328 raft_consensus.cc:740] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.523355 21327 raft_consensus.cc:740] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.523481 21329 ts_tablet_manager.cc:1434] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent starting tablet: real 0.024s	user 0.015s	sys 0.001s
I20260709 12:22:57.524204 21328 consensus_queue.cc:260] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.524535 21327 consensus_queue.cc:260] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.525636 21312 heartbeater.cc:499] Master 127.11.163.62:36937 was elected leader, sending a full tablet report...
I20260709 12:22:57.526325 21329 tablet_bootstrap.cc:492] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7: Bootstrap starting.
I20260709 12:22:57.527514 21327 ts_tablet_manager.cc:1434] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 12:22:57.528548 21327 tablet_bootstrap.cc:492] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:22:57.533546 21329 tablet_bootstrap.cc:654] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.535386 21327 tablet_bootstrap.cc:654] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.535509 21328 ts_tablet_manager.cc:1434] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:22:57.539669 21328 tablet_bootstrap.cc:492] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d: Bootstrap starting.
I20260709 12:22:57.546270 21328 tablet_bootstrap.cc:654] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.546403 21329 tablet_bootstrap.cc:492] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7: No bootstrap required, opened a new log
I20260709 12:22:57.547523 21329 ts_tablet_manager.cc:1403] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 12:22:57.556692 21332 raft_consensus.cc:493] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.557442 21332 raft_consensus.cc:515] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:22:57.560580 21328 tablet_bootstrap.cc:492] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d: No bootstrap required, opened a new log
I20260709 12:22:57.561211 21328 ts_tablet_manager.cc:1403] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 12:22:57.563592 21332 leader_election.cc:290] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513), 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827)
I20260709 12:22:57.564531 21328 raft_consensus.cc:359] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.565330 21328 raft_consensus.cc:385] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.565659 21328 raft_consensus.cc:740] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.566412 21328 consensus_queue.cc:260] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.568634 21328 ts_tablet_manager.cc:1434] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:57.555701 21329 raft_consensus.cc:359] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.574913 21329 raft_consensus.cc:385] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.575244 21329 raft_consensus.cc:740] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.575536 21327 tablet_bootstrap.cc:492] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869: No bootstrap required, opened a new log
I20260709 12:22:57.576048 21329 consensus_queue.cc:260] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.578755 21329 ts_tablet_manager.cc:1434] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:22:57.579896 21329 tablet_bootstrap.cc:492] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7: Bootstrap starting.
I20260709 12:22:57.576169 21327 ts_tablet_manager.cc:1403] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.048s	user 0.041s	sys 0.004s
I20260709 12:22:57.584482 21327 raft_consensus.cc:359] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.585233 21327 raft_consensus.cc:385] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.585549 21327 raft_consensus.cc:740] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.586325 21329 tablet_bootstrap.cc:654] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.588240 21328 tablet_bootstrap.cc:492] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d: Bootstrap starting.
I20260709 12:22:57.590126 21327 consensus_queue.cc:260] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.592953 21327 ts_tablet_manager.cc:1434] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:22:57.594071 21327 tablet_bootstrap.cc:492] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:22:57.591213 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfadb3ce5f1f45f0adb2dd7890737094" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7" is_pre_election: true
I20260709 12:22:57.594709 21287 raft_consensus.cc:2468] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 0.
I20260709 12:22:57.594962 21328 tablet_bootstrap.cc:654] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.597713 21138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfadb3ce5f1f45f0adb2dd7890737094" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869" is_pre_election: true
I20260709 12:22:57.598492 21138 raft_consensus.cc:2468] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 0.
I20260709 12:22:57.600193 21327 tablet_bootstrap.cc:654] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.602787 21329 tablet_bootstrap.cc:492] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7: No bootstrap required, opened a new log
I20260709 12:22:57.603379 21329 ts_tablet_manager.cc:1403] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent bootstrapping tablet: real 0.024s	user 0.003s	sys 0.007s
I20260709 12:22:57.607410 21329 raft_consensus.cc:359] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.608407 21329 raft_consensus.cc:385] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.608767 21329 raft_consensus.cc:740] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.609786 21329 consensus_queue.cc:260] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.610441 21177 leader_election.cc:304] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:57.611692 21332 raft_consensus.cc:2804] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:57.612067 21332 raft_consensus.cc:493] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.612397 21332 raft_consensus.cc:3060] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.612932 21329 ts_tablet_manager.cc:1434] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:22:57.614408 21329 tablet_bootstrap.cc:492] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7: Bootstrap starting.
W20260709 12:22:57.617283 21313 tablet.cc:2406] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:57.621289 21332 raft_consensus.cc:515] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:22:57.622776 21329 tablet_bootstrap.cc:654] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.625434 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfadb3ce5f1f45f0adb2dd7890737094" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:22:57.626237 21287 raft_consensus.cc:3060] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.636675 21329 tablet_bootstrap.cc:492] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7: No bootstrap required, opened a new log
I20260709 12:22:57.637526 21329 ts_tablet_manager.cc:1403] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 12:22:57.641729 21329 raft_consensus.cc:359] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.642767 21329 raft_consensus.cc:385] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.643157 21329 raft_consensus.cc:740] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.644443 21329 consensus_queue.cc:260] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.645001 21138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfadb3ce5f1f45f0adb2dd7890737094" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:22:57.645901 21138 raft_consensus.cc:3060] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.643363 21332 leader_election.cc:290] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 election: Requested vote from peers 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513), 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827)
I20260709 12:22:57.655694 21329 ts_tablet_manager.cc:1434] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 12:22:57.661032 21287 raft_consensus.cc:2468] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 1.
I20260709 12:22:57.657817 21138 raft_consensus.cc:2468] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 1.
I20260709 12:22:57.662438 21328 tablet_bootstrap.cc:492] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d: No bootstrap required, opened a new log
I20260709 12:22:57.663081 21328 ts_tablet_manager.cc:1403] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d: Time spent bootstrapping tablet: real 0.075s	user 0.025s	sys 0.030s
I20260709 12:22:57.662914 21177 leader_election.cc:304] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 222454fb0cb046ccb3f6d15aa35fd869; no voters: 
I20260709 12:22:57.664529 21332 raft_consensus.cc:2804] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:57.666644 21328 raft_consensus.cc:359] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.667656 21328 raft_consensus.cc:385] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.668094 21328 raft_consensus.cc:740] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.668628 21337 raft_consensus.cc:493] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.669087 21328 consensus_queue.cc:260] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.669335 21337 raft_consensus.cc:515] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.674324 21337 leader_election.cc:290] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:57.679675 21329 tablet_bootstrap.cc:492] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7: Bootstrap starting.
I20260709 12:22:57.681583 21348 raft_consensus.cc:493] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.682296 21348 raft_consensus.cc:515] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.683327 21327 tablet_bootstrap.cc:492] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869: No bootstrap required, opened a new log
I20260709 12:22:57.684029 21327 ts_tablet_manager.cc:1403] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.090s	user 0.029s	sys 0.046s
I20260709 12:22:57.686187 21138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e011141c23994d459c3cc61f3a996174" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869" is_pre_election: true
I20260709 12:22:57.687793 21332 raft_consensus.cc:697] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Becoming Leader. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:22:57.689724 21332 consensus_queue.cc:237] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:22:57.692751 21329 tablet_bootstrap.cc:654] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:57.697172 21177 leader_election.cc:343] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:57.696184 21327 raft_consensus.cc:359] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.698233 21327 raft_consensus.cc:385] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.698570 21327 raft_consensus.cc:740] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.699361 21327 consensus_queue.cc:260] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.702225 21327 ts_tablet_manager.cc:1434] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 12:22:57.703029 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e011141c23994d459c3cc61f3a996174" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7" is_pre_election: true
I20260709 12:22:57.703253 21327 tablet_bootstrap.cc:492] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:22:57.703754 21287 raft_consensus.cc:2468] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 0.
I20260709 12:22:57.705602 21177 leader_election.cc:304] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 222454fb0cb046ccb3f6d15aa35fd869
I20260709 12:22:57.706955 21347 raft_consensus.cc:2804] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:57.707454 21347 raft_consensus.cc:493] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.707873 21347 raft_consensus.cc:3060] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.715814 21348 leader_election.cc:290] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:57.727068 21138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a238fdc89e4dcdb85b6a539480cf42" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869" is_pre_election: true
I20260709 12:22:57.727586 21347 raft_consensus.cc:515] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
W20260709 12:22:57.728780 21251 leader_election.cc:343] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:57.729079 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:57.730852 21138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e011141c23994d459c3cc61f3a996174" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:22:57.731521 21138 raft_consensus.cc:3060] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.734639 21328 ts_tablet_manager.cc:1434] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d: Time spent starting tablet: real 0.071s	user 0.020s	sys 0.033s
I20260709 12:22:57.735401 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e011141c23994d459c3cc61f3a996174" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:22:57.735848 21328 tablet_bootstrap.cc:492] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d: Bootstrap starting.
I20260709 12:22:57.736116 21287 raft_consensus.cc:3060] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.740514 21035 catalog_manager.cc:5697] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d reported cstate change: term changed from 0 to 1, leader changed from <none> to 106d5430f7134b50969e552dd855308d (127.11.163.2). New cstate: current_term: 1 leader_uuid: "106d5430f7134b50969e552dd855308d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.741968 21329 tablet_bootstrap.cc:492] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7: No bootstrap required, opened a new log
I20260709 12:22:57.745103 21349 raft_consensus.cc:493] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.745636 21329 ts_tablet_manager.cc:1403] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.019s
I20260709 12:22:57.745749 21347 leader_election.cc:290] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:57.744402 21287 raft_consensus.cc:2468] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 1.
I20260709 12:22:57.747238 21177 leader_election.cc:304] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:57.747774 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a238fdc89e4dcdb85b6a539480cf42" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d" is_pre_election: true
I20260709 12:22:57.745652 21349 raft_consensus.cc:515] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
W20260709 12:22:57.749419 21250 leader_election.cc:343] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 106d5430f7134b50969e552dd855308d (127.11.163.2:39363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:57.749338 21329 raft_consensus.cc:359] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.750023 21250 leader_election.cc:304] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8042cf42fb224a24aac0db5007ffb2e7; no voters: 106d5430f7134b50969e552dd855308d, 222454fb0cb046ccb3f6d15aa35fd869
I20260709 12:22:57.750353 21329 raft_consensus.cc:385] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.750829 21329 raft_consensus.cc:740] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.750988 21137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ace82e19711478ca00a6a56c680068e" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869" is_pre_election: true
I20260709 12:22:57.751174 21327 tablet_bootstrap.cc:654] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.742666 21328 tablet_bootstrap.cc:654] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.751253 21337 raft_consensus.cc:2749] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:57.752115 21329 consensus_queue.cc:260] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
W20260709 12:22:57.752648 21177 leader_election.cc:343] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:57.754673 21329 ts_tablet_manager.cc:1434] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:22:57.755692 21347 raft_consensus.cc:2804] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:57.756466 21347 raft_consensus.cc:697] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Becoming Leader. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:22:57.757476 21328 tablet_bootstrap.cc:492] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d: No bootstrap required, opened a new log
I20260709 12:22:57.758101 21328 ts_tablet_manager.cc:1403] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.002s
I20260709 12:22:57.757792 21347 consensus_queue.cc:237] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.761288 21328 raft_consensus.cc:359] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.762087 21328 raft_consensus.cc:385] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.762432 21328 raft_consensus.cc:740] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.763046 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ace82e19711478ca00a6a56c680068e" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7" is_pre_election: true
I20260709 12:22:57.763285 21328 consensus_queue.cc:260] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
W20260709 12:22:57.764791 21177 leader_election.cc:343] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:57.765311 21177 leader_election.cc:304] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 106d5430f7134b50969e552dd855308d; no voters: 222454fb0cb046ccb3f6d15aa35fd869, 8042cf42fb224a24aac0db5007ffb2e7
I20260709 12:22:57.766062 21328 ts_tablet_manager.cc:1434] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:57.766152 21332 raft_consensus.cc:2749] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:57.767196 21349 leader_election.cc:290] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:57.767419 21328 tablet_bootstrap.cc:492] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d: Bootstrap starting.
I20260709 12:22:57.744611 21138 raft_consensus.cc:2468] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 1.
I20260709 12:22:57.771162 21329 tablet_bootstrap.cc:492] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7: Bootstrap starting.
I20260709 12:22:57.775789 21328 tablet_bootstrap.cc:654] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.780723 21329 tablet_bootstrap.cc:654] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.783097 21327 tablet_bootstrap.cc:492] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: No bootstrap required, opened a new log
I20260709 12:22:57.783855 21327 ts_tablet_manager.cc:1403] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.081s	user 0.026s	sys 0.001s
I20260709 12:22:57.787241 21328 tablet_bootstrap.cc:492] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d: No bootstrap required, opened a new log
I20260709 12:22:57.786918 21327 raft_consensus.cc:359] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.787797 21327 raft_consensus.cc:385] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.787976 21328 ts_tablet_manager.cc:1403] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:22:57.788149 21327 raft_consensus.cc:740] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.789222 21327 consensus_queue.cc:260] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.790210 21329 tablet_bootstrap.cc:492] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7: No bootstrap required, opened a new log
I20260709 12:22:57.790766 21329 ts_tablet_manager.cc:1403] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 12:22:57.791662 21328 raft_consensus.cc:359] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.792493 21328 raft_consensus.cc:385] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.792863 21328 raft_consensus.cc:740] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.793797 21329 raft_consensus.cc:359] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.794355 21327 ts_tablet_manager.cc:1434] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:22:57.793833 21328 consensus_queue.cc:260] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.794947 21329 raft_consensus.cc:385] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.795303 21329 raft_consensus.cc:740] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.795837 21327 tablet_bootstrap.cc:492] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:22:57.796121 21329 consensus_queue.cc:260] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.796787 21328 ts_tablet_manager.cc:1434] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:57.798326 21328 tablet_bootstrap.cc:492] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d: Bootstrap starting.
I20260709 12:22:57.798543 21329 ts_tablet_manager.cc:1434] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:57.799662 21329 tablet_bootstrap.cc:492] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7: Bootstrap starting.
I20260709 12:22:57.801913 21347 raft_consensus.cc:493] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.802510 21347 raft_consensus.cc:515] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.804728 21347 leader_election.cc:290] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:57.805545 21328 tablet_bootstrap.cc:654] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.805975 21329 tablet_bootstrap.cc:654] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.806493 21327 tablet_bootstrap.cc:654] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.807171 21138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869" is_pre_election: true
I20260709 12:22:57.807891 21138 raft_consensus.cc:2468] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 0.
I20260709 12:22:57.808971 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7" is_pre_election: true
I20260709 12:22:57.809842 21287 raft_consensus.cc:2468] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 0.
I20260709 12:22:57.812443 21177 leader_election.cc:304] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 222454fb0cb046ccb3f6d15aa35fd869; no voters: 
I20260709 12:22:57.813556 21347 raft_consensus.cc:2804] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:57.814057 21347 raft_consensus.cc:493] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.814508 21347 raft_consensus.cc:3060] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.819154 21329 tablet_bootstrap.cc:492] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7: No bootstrap required, opened a new log
I20260709 12:22:57.821048 21328 tablet_bootstrap.cc:492] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d: No bootstrap required, opened a new log
I20260709 12:22:57.821810 21328 ts_tablet_manager.cc:1403] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 12:22:57.822602 21347 raft_consensus.cc:515] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.822177 21035 catalog_manager.cc:5697] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d reported cstate change: term changed from 0 to 1, leader changed from <none> to 106d5430f7134b50969e552dd855308d (127.11.163.2). New cstate: current_term: 1 leader_uuid: "106d5430f7134b50969e552dd855308d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.825183 21328 raft_consensus.cc:359] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.825788 21138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:22:57.826025 21328 raft_consensus.cc:385] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.823199 21329 ts_tablet_manager.cc:1403] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 12:22:57.826464 21138 raft_consensus.cc:3060] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.826426 21328 raft_consensus.cc:740] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.827771 21328 consensus_queue.cc:260] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.828549 21327 tablet_bootstrap.cc:492] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869: No bootstrap required, opened a new log
I20260709 12:22:57.829156 21327 ts_tablet_manager.cc:1403] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.008s
I20260709 12:22:57.830273 21328 ts_tablet_manager.cc:1434] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:57.831370 21328 tablet_bootstrap.cc:492] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d: Bootstrap starting.
I20260709 12:22:57.832168 21327 raft_consensus.cc:359] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.832911 21327 raft_consensus.cc:385] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.833211 21327 raft_consensus.cc:740] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.834163 21327 consensus_queue.cc:260] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.835047 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:22:57.835736 21287 raft_consensus.cc:3060] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.837028 21349 raft_consensus.cc:493] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.837543 21349 raft_consensus.cc:515] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.838891 21327 ts_tablet_manager.cc:1434] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:57.839022 21328 tablet_bootstrap.cc:654] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.839648 21349 leader_election.cc:290] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:57.840121 21329 raft_consensus.cc:359] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.841153 21329 raft_consensus.cc:385] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.841485 21329 raft_consensus.cc:740] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.842314 21329 consensus_queue.cc:260] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.844274 21286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97632f21e76f4fea967399bdb6315eaf" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7" is_pre_election: true
I20260709 12:22:57.845053 21329 ts_tablet_manager.cc:1434] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 12:22:57.846135 21329 tablet_bootstrap.cc:492] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7: Bootstrap starting.
I20260709 12:22:57.846424 21137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97632f21e76f4fea967399bdb6315eaf" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869" is_pre_election: true
I20260709 12:22:57.852710 21329 tablet_bootstrap.cc:654] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:57.856607 21177 leader_election.cc:343] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:57.857754 21177 leader_election.cc:343] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:57.858296 21177 leader_election.cc:304] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 106d5430f7134b50969e552dd855308d; no voters: 222454fb0cb046ccb3f6d15aa35fd869, 8042cf42fb224a24aac0db5007ffb2e7
I20260709 12:22:57.859314 21349 raft_consensus.cc:2749] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:57.862155 21327 tablet_bootstrap.cc:492] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:22:57.863569 21347 leader_election.cc:290] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:57.867301 21287 raft_consensus.cc:2468] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 1.
I20260709 12:22:57.869130 21177 leader_election.cc:304] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:57.870122 21347 raft_consensus.cc:2804] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:57.870697 21327 tablet_bootstrap.cc:654] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.871935 21329 tablet_bootstrap.cc:492] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7: No bootstrap required, opened a new log
I20260709 12:22:57.871387 21347 raft_consensus.cc:697] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Becoming Leader. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:22:57.872555 21329 ts_tablet_manager.cc:1403] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 12:22:57.873049 21347 consensus_queue.cc:237] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.871870 21138 raft_consensus.cc:2468] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 1.
I20260709 12:22:57.875770 21329 raft_consensus.cc:359] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.876436 21328 tablet_bootstrap.cc:492] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d: No bootstrap required, opened a new log
I20260709 12:22:57.876745 21329 raft_consensus.cc:385] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.877151 21328 ts_tablet_manager.cc:1403] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.020s
I20260709 12:22:57.877177 21329 raft_consensus.cc:740] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.878361 21329 consensus_queue.cc:260] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.880530 21328 raft_consensus.cc:359] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.881264 21328 raft_consensus.cc:385] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.881609 21328 raft_consensus.cc:740] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.881685 21327 tablet_bootstrap.cc:492] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869: No bootstrap required, opened a new log
I20260709 12:22:57.882297 21327 ts_tablet_manager.cc:1403] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.003s
I20260709 12:22:57.882601 21328 consensus_queue.cc:260] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.885026 21328 ts_tablet_manager.cc:1434] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:57.885377 21327 raft_consensus.cc:359] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.886053 21328 tablet_bootstrap.cc:492] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d: Bootstrap starting.
I20260709 12:22:57.886178 21327 raft_consensus.cc:385] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.886721 21327 raft_consensus.cc:740] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.887403 21329 ts_tablet_manager.cc:1434] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:22:57.886587 21035 catalog_manager.cc:5697] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d reported cstate change: term changed from 0 to 1, leader changed from <none> to 106d5430f7134b50969e552dd855308d (127.11.163.2). New cstate: current_term: 1 leader_uuid: "106d5430f7134b50969e552dd855308d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.888484 21329 tablet_bootstrap.cc:492] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7: Bootstrap starting.
I20260709 12:22:57.889585 21327 consensus_queue.cc:260] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.891986 21327 ts_tablet_manager.cc:1434] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:22:57.892967 21327 tablet_bootstrap.cc:492] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:22:57.893221 21328 tablet_bootstrap.cc:654] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.894513 21347 raft_consensus.cc:493] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.895038 21347 raft_consensus.cc:515] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.898589 21138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a238fdc89e4dcdb85b6a539480cf42" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869" is_pre_election: true
I20260709 12:22:57.899461 21138 raft_consensus.cc:2468] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 0.
I20260709 12:22:57.900976 21177 leader_election.cc:304] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 222454fb0cb046ccb3f6d15aa35fd869; no voters: 
I20260709 12:22:57.901983 21349 raft_consensus.cc:2804] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:57.902339 21349 raft_consensus.cc:493] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.902695 21349 raft_consensus.cc:3060] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.903451 21327 tablet_bootstrap.cc:654] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.910624 21337 raft_consensus.cc:493] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.910454 21349 raft_consensus.cc:515] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.911188 21337 raft_consensus.cc:515] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.911810 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a238fdc89e4dcdb85b6a539480cf42" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7" is_pre_election: true
I20260709 12:22:57.912495 21287 raft_consensus.cc:2468] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 0.
I20260709 12:22:57.913419 21337 leader_election.cc:290] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:57.914036 21349 leader_election.cc:290] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:57.915812 21286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a238fdc89e4dcdb85b6a539480cf42" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:22:57.916450 21286 raft_consensus.cc:3060] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.917214 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d" is_pre_election: true
I20260709 12:22:57.918082 21213 raft_consensus.cc:2468] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 0.
I20260709 12:22:57.918390 21328 tablet_bootstrap.cc:492] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d: No bootstrap required, opened a new log
I20260709 12:22:57.919054 21328 ts_tablet_manager.cc:1403] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.002s
I20260709 12:22:57.919767 21250 leader_election.cc:304] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:57.921589 21337 raft_consensus.cc:2804] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:57.921950 21337 raft_consensus.cc:493] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.916383 21137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869" is_pre_election: true
I20260709 12:22:57.922297 21337 raft_consensus.cc:3060] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.922789 21137 raft_consensus.cc:2468] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 0.
I20260709 12:22:57.923010 21327 tablet_bootstrap.cc:492] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869: No bootstrap required, opened a new log
I20260709 12:22:57.923533 21327 ts_tablet_manager.cc:1403] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.005s
I20260709 12:22:57.913959 21138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a238fdc89e4dcdb85b6a539480cf42" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:22:57.924232 21138 raft_consensus.cc:3060] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.926540 21327 raft_consensus.cc:359] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.927220 21327 raft_consensus.cc:385] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.927585 21327 raft_consensus.cc:740] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.922199 21328 raft_consensus.cc:359] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.928520 21329 tablet_bootstrap.cc:654] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.929131 21328 raft_consensus.cc:385] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.928369 21327 consensus_queue.cc:260] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.929428 21328 raft_consensus.cc:740] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.930145 21328 consensus_queue.cc:260] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.931152 21327 ts_tablet_manager.cc:1434] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:22:57.932097 21328 ts_tablet_manager.cc:1434] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:22:57.931859 21337 raft_consensus.cc:515] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.933120 21328 tablet_bootstrap.cc:492] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d: Bootstrap starting.
I20260709 12:22:57.932142 21327 tablet_bootstrap.cc:492] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:22:57.934989 21137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:22:57.935627 21137 raft_consensus.cc:3060] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.939851 21328 tablet_bootstrap.cc:654] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.940078 21327 tablet_bootstrap.cc:654] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.943938 21137 raft_consensus.cc:2468] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 1.
I20260709 12:22:57.946087 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:22:57.946794 21213 raft_consensus.cc:3060] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.953471 21286 raft_consensus.cc:2468] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 1.
I20260709 12:22:57.954517 21213 raft_consensus.cc:2468] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 1.
I20260709 12:22:57.954845 21177 leader_election.cc:304] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:57.955750 21347 leader_election.cc:290] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:57.956178 21349 raft_consensus.cc:2804] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:57.956681 21349 raft_consensus.cc:697] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Becoming Leader. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:22:57.957527 21349 consensus_queue.cc:237] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.959673 21138 raft_consensus.cc:2468] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 1.
I20260709 12:22:57.955940 21250 leader_election.cc:304] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:57.962277 21374 raft_consensus.cc:2804] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:57.964147 21337 leader_election.cc:290] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:57.971788 21337 raft_consensus.cc:493] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.972131 21327 tablet_bootstrap.cc:492] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: No bootstrap required, opened a new log
I20260709 12:22:57.972776 21327 ts_tablet_manager.cc:1403] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.003s
I20260709 12:22:57.972437 21337 raft_consensus.cc:515] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.975016 21032 catalog_manager.cc:5697] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d reported cstate change: term changed from 0 to 1, leader changed from <none> to 106d5430f7134b50969e552dd855308d (127.11.163.2). New cstate: current_term: 1 leader_uuid: "106d5430f7134b50969e552dd855308d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.975831 21327 raft_consensus.cc:359] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.976598 21327 raft_consensus.cc:385] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.976895 21327 raft_consensus.cc:740] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.977584 21327 consensus_queue.cc:260] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.979301 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c214fa28b43488c817dcc97e88ebc" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d" is_pre_election: true
I20260709 12:22:57.979159 21137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c214fa28b43488c817dcc97e88ebc" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869" is_pre_election: true
I20260709 12:22:57.980235 21213 raft_consensus.cc:2468] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 0.
I20260709 12:22:57.980690 21137 raft_consensus.cc:2468] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 0.
I20260709 12:22:57.982190 21250 leader_election.cc:304] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:57.982594 21327 ts_tablet_manager.cc:1434] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:22:57.983598 21337 leader_election.cc:290] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:57.983810 21327 tablet_bootstrap.cc:492] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:22:57.984725 21337 raft_consensus.cc:2804] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:57.985240 21337 raft_consensus.cc:493] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.987900 21337 raft_consensus.cc:3060] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.990881 21327 tablet_bootstrap.cc:654] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.982194 21334 raft_consensus.cc:493] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.991520 21334 raft_consensus.cc:515] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:57.994306 21334 leader_election.cc:290] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 106d5430f7134b50969e552dd855308d (127.11.163.2:39363), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:57.995709 21328 tablet_bootstrap.cc:492] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d: No bootstrap required, opened a new log
I20260709 12:22:57.996454 21328 ts_tablet_manager.cc:1403] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d: Time spent bootstrapping tablet: real 0.064s	user 0.021s	sys 0.015s
I20260709 12:22:58.000293 21328 raft_consensus.cc:359] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.001207 21328 raft_consensus.cc:385] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.001564 21328 raft_consensus.cc:740] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.002591 21328 consensus_queue.cc:260] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.004702 21328 ts_tablet_manager.cc:1434] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:22:58.013729 21337 raft_consensus.cc:515] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.019695 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c214fa28b43488c817dcc97e88ebc" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:22:58.020385 21213 raft_consensus.cc:3060] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.021184 21337 leader_election.cc:290] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:58.033315 21213 raft_consensus.cc:2468] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 1.
I20260709 12:22:58.033867 21334 raft_consensus.cc:493] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.034404 21334 raft_consensus.cc:515] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.023579 21374 raft_consensus.cc:697] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:22:58.034770 21250 leader_election.cc:304] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:58.038193 21374 consensus_queue.cc:237] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.038825 21376 raft_consensus.cc:2804] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.039772 21329 tablet_bootstrap.cc:492] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7: No bootstrap required, opened a new log
I20260709 12:22:58.040117 21334 leader_election.cc:290] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 106d5430f7134b50969e552dd855308d (127.11.163.2:39363), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:58.040159 21137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c214fa28b43488c817dcc97e88ebc" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:22:58.040325 21329 ts_tablet_manager.cc:1403] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent bootstrapping tablet: real 0.152s	user 0.025s	sys 0.041s
I20260709 12:22:58.041769 21137 raft_consensus.cc:3060] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.044682 21329 raft_consensus.cc:359] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.045238 21329 raft_consensus.cc:385] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.045450 21329 raft_consensus.cc:740] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.045975 21329 consensus_queue.cc:260] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.047408 21329 ts_tablet_manager.cc:1434] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:22:58.048365 21329 tablet_bootstrap.cc:492] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7: Bootstrap starting.
I20260709 12:22:58.039773 21376 raft_consensus.cc:697] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:22:58.054464 21376 consensus_queue.cc:237] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.056070 21327 tablet_bootstrap.cc:492] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869: No bootstrap required, opened a new log
I20260709 12:22:58.056648 21327 ts_tablet_manager.cc:1403] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.016s
I20260709 12:22:58.059330 21327 raft_consensus.cc:359] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.060173 21327 raft_consensus.cc:385] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.060451 21327 raft_consensus.cc:740] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.061712 21327 consensus_queue.cc:260] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.062040 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9f3b4f37c40f79fa03d8356aa946e" candidate_uuid: "222454fb0cb046ccb3f6d15aa35fd869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7" is_pre_election: true
I20260709 12:22:58.062841 21287 raft_consensus.cc:2468] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 222454fb0cb046ccb3f6d15aa35fd869 in term 0.
I20260709 12:22:58.063738 21327 ts_tablet_manager.cc:1434] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:58.065276 21101 leader_election.cc:304] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 222454fb0cb046ccb3f6d15aa35fd869, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:58.065779 21286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c68c745025847329ecc9b974a3d49a1" candidate_uuid: "222454fb0cb046ccb3f6d15aa35fd869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7" is_pre_election: true
I20260709 12:22:58.066197 21334 raft_consensus.cc:2804] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.066473 21286 raft_consensus.cc:2468] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 222454fb0cb046ccb3f6d15aa35fd869 in term 0.
I20260709 12:22:58.066632 21334 raft_consensus.cc:493] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.067067 21334 raft_consensus.cc:3060] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.067684 21101 leader_election.cc:304] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 222454fb0cb046ccb3f6d15aa35fd869, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:58.072481 21329 tablet_bootstrap.cc:654] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.072314 21032 catalog_manager.cc:5697] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:58.069104 21137 raft_consensus.cc:2468] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 1.
I20260709 12:22:58.079407 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c68c745025847329ecc9b974a3d49a1" candidate_uuid: "222454fb0cb046ccb3f6d15aa35fd869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d" is_pre_election: true
I20260709 12:22:58.079732 21382 raft_consensus.cc:2804] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.080217 21213 raft_consensus.cc:2468] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 222454fb0cb046ccb3f6d15aa35fd869 in term 0.
I20260709 12:22:58.080271 21382 raft_consensus.cc:493] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.080811 21382 raft_consensus.cc:3060] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.079668 21212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9f3b4f37c40f79fa03d8356aa946e" candidate_uuid: "222454fb0cb046ccb3f6d15aa35fd869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d" is_pre_election: true
I20260709 12:22:58.082357 21212 raft_consensus.cc:2468] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 222454fb0cb046ccb3f6d15aa35fd869 in term 0.
I20260709 12:22:58.086061 21334 raft_consensus.cc:515] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.088326 21334 leader_election.cc:290] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [CANDIDATE]: Term 1 election: Requested vote from peers 106d5430f7134b50969e552dd855308d (127.11.163.2:39363), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:58.088469 21382 raft_consensus.cc:515] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.090735 21212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9f3b4f37c40f79fa03d8356aa946e" candidate_uuid: "222454fb0cb046ccb3f6d15aa35fd869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:22:58.091363 21212 raft_consensus.cc:3060] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.092957 21382 leader_election.cc:290] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [CANDIDATE]: Term 1 election: Requested vote from peers 106d5430f7134b50969e552dd855308d (127.11.163.2:39363), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:58.093014 21347 consensus_queue.cc:1048] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:58.096441 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c68c745025847329ecc9b974a3d49a1" candidate_uuid: "222454fb0cb046ccb3f6d15aa35fd869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:22:58.097908 21213 raft_consensus.cc:3060] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.107611 21212 raft_consensus.cc:2468] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 222454fb0cb046ccb3f6d15aa35fd869 in term 1.
I20260709 12:22:58.109436 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9f3b4f37c40f79fa03d8356aa946e" candidate_uuid: "222454fb0cb046ccb3f6d15aa35fd869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:22:58.110332 21287 raft_consensus.cc:3060] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.112386 21285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c68c745025847329ecc9b974a3d49a1" candidate_uuid: "222454fb0cb046ccb3f6d15aa35fd869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:22:58.113273 21285 raft_consensus.cc:3060] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.115686 21100 leader_election.cc:304] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 222454fb0cb046ccb3f6d15aa35fd869; no voters: 
I20260709 12:22:58.116856 21382 raft_consensus.cc:2804] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.117333 21382 raft_consensus.cc:697] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 LEADER]: Becoming Leader. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Running, Role: LEADER
I20260709 12:22:58.118171 21382 consensus_queue.cc:237] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.119701 21347 consensus_queue.cc:1048] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:58.127552 21285 raft_consensus.cc:2468] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 222454fb0cb046ccb3f6d15aa35fd869 in term 1.
I20260709 12:22:58.129547 21101 leader_election.cc:304] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 222454fb0cb046ccb3f6d15aa35fd869, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:58.130767 21334 raft_consensus.cc:2804] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.130115 21034 catalog_manager.cc:5697] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:58.136161 21287 raft_consensus.cc:2468] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 222454fb0cb046ccb3f6d15aa35fd869 in term 1.
I20260709 12:22:58.145021 21213 raft_consensus.cc:2468] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 222454fb0cb046ccb3f6d15aa35fd869 in term 1.
I20260709 12:22:58.159999 21329 tablet_bootstrap.cc:492] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7: No bootstrap required, opened a new log
I20260709 12:22:58.160710 21329 ts_tablet_manager.cc:1403] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7: Time spent bootstrapping tablet: real 0.113s	user 0.037s	sys 0.024s
I20260709 12:22:58.164264 21329 raft_consensus.cc:359] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.165032 21329 raft_consensus.cc:385] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.165294 21329 raft_consensus.cc:740] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.166630 21329 consensus_queue.cc:260] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.168841 21329 ts_tablet_manager.cc:1434] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:58.169891 21334 raft_consensus.cc:697] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 LEADER]: Becoming Leader. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Running, Role: LEADER
I20260709 12:22:58.175810 21032 catalog_manager.cc:5697] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 reported cstate change: term changed from 0 to 1, leader changed from <none> to 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "222454fb0cb046ccb3f6d15aa35fd869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.180354 21334 consensus_queue.cc:237] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.184289 21347 consensus_queue.cc:1048] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:22:58.192190 21376 raft_consensus.cc:493] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.192996 21376 raft_consensus.cc:515] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.197194 21376 leader_election.cc:290] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:58.197645 21374 raft_consensus.cc:493] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.199128 21374 raft_consensus.cc:515] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.199618 21136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ace82e19711478ca00a6a56c680068e" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869" is_pre_election: true
I20260709 12:22:58.203001 21136 raft_consensus.cc:2468] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 0.
I20260709 12:22:58.203893 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ace82e19711478ca00a6a56c680068e" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d" is_pre_election: true
I20260709 12:22:58.204653 21213 raft_consensus.cc:2468] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 0.
I20260709 12:22:58.204725 21251 leader_election.cc:304] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 222454fb0cb046ccb3f6d15aa35fd869, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:58.203889 21374 leader_election.cc:290] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:58.205674 21376 raft_consensus.cc:2804] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.206434 21376 raft_consensus.cc:493] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.206745 21376 raft_consensus.cc:3060] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.206995 21136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97632f21e76f4fea967399bdb6315eaf" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869" is_pre_election: true
I20260709 12:22:58.207800 21136 raft_consensus.cc:2468] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 0.
I20260709 12:22:58.209227 21251 leader_election.cc:304] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 222454fb0cb046ccb3f6d15aa35fd869, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:58.209882 21374 raft_consensus.cc:2804] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.210242 21374 raft_consensus.cc:493] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.210579 21374 raft_consensus.cc:3060] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.212270 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97632f21e76f4fea967399bdb6315eaf" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d" is_pre_election: true
I20260709 12:22:58.213043 21213 raft_consensus.cc:2468] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 0.
I20260709 12:22:58.216881 21376 raft_consensus.cc:515] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.218803 21374 raft_consensus.cc:515] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.220250 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ace82e19711478ca00a6a56c680068e" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:22:58.220922 21213 raft_consensus.cc:3060] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.222239 21136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97632f21e76f4fea967399bdb6315eaf" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:22:58.222402 21212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97632f21e76f4fea967399bdb6315eaf" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:22:58.223191 21212 raft_consensus.cc:3060] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.222883 21136 raft_consensus.cc:3060] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.229725 21349 consensus_queue.cc:1048] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:58.218911 21376 leader_election.cc:290] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:58.240221 21374 leader_election.cc:290] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:58.242161 21212 raft_consensus.cc:2468] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 1.
I20260709 12:22:58.243353 21250 leader_election.cc:304] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:58.243647 21138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ace82e19711478ca00a6a56c680068e" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:22:58.244324 21138 raft_consensus.cc:3060] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.245417 21376 raft_consensus.cc:2804] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.247448 21136 raft_consensus.cc:2468] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 1.
I20260709 12:22:58.247771 21213 raft_consensus.cc:2468] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 1.
I20260709 12:22:58.249248 21250 leader_election.cc:304] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:22:58.249507 21376 raft_consensus.cc:697] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:22:58.250084 21374 raft_consensus.cc:2804] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.251705 21138 raft_consensus.cc:2468] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 1.
I20260709 12:22:58.251363 21376 consensus_queue.cc:237] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.252089 21374 raft_consensus.cc:697] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:22:58.251737 21034 catalog_manager.cc:5697] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 reported cstate change: term changed from 0 to 1, leader changed from <none> to 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "222454fb0cb046ccb3f6d15aa35fd869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.254187 21374 consensus_queue.cc:237] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:58.264165 21032 catalog_manager.cc:5697] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:58.278736 21034 catalog_manager.cc:5697] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:58.373158 21349 consensus_queue.cc:1048] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:58.386366 21332 consensus_queue.cc:1048] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:58.396236 11916 ts_manager.cc:295] Set tserver state for 222454fb0cb046ccb3f6d15aa35fd869 to MAINTENANCE_MODE
I20260709 12:22:58.397099 11916 tablet_server.cc:179] TabletServer@127.11.163.1:0 shutting down...
I20260709 12:22:58.425705 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:58.425964 21349 consensus_queue.cc:1048] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:58.426682 11916 tablet_replica.cc:333] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869: stopping tablet replica
I20260709 12:22:58.427686 11916 raft_consensus.cc:2243] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.428215 11916 raft_consensus.cc:2272] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.430620 11916 tablet_replica.cc:333] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869: stopping tablet replica
I20260709 12:22:58.431229 11916 raft_consensus.cc:2243] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.431646 11916 raft_consensus.cc:2272] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.434235 11916 tablet_replica.cc:333] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869: stopping tablet replica
I20260709 12:22:58.435029 11916 raft_consensus.cc:2243] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.435554 11916 raft_consensus.cc:2272] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.439850 11916 tablet_replica.cc:333] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869: stopping tablet replica
I20260709 12:22:58.440665 11916 raft_consensus.cc:2243] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.441205 11916 raft_consensus.cc:2272] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.443706 11916 tablet_replica.cc:333] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: stopping tablet replica
I20260709 12:22:58.444437 11916 raft_consensus.cc:2243] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:58.445194 11916 pending_rounds.cc:70] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Trying to abort 1 pending ops.
I20260709 12:22:58.445421 11916 pending_rounds.cc:77] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624691439652864 op_type: NO_OP noop_request { }
I20260709 12:22:58.445808 11916 raft_consensus.cc:2889] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:58.446159 11916 raft_consensus.cc:2272] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.448917 11916 tablet_replica.cc:333] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869: stopping tablet replica
I20260709 12:22:58.449579 11916 raft_consensus.cc:2243] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.449978 11916 raft_consensus.cc:2272] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.451859 11916 tablet_replica.cc:333] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869: stopping tablet replica
W20260709 12:22:58.452184 21177 consensus_peers.cc:597] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:58.452478 11916 raft_consensus.cc:2243] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.452971 11916 raft_consensus.cc:2272] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.455477 11916 tablet_replica.cc:333] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: stopping tablet replica
I20260709 12:22:58.455947 11916 raft_consensus.cc:2243] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:58.456462 11916 pending_rounds.cc:70] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Trying to abort 1 pending ops.
I20260709 12:22:58.456612 11916 pending_rounds.cc:77] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624691181281280 op_type: NO_OP noop_request { }
I20260709 12:22:58.456830 11916 raft_consensus.cc:2889] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:58.457036 11916 raft_consensus.cc:2272] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.459213 11916 tablet_replica.cc:333] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869: stopping tablet replica
I20260709 12:22:58.459733 11916 raft_consensus.cc:2243] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.460049 11916 raft_consensus.cc:2272] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.461678 11916 tablet_replica.cc:333] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869: stopping tablet replica
I20260709 12:22:58.462131 11916 raft_consensus.cc:2243] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.462522 11916 raft_consensus.cc:2272] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.493435 11916 tablet_server.cc:196] TabletServer@127.11.163.1:0 shutdown complete.
W20260709 12:22:58.588864 21251 consensus_peers.cc:597] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:58.590202 21374 consensus_queue.cc:1048] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:58.602738 21251 consensus_peers.cc:597] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:58.627326 21337 consensus_queue.cc:1048] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:58.663233 21177 consensus_peers.cc:597] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:58.666311 21251 consensus_peers.cc:597] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:58.726501 21404 consensus_queue.cc:1048] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:58.730037 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:58.828888 21404 consensus_queue.cc:1048] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:58.846171 21177 consensus_peers.cc:597] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:58.849396 21251 consensus_peers.cc:597] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:59.002251 21177 consensus_peers.cc:597] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:59.731287 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:59.804405 21404 raft_consensus.cc:493] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.805442 21404 raft_consensus.cc:515] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:59.808203 21404 leader_election.cc:290] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:59.810436 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9f3b4f37c40f79fa03d8356aa946e" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d" is_pre_election: true
I20260709 12:22:59.811401 21213 raft_consensus.cc:2468] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 1.
I20260709 12:22:59.812815 21250 leader_election.cc:304] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
W20260709 12:22:59.813390 21251 leader_election.cc:336] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111)
I20260709 12:22:59.813640 21404 raft_consensus.cc:2804] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:59.814119 21404 raft_consensus.cc:493] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.814419 21404 raft_consensus.cc:3060] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.823638 21404 raft_consensus.cc:515] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:59.825554 21404 leader_election.cc:290] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:22:59.826730 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9f3b4f37c40f79fa03d8356aa946e" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:22:59.827520 21213 raft_consensus.cc:3060] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:59.829452 21251 leader_election.cc:336] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111)
I20260709 12:22:59.835096 21213 raft_consensus.cc:2468] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 2.
I20260709 12:22:59.836164 21250 leader_election.cc:304] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 222454fb0cb046ccb3f6d15aa35fd869
I20260709 12:22:59.836841 21404 raft_consensus.cc:2804] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:59.837308 21404 raft_consensus.cc:697] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Becoming Leader. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:22:59.838413 21404 consensus_queue.cc:237] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:59.846711 21033 catalog_manager.cc:5697] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 reported cstate change: term changed from 1 to 2, leader changed from 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1) to 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:59.864940 21348 raft_consensus.cc:493] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.865610 21348 raft_consensus.cc:515] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:59.867980 21348 leader_election.cc:290] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:59.869741 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c68c745025847329ecc9b974a3d49a1" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7" is_pre_election: true
I20260709 12:22:59.870482 21287 raft_consensus.cc:2468] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 1.
W20260709 12:22:59.871856 21177 leader_election.cc:336] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111)
I20260709 12:22:59.872671 21177 leader_election.cc:304] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 222454fb0cb046ccb3f6d15aa35fd869
I20260709 12:22:59.873368 21348 raft_consensus.cc:2804] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:59.873700 21348 raft_consensus.cc:493] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.873940 21348 raft_consensus.cc:3060] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.880762 21348 raft_consensus.cc:515] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:59.882387 21348 leader_election.cc:290] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 2 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:22:59.883878 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c68c745025847329ecc9b974a3d49a1" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:22:59.884434 21287 raft_consensus.cc:3060] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:59.885749 21177 leader_election.cc:336] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111)
I20260709 12:22:59.890699 21287 raft_consensus.cc:2468] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 2.
I20260709 12:22:59.891700 21177 leader_election.cc:304] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 222454fb0cb046ccb3f6d15aa35fd869
I20260709 12:22:59.892376 21348 raft_consensus.cc:2804] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:59.892802 21348 raft_consensus.cc:697] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 2 LEADER]: Becoming Leader. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:22:59.893676 21348 consensus_queue.cc:237] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:22:59.902412 21033 catalog_manager.cc:5697] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d reported cstate change: term changed from 1 to 2, leader changed from 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1) to 106d5430f7134b50969e552dd855308d (127.11.163.2). New cstate: current_term: 2 leader_uuid: "106d5430f7134b50969e552dd855308d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:00.019003 21251 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111) [suppressed 123 similar messages]
W20260709 12:23:00.388150 21177 consensus_peers.cc:597] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:00.402908 21287 raft_consensus.cc:1275] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Refusing update from remote peer 106d5430f7134b50969e552dd855308d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:00.404284 21348 consensus_queue.cc:1048] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:00.434443 21213 raft_consensus.cc:1275] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Refusing update from remote peer 8042cf42fb224a24aac0db5007ffb2e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:00.435941 21409 consensus_queue.cc:1048] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:00.452394 21251 consensus_peers.cc:597] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:00.732371 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:00.939677 21177 consensus_peers.cc:597] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:00.955394 21251 consensus_peers.cc:597] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:01.019745 21251 consensus_peers.cc:597] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:01.082576 21251 consensus_peers.cc:597] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:01.182874 21251 consensus_peers.cc:597] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:01.295132 21177 consensus_peers.cc:597] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:01.436997 21177 consensus_peers.cc:597] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:01.582710 21177 consensus_peers.cc:597] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:01.733500 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:02.734625 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:02.775602 21251 consensus_peers.cc:597] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:03.002862 21177 consensus_peers.cc:597] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:03.233304 21177 consensus_peers.cc:597] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:03.510385 21251 consensus_peers.cc:597] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:03.513118 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:03.520921 21426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.520972 21427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.524314 21429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:03.527194 11916 server_base.cc:1061] running on GCE node
I20260709 12:23:03.530009 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:03.530230 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:03.530376 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599783530364 us; error 0 us; skew 500 ppm
I20260709 12:23:03.530934 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:03.533794 11916 webserver.cc:533] Webserver started at http://127.11.163.1:41703/ using document root <none> and password file <none>
I20260709 12:23:03.534305 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:03.534458 11916 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:23:03.538599 11916 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:23:03.543241 21434 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.544214 11916 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:23:03.544530 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-0-root
uuid: "222454fb0cb046ccb3f6d15aa35fd869"
format_stamp: "Formatted at 2026-07-09 12:22:56 on dist-test-slave-z9f9"
I20260709 12:23:03.544955 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599438829268-11916-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:03.557864 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:03.559204 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:03.560792 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:03.565148 21441 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:23:03.615836 21251 consensus_peers.cc:597] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:03.617573 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:23:03.617923 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.054s	user 0.003s	sys 0.000s
I20260709 12:23:03.618235 11916 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:23:03.623665 21441 tablet_bootstrap.cc:492] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
W20260709 12:23:03.631265 21177 consensus_peers.cc:597] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:03.638942 21441 tablet_bootstrap.cc:492] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:03.639962 21441 tablet_bootstrap.cc:492] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap complete.
I20260709 12:23:03.640722 21441 ts_tablet_manager.cc:1403] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:23:03.643612 21441 raft_consensus.cc:359] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.644336 21441 raft_consensus.cc:740] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.645112 21441 consensus_queue.cc:260] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.648116 21441 ts_tablet_manager.cc:1434] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:03.648991 21441 tablet_bootstrap.cc:492] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:23:03.666713 21441 tablet_bootstrap.cc:492] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:23:03.666996 21251 consensus_peers.cc:597] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:03.667846 21441 tablet_bootstrap.cc:492] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap complete.
I20260709 12:23:03.668779 21441 ts_tablet_manager.cc:1403] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.015s
I20260709 12:23:03.671041 21441 raft_consensus.cc:359] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.671695 21441 raft_consensus.cc:740] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.672399 21441 consensus_queue.cc:260] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.673951 21441 ts_tablet_manager.cc:1434] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:03.674642 21441 tablet_bootstrap.cc:492] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:23:03.677129 11916 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:23:03.677438 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.059s	user 0.054s	sys 0.004s
I20260709 12:23:03.686334 21441 tablet_bootstrap.cc:492] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:03.687373 21441 tablet_bootstrap.cc:492] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap complete.
I20260709 12:23:03.688210 21441 ts_tablet_manager.cc:1403] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:23:03.690522 21441 raft_consensus.cc:359] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.691222 21441 raft_consensus.cc:740] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.692210 21441 consensus_queue.cc:260] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.694422 21441 ts_tablet_manager.cc:1434] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:03.695237 21441 tablet_bootstrap.cc:492] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:23:03.708545 21441 tablet_bootstrap.cc:492] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:03.709498 21441 tablet_bootstrap.cc:492] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap complete.
I20260709 12:23:03.710170 21441 ts_tablet_manager.cc:1403] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:23:03.712690 21441 raft_consensus.cc:359] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.713258 21441 raft_consensus.cc:740] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.714066 21441 consensus_queue.cc:260] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.716094 21441 ts_tablet_manager.cc:1434] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:03.716799 21441 tablet_bootstrap.cc:492] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:23:03.728722 21441 tablet_bootstrap.cc:492] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:03.729830 21441 tablet_bootstrap.cc:492] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap complete.
I20260709 12:23:03.730557 21441 ts_tablet_manager.cc:1403] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:23:03.732776 21441 raft_consensus.cc:359] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.733351 21441 raft_consensus.cc:740] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.734139 21441 consensus_queue.cc:260] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
W20260709 12:23:03.735818 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:03.736321 21441 ts_tablet_manager.cc:1434] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:23:03.737349 21441 tablet_bootstrap.cc:492] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:23:03.747252 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.1:43827
I20260709 12:23:03.747385 21504 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.1:43827 every 8 connection(s)
I20260709 12:23:03.751384 21441 tablet_bootstrap.cc:492] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:03.752605 21441 tablet_bootstrap.cc:492] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap complete.
I20260709 12:23:03.753535 21441 ts_tablet_manager.cc:1403] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:23:03.753903 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:03.757104 21441 raft_consensus.cc:359] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:23:03.758285 21441 raft_consensus.cc:740] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.759419 21441 consensus_queue.cc:260] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:23:03.762125 21441 ts_tablet_manager.cc:1434] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:03.763192 21441 tablet_bootstrap.cc:492] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:23:03.779183 21505 heartbeater.cc:344] Connected to a master server at 127.11.163.62:36937
I20260709 12:23:03.779789 21505 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:03.780875 21505 heartbeater.cc:507] Master 127.11.163.62:36937 requested a full tablet report, sending...
I20260709 12:23:03.782584 21441 tablet_bootstrap.cc:492] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:23:03.783802 21441 tablet_bootstrap.cc:492] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap complete.
I20260709 12:23:03.784515 21441 ts_tablet_manager.cc:1403] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:23:03.785671 21286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "226c214fa28b43488c817dcc97e88ebc"
dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
mode: GRACEFUL
new_leader_uuid: "106d5430f7134b50969e552dd855308d"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:23:03.786374 21286 raft_consensus.cc:606] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Received request to transfer leadership to TS 106d5430f7134b50969e552dd855308d
I20260709 12:23:03.787602 21441 raft_consensus.cc:359] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.788578 21441 raft_consensus.cc:740] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.789029 21032 ts_manager.cc:194] Re-registered known tserver with Master: 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827)
I20260709 12:23:03.792577 21441 consensus_queue.cc:260] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.795740 21441 ts_tablet_manager.cc:1434] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:03.796703 21441 tablet_bootstrap.cc:492] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:23:03.800307 21032 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54872
I20260709 12:23:03.802583 21213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfadb3ce5f1f45f0adb2dd7890737094"
dest_uuid: "106d5430f7134b50969e552dd855308d"
mode: GRACEFUL
new_leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
 from {username='slave'} at 127.0.0.1:57322
I20260709 12:23:03.803211 21213 raft_consensus.cc:606] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Received request to transfer leadership to TS 8042cf42fb224a24aac0db5007ffb2e7
I20260709 12:23:03.804665 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:03.804731 21505 heartbeater.cc:499] Master 127.11.163.62:36937 was elected leader, sending a full tablet report...
I20260709 12:23:03.805244 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:03.805943 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:03.811710 21441 tablet_bootstrap.cc:492] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:03.812623 21441 tablet_bootstrap.cc:492] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap complete.
I20260709 12:23:03.813301 21441 ts_tablet_manager.cc:1403] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:23:03.816151 21441 raft_consensus.cc:359] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.816918 21441 raft_consensus.cc:740] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.817683 21441 consensus_queue.cc:260] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.819977 21441 ts_tablet_manager.cc:1434] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:03.820885 21441 tablet_bootstrap.cc:492] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:23:03.836272 21441 tablet_bootstrap.cc:492] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:03.837100 21441 tablet_bootstrap.cc:492] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap complete.
I20260709 12:23:03.837628 21441 ts_tablet_manager.cc:1403] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:23:03.839581 21441 raft_consensus.cc:359] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.840073 21441 raft_consensus.cc:740] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.840607 21441 consensus_queue.cc:260] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.842082 21441 ts_tablet_manager.cc:1434] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:03.842844 21441 tablet_bootstrap.cc:492] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap starting.
I20260709 12:23:03.857653 21441 tablet_bootstrap.cc:492] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:23:03.858456 21441 tablet_bootstrap.cc:492] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Bootstrap complete.
I20260709 12:23:03.859052 21441 ts_tablet_manager.cc:1403] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 12:23:03.861066 21441 raft_consensus.cc:359] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.861747 21441 raft_consensus.cc:740] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222454fb0cb046ccb3f6d15aa35fd869, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.862447 21441 consensus_queue.cc:260] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.864552 21441 ts_tablet_manager.cc:1434] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:23:03.945500 21478 raft_consensus.cc:3060] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:03.955096 21478 pending_rounds.cc:85] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Aborting all ops after (but not including) 0
I20260709 12:23:03.955401 21478 pending_rounds.cc:107] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:23:03.955760 21478 raft_consensus.cc:2889] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:03.977111 21421 raft_consensus.cc:993] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7: : Instructing follower 106d5430f7134b50969e552dd855308d to start an election
I20260709 12:23:03.977725 21521 raft_consensus.cc:1081] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Signalling peer 106d5430f7134b50969e552dd855308d to start an election
I20260709 12:23:03.979403 21213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "226c214fa28b43488c817dcc97e88ebc"
dest_uuid: "106d5430f7134b50969e552dd855308d"
 from {username='slave'} at 127.0.0.1:57256
I20260709 12:23:03.980026 21213 raft_consensus.cc:493] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:03.980338 21213 raft_consensus.cc:3060] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:03.986253 21213 raft_consensus.cc:515] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.987962 21213 leader_election.cc:290] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 2 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:23:03.988804 21478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c214fa28b43488c817dcc97e88ebc" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:23:03.988973 21286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226c214fa28b43488c817dcc97e88ebc" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:23:03.989555 21478 raft_consensus.cc:3060] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:03.989631 21286 raft_consensus.cc:3055] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:03.990044 21286 raft_consensus.cc:740] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:23:03.990777 21286 consensus_queue.cc:260] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:03.991883 21286 raft_consensus.cc:3060] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:03.994863 21478 raft_consensus.cc:2468] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 2.
I20260709 12:23:03.996035 21177 leader_election.cc:304] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 222454fb0cb046ccb3f6d15aa35fd869; no voters: 
I20260709 12:23:03.996889 21425 raft_consensus.cc:2804] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:03.997967 21286 raft_consensus.cc:2468] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 2.
I20260709 12:23:03.998169 21425 raft_consensus.cc:697] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 2 LEADER]: Becoming Leader. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:23:03.999212 21425 consensus_queue.cc:237] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:04.007577 21032 catalog_manager.cc:5697] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d reported cstate change: term changed from 1 to 2, leader changed from 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3) to 106d5430f7134b50969e552dd855308d (127.11.163.2). New cstate: current_term: 2 leader_uuid: "106d5430f7134b50969e552dd855308d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.060128 21522 raft_consensus.cc:993] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d: : Instructing follower 8042cf42fb224a24aac0db5007ffb2e7 to start an election
I20260709 12:23:04.060623 21425 raft_consensus.cc:1081] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Signalling peer 8042cf42fb224a24aac0db5007ffb2e7 to start an election
I20260709 12:23:04.062096 21286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfadb3ce5f1f45f0adb2dd7890737094"
dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
 from {username='slave'} at 127.0.0.1:48314
I20260709 12:23:04.062618 21286 raft_consensus.cc:493] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:04.062913 21286 raft_consensus.cc:3060] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.070446 21286 raft_consensus.cc:515] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:23:04.072999 21286 leader_election.cc:290] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:23:04.073216 21478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfadb3ce5f1f45f0adb2dd7890737094" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:23:04.073745 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfadb3ce5f1f45f0adb2dd7890737094" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:23:04.074093 21478 raft_consensus.cc:3060] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.074410 21213 raft_consensus.cc:3055] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.074779 21213 raft_consensus.cc:740] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:23:04.075738 21213 consensus_queue.cc:260] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:23:04.077239 21213 raft_consensus.cc:3060] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.081756 21478 raft_consensus.cc:2468] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 2.
I20260709 12:23:04.083005 21251 leader_election.cc:304] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 222454fb0cb046ccb3f6d15aa35fd869, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:23:04.083920 21521 raft_consensus.cc:2804] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:04.084408 21521 raft_consensus.cc:697] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Becoming Leader. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:23:04.085032 21213 raft_consensus.cc:2468] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 2.
I20260709 12:23:04.085314 21521 consensus_queue.cc:237] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } }
I20260709 12:23:04.092957 21032 catalog_manager.cc:5697] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 reported cstate change: term changed from 1 to 2, leader changed from 106d5430f7134b50969e552dd855308d (127.11.163.2) to 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.095346 21478 raft_consensus.cc:3060] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.101984 21478 pending_rounds.cc:85] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Aborting all ops after (but not including) 0
I20260709 12:23:04.102209 21478 pending_rounds.cc:107] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:23:04.102430 21478 raft_consensus.cc:2889] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:04.401801 21478 raft_consensus.cc:1275] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Refusing update from remote peer 106d5430f7134b50969e552dd855308d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:04.403121 21425 consensus_queue.cc:1048] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:04.413247 21286 raft_consensus.cc:1275] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Refusing update from remote peer 106d5430f7134b50969e552dd855308d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:04.414863 21425 consensus_queue.cc:1048] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:04.493671 21478 raft_consensus.cc:1275] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Refusing update from remote peer 8042cf42fb224a24aac0db5007ffb2e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:04.495157 21532 consensus_queue.cc:1048] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:04.505281 21213 raft_consensus.cc:1275] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Refusing update from remote peer 8042cf42fb224a24aac0db5007ffb2e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:04.506894 21521 consensus_queue.cc:1048] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:04.736930 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:04.814801 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:04.822616 21213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4"
dest_uuid: "106d5430f7134b50969e552dd855308d"
mode: GRACEFUL
new_leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
 from {username='slave'} at 127.0.0.1:57322
I20260709 12:23:04.823170 21213 raft_consensus.cc:606] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Received request to transfer leadership to TS 8042cf42fb224a24aac0db5007ffb2e7
I20260709 12:23:04.826014 21286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9d9f3b4f37c40f79fa03d8356aa946e"
dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
mode: GRACEFUL
new_leader_uuid: "106d5430f7134b50969e552dd855308d"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:23:04.826565 21286 raft_consensus.cc:606] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Received request to transfer leadership to TS 106d5430f7134b50969e552dd855308d
I20260709 12:23:04.827850 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:04.828344 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:04.828948 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.040151 21522 raft_consensus.cc:993] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d: : Instructing follower 8042cf42fb224a24aac0db5007ffb2e7 to start an election
I20260709 12:23:05.040830 21537 raft_consensus.cc:1081] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Signalling peer 8042cf42fb224a24aac0db5007ffb2e7 to start an election
I20260709 12:23:05.042309 21286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4"
dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
 from {username='slave'} at 127.0.0.1:48314
I20260709 12:23:05.042838 21286 raft_consensus.cc:493] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.043218 21286 raft_consensus.cc:3060] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.049166 21286 raft_consensus.cc:515] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:05.050859 21286 leader_election.cc:290] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:23:05.051954 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:23:05.052016 21477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:23:05.052551 21213 raft_consensus.cc:3055] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:05.052836 21477 raft_consensus.cc:3060] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.052909 21213 raft_consensus.cc:740] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:23:05.053730 21213 consensus_queue.cc:260] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:05.054702 21213 raft_consensus.cc:3060] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.059549 21213 raft_consensus.cc:2468] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 2.
I20260709 12:23:05.059579 21477 raft_consensus.cc:2468] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 2.
I20260709 12:23:05.060743 21250 leader_election.cc:304] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:23:05.061511 21421 raft_consensus.cc:2804] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:05.061980 21421 raft_consensus.cc:697] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Becoming Leader. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:23:05.062954 21421 consensus_queue.cc:237] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:05.070883 21032 catalog_manager.cc:5697] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 reported cstate change: term changed from 1 to 2, leader changed from 106d5430f7134b50969e552dd855308d (127.11.163.2) to 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.325348 21521 raft_consensus.cc:993] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7: : Instructing follower 106d5430f7134b50969e552dd855308d to start an election
I20260709 12:23:05.325937 21421 raft_consensus.cc:1081] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Signalling peer 106d5430f7134b50969e552dd855308d to start an election
I20260709 12:23:05.327330 21213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9d9f3b4f37c40f79fa03d8356aa946e"
dest_uuid: "106d5430f7134b50969e552dd855308d"
 from {username='slave'} at 127.0.0.1:57256
I20260709 12:23:05.327821 21213 raft_consensus.cc:493] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.328101 21213 raft_consensus.cc:3060] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:05.332887 21213 raft_consensus.cc:515] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:05.334487 21213 leader_election.cc:290] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 3 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:23:05.335292 21477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9f3b4f37c40f79fa03d8356aa946e" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:23:05.335530 21286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d9f3b4f37c40f79fa03d8356aa946e" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:23:05.336055 21477 raft_consensus.cc:3060] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:05.336164 21286 raft_consensus.cc:3055] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:05.336606 21286 raft_consensus.cc:740] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:23:05.337347 21286 consensus_queue.cc:260] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:05.338325 21286 raft_consensus.cc:3060] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:05.342013 21477 raft_consensus.cc:2468] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 3.
I20260709 12:23:05.343101 21177 leader_election.cc:304] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 222454fb0cb046ccb3f6d15aa35fd869; no voters: 
I20260709 12:23:05.343304 21286 raft_consensus.cc:2468] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 3.
I20260709 12:23:05.343799 21537 raft_consensus.cc:2804] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:05.344343 21537 raft_consensus.cc:697] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 3 LEADER]: Becoming Leader. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:23:05.345254 21537 consensus_queue.cc:237] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:05.352380 21032 catalog_manager.cc:5697] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d reported cstate change: term changed from 2 to 3, leader changed from 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3) to 106d5430f7134b50969e552dd855308d (127.11.163.2). New cstate: current_term: 3 leader_uuid: "106d5430f7134b50969e552dd855308d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.496093 21478 raft_consensus.cc:1275] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Refusing update from remote peer 8042cf42fb224a24aac0db5007ffb2e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.497295 21421 consensus_queue.cc:1048] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:05.508402 21213 raft_consensus.cc:1275] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Refusing update from remote peer 8042cf42fb224a24aac0db5007ffb2e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.510216 21521 consensus_queue.cc:1048] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:05.737927 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:05.801717 21286 raft_consensus.cc:1275] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Refusing update from remote peer 106d5430f7134b50969e552dd855308d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:05.803236 21537 consensus_queue.cc:1048] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:05.813256 21478 raft_consensus.cc:1275] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Refusing update from remote peer 106d5430f7134b50969e552dd855308d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:05.815110 21552 consensus_queue.cc:1048] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:05.835282 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.842422 21286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842"
dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
mode: GRACEFUL
new_leader_uuid: "106d5430f7134b50969e552dd855308d"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:23:05.842974 21286 raft_consensus.cc:606] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Received request to transfer leadership to TS 106d5430f7134b50969e552dd855308d
I20260709 12:23:05.845534 21213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e011141c23994d459c3cc61f3a996174"
dest_uuid: "106d5430f7134b50969e552dd855308d"
mode: GRACEFUL
new_leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
 from {username='slave'} at 127.0.0.1:57322
I20260709 12:23:05.846143 21213 raft_consensus.cc:606] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Received request to transfer leadership to TS 8042cf42fb224a24aac0db5007ffb2e7
I20260709 12:23:05.847538 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:05.848021 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:05.848639 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.018682 21522 raft_consensus.cc:993] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d: : Instructing follower 8042cf42fb224a24aac0db5007ffb2e7 to start an election
I20260709 12:23:06.019222 21552 raft_consensus.cc:1081] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Signalling peer 8042cf42fb224a24aac0db5007ffb2e7 to start an election
I20260709 12:23:06.020586 21286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e011141c23994d459c3cc61f3a996174"
dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
 from {username='slave'} at 127.0.0.1:48314
I20260709 12:23:06.021018 21286 raft_consensus.cc:493] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:06.021268 21286 raft_consensus.cc:3060] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.027729 21286 raft_consensus.cc:515] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:06.029377 21286 leader_election.cc:290] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:23:06.030309 21477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e011141c23994d459c3cc61f3a996174" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:23:06.030407 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e011141c23994d459c3cc61f3a996174" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:23:06.031116 21477 raft_consensus.cc:3060] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.031132 21213 raft_consensus.cc:3055] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:06.031667 21213 raft_consensus.cc:740] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:23:06.032323 21213 consensus_queue.cc:260] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:06.033275 21213 raft_consensus.cc:3060] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.038957 21477 raft_consensus.cc:2468] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 2.
I20260709 12:23:06.040351 21213 raft_consensus.cc:2468] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 2.
I20260709 12:23:06.040393 21251 leader_election.cc:304] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 222454fb0cb046ccb3f6d15aa35fd869, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:23:06.041551 21554 raft_consensus.cc:2804] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:06.041954 21554 raft_consensus.cc:697] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Becoming Leader. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:23:06.042732 21554 consensus_queue.cc:237] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:06.049335 21032 catalog_manager.cc:5697] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 reported cstate change: term changed from 1 to 2, leader changed from 106d5430f7134b50969e552dd855308d (127.11.163.2) to 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.219961 21554 raft_consensus.cc:993] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7: : Instructing follower 106d5430f7134b50969e552dd855308d to start an election
I20260709 12:23:06.220498 21421 raft_consensus.cc:1081] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Signalling peer 106d5430f7134b50969e552dd855308d to start an election
I20260709 12:23:06.221982 21213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842"
dest_uuid: "106d5430f7134b50969e552dd855308d"
 from {username='slave'} at 127.0.0.1:57256
I20260709 12:23:06.222424 21213 raft_consensus.cc:493] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:06.222687 21213 raft_consensus.cc:3060] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.227586 21213 raft_consensus.cc:515] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:06.228991 21213 leader_election.cc:290] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 2 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:23:06.229894 21478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:23:06.230175 21286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:23:06.230631 21478 raft_consensus.cc:3060] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.230746 21286 raft_consensus.cc:3055] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:06.231190 21286 raft_consensus.cc:740] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:23:06.232070 21286 consensus_queue.cc:260] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:06.233399 21286 raft_consensus.cc:3060] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.238217 21478 raft_consensus.cc:2468] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 2.
I20260709 12:23:06.239586 21177 leader_election.cc:304] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 222454fb0cb046ccb3f6d15aa35fd869; no voters: 
I20260709 12:23:06.240324 21552 raft_consensus.cc:2804] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:06.240725 21552 raft_consensus.cc:697] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 2 LEADER]: Becoming Leader. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:23:06.240816 21286 raft_consensus.cc:2468] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 2.
I20260709 12:23:06.241539 21552 consensus_queue.cc:237] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:06.248968 21032 catalog_manager.cc:5697] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d reported cstate change: term changed from 1 to 2, leader changed from 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3) to 106d5430f7134b50969e552dd855308d (127.11.163.2). New cstate: current_term: 2 leader_uuid: "106d5430f7134b50969e552dd855308d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.555975 21478 raft_consensus.cc:1275] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Refusing update from remote peer 8042cf42fb224a24aac0db5007ffb2e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.557303 21421 consensus_queue.cc:1048] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:06.568122 21213 raft_consensus.cc:1275] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Refusing update from remote peer 8042cf42fb224a24aac0db5007ffb2e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.570024 21421 consensus_queue.cc:1048] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:06.646867 21287 raft_consensus.cc:1275] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Refusing update from remote peer 106d5430f7134b50969e552dd855308d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.648139 21560 consensus_queue.cc:1048] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:06.657506 21477 raft_consensus.cc:1275] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Refusing update from remote peer 106d5430f7134b50969e552dd855308d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.659399 21569 consensus_queue.cc:1048] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:06.738886 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:06.854841 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.862572 21287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4"
dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
mode: GRACEFUL
new_leader_uuid: "106d5430f7134b50969e552dd855308d"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:23:06.863147 21287 raft_consensus.cc:606] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Received request to transfer leadership to TS 106d5430f7134b50969e552dd855308d
I20260709 12:23:06.865775 21213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48a238fdc89e4dcdb85b6a539480cf42"
dest_uuid: "106d5430f7134b50969e552dd855308d"
mode: GRACEFUL
new_leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
 from {username='slave'} at 127.0.0.1:57322
I20260709 12:23:06.866195 21213 raft_consensus.cc:606] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Received request to transfer leadership to TS 8042cf42fb224a24aac0db5007ffb2e7
I20260709 12:23:06.867300 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:06.867818 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:06.868335 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.926426 21564 raft_consensus.cc:993] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7: : Instructing follower 106d5430f7134b50969e552dd855308d to start an election
I20260709 12:23:06.926935 21554 raft_consensus.cc:1081] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Signalling peer 106d5430f7134b50969e552dd855308d to start an election
I20260709 12:23:06.928452 21213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4"
dest_uuid: "106d5430f7134b50969e552dd855308d"
 from {username='slave'} at 127.0.0.1:57256
I20260709 12:23:06.928915 21213 raft_consensus.cc:493] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:06.929252 21213 raft_consensus.cc:3060] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.935209 21213 raft_consensus.cc:515] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:06.936565 21213 leader_election.cc:290] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 3 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:23:06.937408 21477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:23:06.937686 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fe6fe912a495bb0077b0f9f1281d4" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:23:06.938103 21477 raft_consensus.cc:3060] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.938298 21287 raft_consensus.cc:3055] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:06.938678 21287 raft_consensus.cc:740] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:23:06.939314 21287 consensus_queue.cc:260] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:06.940311 21287 raft_consensus.cc:3060] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.943495 21477 raft_consensus.cc:2468] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 3.
I20260709 12:23:06.944573 21177 leader_election.cc:304] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 222454fb0cb046ccb3f6d15aa35fd869; no voters: 
I20260709 12:23:06.945266 21569 raft_consensus.cc:2804] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:06.945550 21287 raft_consensus.cc:2468] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 3.
I20260709 12:23:06.945799 21569 raft_consensus.cc:697] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 3 LEADER]: Becoming Leader. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:23:06.946873 21569 consensus_queue.cc:237] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:06.954735 21033 catalog_manager.cc:5697] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d reported cstate change: term changed from 2 to 3, leader changed from 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3) to 106d5430f7134b50969e552dd855308d (127.11.163.2). New cstate: current_term: 3 leader_uuid: "106d5430f7134b50969e552dd855308d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.149399 21560 raft_consensus.cc:993] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d: : Instructing follower 8042cf42fb224a24aac0db5007ffb2e7 to start an election
I20260709 12:23:07.149937 21569 raft_consensus.cc:1081] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Signalling peer 8042cf42fb224a24aac0db5007ffb2e7 to start an election
I20260709 12:23:07.151386 21287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48a238fdc89e4dcdb85b6a539480cf42"
dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
 from {username='slave'} at 127.0.0.1:48314
I20260709 12:23:07.151947 21287 raft_consensus.cc:493] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:07.152294 21287 raft_consensus.cc:3060] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.158388 21287 raft_consensus.cc:515] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:07.160288 21287 leader_election.cc:290] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:23:07.161266 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a238fdc89e4dcdb85b6a539480cf42" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:23:07.161131 21477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a238fdc89e4dcdb85b6a539480cf42" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:23:07.161964 21213 raft_consensus.cc:3055] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:07.162096 21477 raft_consensus.cc:3060] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.162263 21213 raft_consensus.cc:740] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:23:07.163125 21213 consensus_queue.cc:260] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:07.164186 21213 raft_consensus.cc:3060] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.168495 21477 raft_consensus.cc:2468] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 2.
I20260709 12:23:07.169605 21213 raft_consensus.cc:2468] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 2.
I20260709 12:23:07.169761 21251 leader_election.cc:304] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 222454fb0cb046ccb3f6d15aa35fd869, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:23:07.170676 21554 raft_consensus.cc:2804] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:07.171181 21554 raft_consensus.cc:697] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Becoming Leader. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:23:07.172163 21554 consensus_queue.cc:237] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:07.179491 21033 catalog_manager.cc:5697] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 reported cstate change: term changed from 1 to 2, leader changed from 106d5430f7134b50969e552dd855308d (127.11.163.2) to 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:07.403698 21287 raft_consensus.cc:1275] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Refusing update from remote peer 106d5430f7134b50969e552dd855308d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:07.405154 21569 consensus_queue.cc:1048] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:07.417858 21477 raft_consensus.cc:1275] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Refusing update from remote peer 106d5430f7134b50969e552dd855308d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:07.420032 21560 consensus_queue.cc:1048] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:07.566850 21213 raft_consensus.cc:1275] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Refusing update from remote peer 8042cf42fb224a24aac0db5007ffb2e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:07.568264 21564 consensus_queue.cc:1048] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.580341 21477 raft_consensus.cc:1275] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Refusing update from remote peer 8042cf42fb224a24aac0db5007ffb2e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:07.582278 21554 consensus_queue.cc:1048] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:07.739876 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:07.874553 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:07.882725 21213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842"
dest_uuid: "106d5430f7134b50969e552dd855308d"
mode: GRACEFUL
new_leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
 from {username='slave'} at 127.0.0.1:57322
I20260709 12:23:07.883261 21213 raft_consensus.cc:606] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 2 LEADER]: Received request to transfer leadership to TS 8042cf42fb224a24aac0db5007ffb2e7
I20260709 12:23:07.885622 21287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e011141c23994d459c3cc61f3a996174"
dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
mode: GRACEFUL
new_leader_uuid: "106d5430f7134b50969e552dd855308d"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:23:07.886127 21287 raft_consensus.cc:606] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Received request to transfer leadership to TS 106d5430f7134b50969e552dd855308d
I20260709 12:23:07.887367 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:07.887849 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:07.888384 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:08.025214 21554 raft_consensus.cc:993] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7: : Instructing follower 106d5430f7134b50969e552dd855308d to start an election
I20260709 12:23:08.025738 21584 raft_consensus.cc:1081] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Signalling peer 106d5430f7134b50969e552dd855308d to start an election
I20260709 12:23:08.027115 21213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e011141c23994d459c3cc61f3a996174"
dest_uuid: "106d5430f7134b50969e552dd855308d"
 from {username='slave'} at 127.0.0.1:57256
I20260709 12:23:08.027598 21213 raft_consensus.cc:493] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:08.027853 21213 raft_consensus.cc:3060] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:08.032795 21213 raft_consensus.cc:515] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:08.034188 21213 leader_election.cc:290] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 3 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3:45513)
I20260709 12:23:08.035218 21477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e011141c23994d459c3cc61f3a996174" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:23:08.035569 21287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e011141c23994d459c3cc61f3a996174" candidate_uuid: "106d5430f7134b50969e552dd855308d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
I20260709 12:23:08.035908 21477 raft_consensus.cc:3060] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:08.036178 21287 raft_consensus.cc:3055] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:08.036542 21287 raft_consensus.cc:740] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:23:08.037618 21287 consensus_queue.cc:260] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:08.038959 21287 raft_consensus.cc:3060] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:08.043980 21477 raft_consensus.cc:2468] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 3.
I20260709 12:23:08.045445 21177 leader_election.cc:304] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 106d5430f7134b50969e552dd855308d, 222454fb0cb046ccb3f6d15aa35fd869; no voters: 
I20260709 12:23:08.046279 21587 raft_consensus.cc:2804] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:08.046844 21587 raft_consensus.cc:697] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 3 LEADER]: Becoming Leader. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:23:08.047479 21287 raft_consensus.cc:2468] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 106d5430f7134b50969e552dd855308d in term 3.
I20260709 12:23:08.047847 21587 consensus_queue.cc:237] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:08.054940 21032 catalog_manager.cc:5697] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d reported cstate change: term changed from 2 to 3, leader changed from 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3) to 106d5430f7134b50969e552dd855308d (127.11.163.2). New cstate: current_term: 3 leader_uuid: "106d5430f7134b50969e552dd855308d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.148095 21586 raft_consensus.cc:993] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d: : Instructing follower 8042cf42fb224a24aac0db5007ffb2e7 to start an election
I20260709 12:23:08.148582 21587 raft_consensus.cc:1081] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 2 LEADER]: Signalling peer 8042cf42fb224a24aac0db5007ffb2e7 to start an election
I20260709 12:23:08.150111 21287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842"
dest_uuid: "8042cf42fb224a24aac0db5007ffb2e7"
 from {username='slave'} at 127.0.0.1:48314
I20260709 12:23:08.150576 21287 raft_consensus.cc:493] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:08.150895 21287 raft_consensus.cc:3060] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:08.156121 21287 raft_consensus.cc:515] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:08.157526 21287 leader_election.cc:290] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 3 election: Requested vote from peers 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827), 106d5430f7134b50969e552dd855308d (127.11.163.2:39363)
I20260709 12:23:08.158514 21213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "106d5430f7134b50969e552dd855308d"
I20260709 12:23:08.158561 21477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa4ccaa51f6450283cdf3a3ce681842" candidate_uuid: "8042cf42fb224a24aac0db5007ffb2e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "222454fb0cb046ccb3f6d15aa35fd869"
I20260709 12:23:08.159166 21213 raft_consensus.cc:3055] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:08.159276 21477 raft_consensus.cc:3060] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:08.159487 21213 raft_consensus.cc:740] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 106d5430f7134b50969e552dd855308d, State: Running, Role: LEADER
I20260709 12:23:08.160166 21213 consensus_queue.cc:260] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:08.161180 21213 raft_consensus.cc:3060] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:08.166559 21477 raft_consensus.cc:2468] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 3.
I20260709 12:23:08.167725 21213 raft_consensus.cc:2468] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8042cf42fb224a24aac0db5007ffb2e7 in term 3.
I20260709 12:23:08.167846 21251 leader_election.cc:304] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 222454fb0cb046ccb3f6d15aa35fd869, 8042cf42fb224a24aac0db5007ffb2e7; no voters: 
I20260709 12:23:08.168751 21554 raft_consensus.cc:2804] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:08.169214 21554 raft_consensus.cc:697] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 LEADER]: Becoming Leader. State: Replica: 8042cf42fb224a24aac0db5007ffb2e7, State: Running, Role: LEADER
I20260709 12:23:08.169950 21554 consensus_queue.cc:237] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } }
I20260709 12:23:08.176326 21032 catalog_manager.cc:5697] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 reported cstate change: term changed from 2 to 3, leader changed from 106d5430f7134b50969e552dd855308d (127.11.163.2) to 8042cf42fb224a24aac0db5007ffb2e7 (127.11.163.3). New cstate: current_term: 3 leader_uuid: "8042cf42fb224a24aac0db5007ffb2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:08.525333 21287 raft_consensus.cc:1275] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Refusing update from remote peer 106d5430f7134b50969e552dd855308d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:08.526582 21587 consensus_queue.cc:1048] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8042cf42fb224a24aac0db5007ffb2e7" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:08.536999 21477 raft_consensus.cc:1275] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Refusing update from remote peer 106d5430f7134b50969e552dd855308d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:08.539264 21596 consensus_queue.cc:1048] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:08.598143 21477 raft_consensus.cc:1275] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Refusing update from remote peer 8042cf42fb224a24aac0db5007ffb2e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:08.599490 21592 consensus_queue.cc:1048] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "222454fb0cb046ccb3f6d15aa35fd869" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:08.608421 21213 raft_consensus.cc:1275] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Refusing update from remote peer 8042cf42fb224a24aac0db5007ffb2e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:08.610278 21592 consensus_queue.cc:1048] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "106d5430f7134b50969e552dd855308d" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 39363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:23:08.740854 21083 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:08.894990 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:08.933331 11916 tablet_server.cc:179] TabletServer@127.11.163.1:43827 shutting down...
W20260709 12:23:08.966199 21177 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 74 similar messages]
I20260709 12:23:08.970291 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:23:08.971227 21177 consensus_peers.cc:597] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.972107 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:08.973258 11916 raft_consensus.cc:2243] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.974473 11916 raft_consensus.cc:2272] T 9c68c745025847329ecc9b974a3d49a1 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.978041 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:08.978770 11916 raft_consensus.cc:2243] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.979414 11916 raft_consensus.cc:2272] T 397fe6fe912a495bb0077b0f9f1281d4 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.982242 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:08.982713 11916 raft_consensus.cc:2243] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.983223 11916 raft_consensus.cc:2272] T bfadb3ce5f1f45f0adb2dd7890737094 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.986056 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:08.986974 11916 raft_consensus.cc:2243] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.987890 11916 raft_consensus.cc:2272] T e011141c23994d459c3cc61f3a996174 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:08.991505 21177 consensus_peers.cc:597] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.994772 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:08.996347 11916 raft_consensus.cc:2243] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.997512 11916 raft_consensus.cc:2272] T 97632f21e76f4fea967399bdb6315eaf P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:08.999212 21177 consensus_peers.cc:597] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.002175 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:09.002897 11916 raft_consensus.cc:2243] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.003585 11916 raft_consensus.cc:2272] T 0ace82e19711478ca00a6a56c680068e P 222454fb0cb046ccb3f6d15aa35fd869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.006700 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:09.007686 11916 raft_consensus.cc:2243] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.008520 11916 raft_consensus.cc:2272] T 48a238fdc89e4dcdb85b6a539480cf42 P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.012897 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:09.013772 11916 raft_consensus.cc:2243] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:09.013779 21251 consensus_peers.cc:597] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.014802 11916 raft_consensus.cc:2272] T 226c214fa28b43488c817dcc97e88ebc P 222454fb0cb046ccb3f6d15aa35fd869 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.018007 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:09.018589 11916 raft_consensus.cc:2243] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.019172 11916 raft_consensus.cc:2272] T f9d9f3b4f37c40f79fa03d8356aa946e P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.023463 11916 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:09.024385 11916 raft_consensus.cc:2243] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.025539 11916 raft_consensus.cc:2272] T 3fa4ccaa51f6450283cdf3a3ce681842 P 222454fb0cb046ccb3f6d15aa35fd869 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.065892 11916 tablet_server.cc:196] TabletServer@127.11.163.1:43827 shutdown complete.
I20260709 12:23:09.098241 11916 tablet_server.cc:179] TabletServer@127.11.163.2:0 shutting down...
W20260709 12:23:09.114256 21251 consensus_peers.cc:597] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:09.129704 21177 consensus_peers.cc:597] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:09.133757 21250 consensus_peers.cc:597] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 106d5430f7134b50969e552dd855308d (127.11.163.2:39363): Couldn't send request to peer 106d5430f7134b50969e552dd855308d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.136770 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:09.137733 11916 tablet_replica.cc:333] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d: stopping tablet replica
I20260709 12:23:09.138523 11916 raft_consensus.cc:2243] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.139621 11916 raft_consensus.cc:2272] T 226c214fa28b43488c817dcc97e88ebc P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.142022 11916 tablet_replica.cc:333] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d: stopping tablet replica
I20260709 12:23:09.142652 11916 raft_consensus.cc:2243] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.143612 11916 raft_consensus.cc:2272] T f9d9f3b4f37c40f79fa03d8356aa946e P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.146173 11916 tablet_replica.cc:333] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d: stopping tablet replica
I20260709 12:23:09.146710 11916 raft_consensus.cc:2243] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.147243 11916 raft_consensus.cc:2272] T 3fa4ccaa51f6450283cdf3a3ce681842 P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.150148 11916 tablet_replica.cc:333] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d: stopping tablet replica
I20260709 12:23:09.150702 11916 raft_consensus.cc:2243] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.151696 11916 raft_consensus.cc:2272] T 397fe6fe912a495bb0077b0f9f1281d4 P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.154084 11916 tablet_replica.cc:333] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d: stopping tablet replica
I20260709 12:23:09.154618 11916 raft_consensus.cc:2243] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.155045 11916 raft_consensus.cc:2272] T 0ace82e19711478ca00a6a56c680068e P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.157397 11916 tablet_replica.cc:333] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d: stopping tablet replica
I20260709 12:23:09.157892 11916 raft_consensus.cc:2243] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.158397 11916 raft_consensus.cc:2272] T 48a238fdc89e4dcdb85b6a539480cf42 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.161322 11916 tablet_replica.cc:333] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d: stopping tablet replica
I20260709 12:23:09.161823 11916 raft_consensus.cc:2243] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.162969 11916 raft_consensus.cc:2272] T 9c68c745025847329ecc9b974a3d49a1 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.165493 11916 tablet_replica.cc:333] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d: stopping tablet replica
I20260709 12:23:09.165978 11916 raft_consensus.cc:2243] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.166564 11916 raft_consensus.cc:2272] T 97632f21e76f4fea967399bdb6315eaf P 106d5430f7134b50969e552dd855308d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.169006 11916 tablet_replica.cc:333] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d: stopping tablet replica
I20260709 12:23:09.169482 11916 raft_consensus.cc:2243] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.170307 11916 raft_consensus.cc:2272] T e011141c23994d459c3cc61f3a996174 P 106d5430f7134b50969e552dd855308d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.174103 11916 tablet_replica.cc:333] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d: stopping tablet replica
I20260709 12:23:09.174599 11916 raft_consensus.cc:2243] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.175046 11916 raft_consensus.cc:2272] T bfadb3ce5f1f45f0adb2dd7890737094 P 106d5430f7134b50969e552dd855308d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:09.198849 21251 consensus_peers.cc:597] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:09.200214 21250 consensus_peers.cc:597] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 106d5430f7134b50969e552dd855308d (127.11.163.2:39363): Couldn't send request to peer 106d5430f7134b50969e552dd855308d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:09.200747 21251 consensus_peers.cc:597] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 -> Peer 222454fb0cb046ccb3f6d15aa35fd869 (127.11.163.1:43827): Couldn't send request to peer 222454fb0cb046ccb3f6d15aa35fd869. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.216747 11916 tablet_server.cc:196] TabletServer@127.11.163.2:0 shutdown complete.
I20260709 12:23:09.246872 11916 tablet_server.cc:179] TabletServer@127.11.163.3:0 shutting down...
I20260709 12:23:09.276312 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:09.277045 11916 tablet_replica.cc:333] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7: stopping tablet replica
I20260709 12:23:09.277786 11916 raft_consensus.cc:2243] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.278370 11916 raft_consensus.cc:2272] T 9c68c745025847329ecc9b974a3d49a1 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.280952 11916 tablet_replica.cc:333] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7: stopping tablet replica
I20260709 12:23:09.281648 11916 raft_consensus.cc:2243] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.282213 11916 raft_consensus.cc:2272] T 226c214fa28b43488c817dcc97e88ebc P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.284708 11916 tablet_replica.cc:333] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7: stopping tablet replica
I20260709 12:23:09.285280 11916 raft_consensus.cc:2243] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.285802 11916 raft_consensus.cc:2272] T 397fe6fe912a495bb0077b0f9f1281d4 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.288271 11916 tablet_replica.cc:333] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7: stopping tablet replica
I20260709 12:23:09.288810 11916 raft_consensus.cc:2243] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.289798 11916 raft_consensus.cc:2272] T 0ace82e19711478ca00a6a56c680068e P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.292047 11916 tablet_replica.cc:333] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7: stopping tablet replica
I20260709 12:23:09.292623 11916 raft_consensus.cc:2243] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.293726 11916 raft_consensus.cc:2272] T 48a238fdc89e4dcdb85b6a539480cf42 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.296185 11916 tablet_replica.cc:333] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7: stopping tablet replica
I20260709 12:23:09.296757 11916 raft_consensus.cc:2243] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.297267 11916 raft_consensus.cc:2272] T f9d9f3b4f37c40f79fa03d8356aa946e P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.299372 11916 tablet_replica.cc:333] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7: stopping tablet replica
I20260709 12:23:09.299991 11916 raft_consensus.cc:2243] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.300971 11916 raft_consensus.cc:2272] T 3fa4ccaa51f6450283cdf3a3ce681842 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.304322 11916 tablet_replica.cc:333] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7: stopping tablet replica
I20260709 12:23:09.304893 11916 raft_consensus.cc:2243] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.305933 11916 raft_consensus.cc:2272] T 97632f21e76f4fea967399bdb6315eaf P 8042cf42fb224a24aac0db5007ffb2e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.308221 11916 tablet_replica.cc:333] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7: stopping tablet replica
I20260709 12:23:09.308759 11916 raft_consensus.cc:2243] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.309285 11916 raft_consensus.cc:2272] T e011141c23994d459c3cc61f3a996174 P 8042cf42fb224a24aac0db5007ffb2e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.312939 11916 tablet_replica.cc:333] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7: stopping tablet replica
I20260709 12:23:09.313457 11916 raft_consensus.cc:2243] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.314339 11916 raft_consensus.cc:2272] T bfadb3ce5f1f45f0adb2dd7890737094 P 8042cf42fb224a24aac0db5007ffb2e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.353014 11916 tablet_server.cc:196] TabletServer@127.11.163.3:0 shutdown complete.
I20260709 12:23:09.382735 11916 master.cc:562] Master@127.11.163.62:36937 shutting down...
I20260709 12:23:09.408203 11916 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.408939 11916 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.409305 11916 tablet_replica.cc:333] T 00000000000000000000000000000000 P c320fad0592c4ca4ab87a166d6bf4b45: stopping tablet replica
I20260709 12:23:09.430572 11916 master.cc:584] Master@127.11.163.62:36937 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12888 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:23:09.476699 11916 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.163.62:41065
I20260709 12:23:09.477981 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:09.484092 21612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.484097 21613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.485523 21615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:09.487061 11916 server_base.cc:1061] running on GCE node
I20260709 12:23:09.487984 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:09.488165 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:09.488279 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599789488269 us; error 0 us; skew 500 ppm
I20260709 12:23:09.488773 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:09.491067 11916 webserver.cc:533] Webserver started at http://127.11.163.62:33299/ using document root <none> and password file <none>
I20260709 12:23:09.491616 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:09.491786 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:09.492005 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:09.493188 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/master-0-root/instance:
uuid: "d52a4979bcc944c1ba0236ef3567a18b"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-z9f9"
I20260709 12:23:09.497849 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:09.501535 21620 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.502395 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:09.502722 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/master-0-root
uuid: "d52a4979bcc944c1ba0236ef3567a18b"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-z9f9"
I20260709 12:23:09.503031 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:09.521796 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:09.523051 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:09.562644 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.62:41065
I20260709 12:23:09.562785 21672 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.62:41065 every 8 connection(s)
I20260709 12:23:09.566910 21673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:09.581095 21673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b: Bootstrap starting.
I20260709 12:23:09.586280 21673 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.590960 21673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b: No bootstrap required, opened a new log
I20260709 12:23:09.593647 21673 raft_consensus.cc:359] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a4979bcc944c1ba0236ef3567a18b" member_type: VOTER }
I20260709 12:23:09.594199 21673 raft_consensus.cc:385] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.594449 21673 raft_consensus.cc:740] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d52a4979bcc944c1ba0236ef3567a18b, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.595182 21673 consensus_queue.cc:260] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a4979bcc944c1ba0236ef3567a18b" member_type: VOTER }
I20260709 12:23:09.595765 21673 raft_consensus.cc:399] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:09.596035 21673 raft_consensus.cc:493] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:09.596359 21673 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.602035 21673 raft_consensus.cc:515] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a4979bcc944c1ba0236ef3567a18b" member_type: VOTER }
I20260709 12:23:09.602703 21673 leader_election.cc:304] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d52a4979bcc944c1ba0236ef3567a18b; no voters: 
I20260709 12:23:09.603928 21673 leader_election.cc:290] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:09.604362 21676 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.605832 21676 raft_consensus.cc:697] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [term 1 LEADER]: Becoming Leader. State: Replica: d52a4979bcc944c1ba0236ef3567a18b, State: Running, Role: LEADER
I20260709 12:23:09.606492 21676 consensus_queue.cc:237] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a4979bcc944c1ba0236ef3567a18b" member_type: VOTER }
I20260709 12:23:09.607420 21673 sys_catalog.cc:565] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:09.614292 21678 sys_catalog.cc:455] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d52a4979bcc944c1ba0236ef3567a18b. Latest consensus state: current_term: 1 leader_uuid: "d52a4979bcc944c1ba0236ef3567a18b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a4979bcc944c1ba0236ef3567a18b" member_type: VOTER } }
I20260709 12:23:09.614869 21678 sys_catalog.cc:458] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:09.615737 21677 sys_catalog.cc:455] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d52a4979bcc944c1ba0236ef3567a18b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52a4979bcc944c1ba0236ef3567a18b" member_type: VOTER } }
I20260709 12:23:09.616521 21677 sys_catalog.cc:458] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:09.617848 21685 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:09.626610 21685 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:09.627765 11916 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:09.636493 21685 catalog_manager.cc:1383] Generated new cluster ID: 9d570928f6cb441fbb85bc51792e1028
I20260709 12:23:09.636839 21685 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:09.657042 21685 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:09.658394 21685 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:09.674060 21685 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b: Generated new TSK 0
I20260709 12:23:09.674729 21685 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:09.694352 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:09.700603 21694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.701949 21695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:09.703758 11916 server_base.cc:1061] running on GCE node
W20260709 12:23:09.703567 21697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:09.705003 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:09.705196 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:09.705418 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599789705400 us; error 0 us; skew 500 ppm
I20260709 12:23:09.705977 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:09.708356 11916 webserver.cc:533] Webserver started at http://127.11.163.1:39051/ using document root <none> and password file <none>
I20260709 12:23:09.708946 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:09.709148 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:09.709431 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:09.710565 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-0-root/instance:
uuid: "c6a299caffcb41e1a0b3dc8016674c36"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-z9f9"
I20260709 12:23:09.715206 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:23:09.718664 21702 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.719753 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:09.720113 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-0-root
uuid: "c6a299caffcb41e1a0b3dc8016674c36"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-z9f9"
I20260709 12:23:09.720466 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:09.747551 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:09.748934 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:09.750504 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:09.752974 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:09.753225 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.753500 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:09.753723 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.798833 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.1:34193
I20260709 12:23:09.798942 21765 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.1:34193 every 8 connection(s)
I20260709 12:23:09.804260 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:09.812651 21770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.815030 21771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:09.816155 11916 server_base.cc:1061] running on GCE node
W20260709 12:23:09.816380 21773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:09.817683 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:09.817963 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:09.818185 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599789818167 us; error 0 us; skew 500 ppm
I20260709 12:23:09.818887 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:09.819000 21766 heartbeater.cc:344] Connected to a master server at 127.11.163.62:41065
I20260709 12:23:09.819550 21766 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:09.820515 21766 heartbeater.cc:507] Master 127.11.163.62:41065 requested a full tablet report, sending...
I20260709 12:23:09.821657 11916 webserver.cc:533] Webserver started at http://127.11.163.2:38149/ using document root <none> and password file <none>
I20260709 12:23:09.822378 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:09.822625 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:09.822983 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:09.823019 21638 ts_manager.cc:194] Registered new tserver with Master: c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1:34193)
I20260709 12:23:09.824788 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-1-root/instance:
uuid: "ea5152ccc7b54049908b1333b66cfc2f"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-z9f9"
I20260709 12:23:09.825691 21638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48508
I20260709 12:23:09.830185 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:23:09.833992 21778 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.834766 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:09.835072 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-1-root
uuid: "ea5152ccc7b54049908b1333b66cfc2f"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-z9f9"
I20260709 12:23:09.835350 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:09.845656 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:09.846870 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:09.848326 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:09.850462 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:09.850692 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.850930 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:09.851117 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.892261 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.2:35193
I20260709 12:23:09.892371 21840 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.2:35193 every 8 connection(s)
I20260709 12:23:09.897317 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:09.904742 21844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.906004 21845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.908769 21848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:09.909885 11916 server_base.cc:1061] running on GCE node
I20260709 12:23:09.911047 21841 heartbeater.cc:344] Connected to a master server at 127.11.163.62:41065
I20260709 12:23:09.911077 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:09.911666 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:09.911718 21841 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:09.911955 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599789911934 us; error 0 us; skew 500 ppm
I20260709 12:23:09.912720 21841 heartbeater.cc:507] Master 127.11.163.62:41065 requested a full tablet report, sending...
I20260709 12:23:09.912839 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:09.915289 21638 ts_manager.cc:194] Registered new tserver with Master: ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193)
I20260709 12:23:09.915896 11916 webserver.cc:533] Webserver started at http://127.11.163.3:34297/ using document root <none> and password file <none>
I20260709 12:23:09.916463 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:09.916682 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:09.916956 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:09.916950 21638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48518
I20260709 12:23:09.918720 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-2-root/instance:
uuid: "d45cee1af84c4cd3a5167ce0cc1ced24"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-z9f9"
I20260709 12:23:09.923825 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:09.927336 21853 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.928265 11916 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:23:09.928591 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-2-root
uuid: "d45cee1af84c4cd3a5167ce0cc1ced24"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-z9f9"
I20260709 12:23:09.928864 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599438829268-11916-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:09.940562 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:09.941728 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:09.943130 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:09.945379 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:09.945612 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.945851 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:09.946053 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.988837 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.3:37093
I20260709 12:23:09.988953 21915 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.3:37093 every 8 connection(s)
I20260709 12:23:10.004316 21916 heartbeater.cc:344] Connected to a master server at 127.11.163.62:41065
I20260709 12:23:10.004904 21916 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:10.005753 21916 heartbeater.cc:507] Master 127.11.163.62:41065 requested a full tablet report, sending...
I20260709 12:23:10.008035 21638 ts_manager.cc:194] Registered new tserver with Master: d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093)
I20260709 12:23:10.008842 11916 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016392359s
I20260709 12:23:10.009996 21638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48528
I20260709 12:23:10.035602 21638 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48530:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:10.037767 21638 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:10.087136 21730 tablet_service.cc:1511] Processing CreateTablet for tablet 40d1b0a0f2154e0686becf745ed6402d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53f2c21992374341a9dc76a32db2a9a7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:10.087685 21731 tablet_service.cc:1511] Processing CreateTablet for tablet 22591a8c91e64120b68be49073288cd6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53f2c21992374341a9dc76a32db2a9a7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:10.089195 21730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d1b0a0f2154e0686becf745ed6402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.089972 21731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22591a8c91e64120b68be49073288cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.092687 21880 tablet_service.cc:1511] Processing CreateTablet for tablet 40d1b0a0f2154e0686becf745ed6402d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53f2c21992374341a9dc76a32db2a9a7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:10.094170 21880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d1b0a0f2154e0686becf745ed6402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.096479 21881 tablet_service.cc:1511] Processing CreateTablet for tablet 22591a8c91e64120b68be49073288cd6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53f2c21992374341a9dc76a32db2a9a7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:10.097898 21881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22591a8c91e64120b68be49073288cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.115142 21931 tablet_bootstrap.cc:492] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36: Bootstrap starting.
I20260709 12:23:10.121078 21932 tablet_bootstrap.cc:492] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24: Bootstrap starting.
I20260709 12:23:10.125475 21931 tablet_bootstrap.cc:654] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.129333 21932 tablet_bootstrap.cc:654] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.130931 21806 tablet_service.cc:1511] Processing CreateTablet for tablet 22591a8c91e64120b68be49073288cd6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53f2c21992374341a9dc76a32db2a9a7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:10.131489 21931 tablet_bootstrap.cc:492] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36: No bootstrap required, opened a new log
I20260709 12:23:10.132193 21931 ts_tablet_manager.cc:1403] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.009s
I20260709 12:23:10.132364 21806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22591a8c91e64120b68be49073288cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.134861 21805 tablet_service.cc:1511] Processing CreateTablet for tablet 40d1b0a0f2154e0686becf745ed6402d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53f2c21992374341a9dc76a32db2a9a7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:10.136265 21805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d1b0a0f2154e0686becf745ed6402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.136742 21931 raft_consensus.cc:359] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.137995 21931 raft_consensus.cc:385] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.138412 21931 raft_consensus.cc:740] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a299caffcb41e1a0b3dc8016674c36, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.139498 21931 consensus_queue.cc:260] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.141106 21932 tablet_bootstrap.cc:492] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24: No bootstrap required, opened a new log
I20260709 12:23:10.141825 21932 ts_tablet_manager.cc:1403] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:23:10.146095 21932 raft_consensus.cc:359] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.146996 21932 raft_consensus.cc:385] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.147305 21932 raft_consensus.cc:740] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45cee1af84c4cd3a5167ce0cc1ced24, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.148383 21932 consensus_queue.cc:260] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.149035 21931 ts_tablet_manager.cc:1434] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.002s
I20260709 12:23:10.150005 21766 heartbeater.cc:499] Master 127.11.163.62:41065 was elected leader, sending a full tablet report...
I20260709 12:23:10.150413 21931 tablet_bootstrap.cc:492] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36: Bootstrap starting.
I20260709 12:23:10.157840 21931 tablet_bootstrap.cc:654] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.162127 21936 tablet_bootstrap.cc:492] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f: Bootstrap starting.
I20260709 12:23:10.162945 21916 heartbeater.cc:499] Master 127.11.163.62:41065 was elected leader, sending a full tablet report...
I20260709 12:23:10.164928 21932 ts_tablet_manager.cc:1434] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:23:10.166016 21932 tablet_bootstrap.cc:492] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24: Bootstrap starting.
I20260709 12:23:10.171574 21932 tablet_bootstrap.cc:654] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.173631 21931 tablet_bootstrap.cc:492] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36: No bootstrap required, opened a new log
I20260709 12:23:10.173674 21936 tablet_bootstrap.cc:654] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.174348 21931 ts_tablet_manager.cc:1403] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:23:10.178862 21931 raft_consensus.cc:359] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } } peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } }
I20260709 12:23:10.179595 21931 raft_consensus.cc:385] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.179924 21931 raft_consensus.cc:740] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a299caffcb41e1a0b3dc8016674c36, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.180986 21932 tablet_bootstrap.cc:492] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24: No bootstrap required, opened a new log
I20260709 12:23:10.180768 21931 consensus_queue.cc:260] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } } peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } }
I20260709 12:23:10.181550 21932 ts_tablet_manager.cc:1403] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.009s
I20260709 12:23:10.181646 21936 tablet_bootstrap.cc:492] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f: No bootstrap required, opened a new log
I20260709 12:23:10.182230 21936 ts_tablet_manager.cc:1403] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 12:23:10.183203 21931 ts_tablet_manager.cc:1434] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:23:10.184679 21932 raft_consensus.cc:359] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } } peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } }
I20260709 12:23:10.185339 21932 raft_consensus.cc:385] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.185794 21932 raft_consensus.cc:740] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45cee1af84c4cd3a5167ce0cc1ced24, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.185235 21936 raft_consensus.cc:359] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } } peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } }
I20260709 12:23:10.186554 21936 raft_consensus.cc:385] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.186882 21936 raft_consensus.cc:740] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5152ccc7b54049908b1333b66cfc2f, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.186739 21932 consensus_queue.cc:260] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } } peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } }
I20260709 12:23:10.188488 21936 consensus_queue.cc:260] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } } peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } }
I20260709 12:23:10.189500 21932 ts_tablet_manager.cc:1434] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:10.196244 21936 ts_tablet_manager.cc:1434] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.008s
I20260709 12:23:10.196321 21841 heartbeater.cc:499] Master 127.11.163.62:41065 was elected leader, sending a full tablet report...
I20260709 12:23:10.197552 21936 tablet_bootstrap.cc:492] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f: Bootstrap starting.
I20260709 12:23:10.203305 21936 tablet_bootstrap.cc:654] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.208194 21936 tablet_bootstrap.cc:492] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f: No bootstrap required, opened a new log
I20260709 12:23:10.208583 21936 ts_tablet_manager.cc:1403] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:23:10.210978 21936 raft_consensus.cc:359] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.211609 21936 raft_consensus.cc:385] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.211815 21936 raft_consensus.cc:740] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5152ccc7b54049908b1333b66cfc2f, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.212493 21936 consensus_queue.cc:260] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.214483 21936 ts_tablet_manager.cc:1434] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:10.236914 21935 raft_consensus.cc:493] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.237470 21935 raft_consensus.cc:515] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.239787 21935 leader_election.cc:290] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193), d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093)
I20260709 12:23:10.249251 21816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d1b0a0f2154e0686becf745ed6402d" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5152ccc7b54049908b1333b66cfc2f" is_pre_election: true
I20260709 12:23:10.250052 21816 raft_consensus.cc:2468] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 0.
I20260709 12:23:10.251391 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d1b0a0f2154e0686becf745ed6402d" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" is_pre_election: true
I20260709 12:23:10.251497 21704 leader_election.cc:304] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a299caffcb41e1a0b3dc8016674c36, ea5152ccc7b54049908b1333b66cfc2f; no voters: 
I20260709 12:23:10.252257 21891 raft_consensus.cc:2468] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 0.
I20260709 12:23:10.252447 21935 raft_consensus.cc:2804] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.252853 21935 raft_consensus.cc:493] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.253193 21935 raft_consensus.cc:3060] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.258996 21935 raft_consensus.cc:515] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.260674 21935 leader_election.cc:290] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 election: Requested vote from peers ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193), d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093)
I20260709 12:23:10.261766 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d1b0a0f2154e0686becf745ed6402d" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24"
I20260709 12:23:10.261690 21816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d1b0a0f2154e0686becf745ed6402d" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5152ccc7b54049908b1333b66cfc2f"
I20260709 12:23:10.262547 21891 raft_consensus.cc:3060] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.262590 21816 raft_consensus.cc:3060] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.271008 21816 raft_consensus.cc:2468] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 1.
I20260709 12:23:10.271008 21891 raft_consensus.cc:2468] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 1.
I20260709 12:23:10.272496 21704 leader_election.cc:304] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a299caffcb41e1a0b3dc8016674c36, ea5152ccc7b54049908b1333b66cfc2f; no voters: 
I20260709 12:23:10.273242 21935 raft_consensus.cc:2804] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.274402 21935 raft_consensus.cc:697] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Becoming Leader. State: Replica: c6a299caffcb41e1a0b3dc8016674c36, State: Running, Role: LEADER
I20260709 12:23:10.275229 21935 consensus_queue.cc:237] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.283349 21636 catalog_manager.cc:5697] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "c6a299caffcb41e1a0b3dc8016674c36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.405539 21935 raft_consensus.cc:493] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.406147 21935 raft_consensus.cc:515] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } } peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } }
I20260709 12:23:10.407992 21935 leader_election.cc:290] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093), ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193)
I20260709 12:23:10.408974 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22591a8c91e64120b68be49073288cd6" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" is_pre_election: true
I20260709 12:23:10.409159 21816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22591a8c91e64120b68be49073288cd6" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5152ccc7b54049908b1333b66cfc2f" is_pre_election: true
I20260709 12:23:10.409765 21891 raft_consensus.cc:2468] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 0.
I20260709 12:23:10.410022 21816 raft_consensus.cc:2468] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 0.
I20260709 12:23:10.411211 21703 leader_election.cc:304] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a299caffcb41e1a0b3dc8016674c36, d45cee1af84c4cd3a5167ce0cc1ced24; no voters: 
I20260709 12:23:10.412108 21935 raft_consensus.cc:2804] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.412416 21935 raft_consensus.cc:493] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.412709 21935 raft_consensus.cc:3060] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.418087 21935 raft_consensus.cc:515] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } } peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } }
I20260709 12:23:10.419924 21935 leader_election.cc:290] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 election: Requested vote from peers d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093), ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193)
I20260709 12:23:10.420709 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22591a8c91e64120b68be49073288cd6" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24"
I20260709 12:23:10.420929 21816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22591a8c91e64120b68be49073288cd6" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5152ccc7b54049908b1333b66cfc2f"
I20260709 12:23:10.421387 21891 raft_consensus.cc:3060] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.421455 21816 raft_consensus.cc:3060] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.428845 21816 raft_consensus.cc:2468] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 1.
I20260709 12:23:10.428845 21891 raft_consensus.cc:2468] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 1.
I20260709 12:23:10.430294 21704 leader_election.cc:304] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a299caffcb41e1a0b3dc8016674c36, ea5152ccc7b54049908b1333b66cfc2f; no voters: 
I20260709 12:23:10.431025 21935 raft_consensus.cc:2804] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.431520 21935 raft_consensus.cc:697] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Becoming Leader. State: Replica: c6a299caffcb41e1a0b3dc8016674c36, State: Running, Role: LEADER
I20260709 12:23:10.432307 21935 consensus_queue.cc:237] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } } peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } }
I20260709 12:23:10.439778 21636 catalog_manager.cc:5697] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "c6a299caffcb41e1a0b3dc8016674c36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.488060 21636 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48538:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:10.490199 21636 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:10.516467 21731 tablet_service.cc:1511] Processing CreateTablet for tablet edf52f122f84407fb812799e6134927c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6992365a91b34b91897113568aad9b49]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:10.517760 21731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf52f122f84407fb812799e6134927c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.517860 21806 tablet_service.cc:1511] Processing CreateTablet for tablet edf52f122f84407fb812799e6134927c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6992365a91b34b91897113568aad9b49]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:10.519163 21806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf52f122f84407fb812799e6134927c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.519675 21880 tablet_service.cc:1511] Processing CreateTablet for tablet edf52f122f84407fb812799e6134927c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6992365a91b34b91897113568aad9b49]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:10.520876 21880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf52f122f84407fb812799e6134927c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.529347 21730 tablet_service.cc:1511] Processing CreateTablet for tablet d1c6875e1ff948dba4a58670292c9ff0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6992365a91b34b91897113568aad9b49]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:10.530768 21730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c6875e1ff948dba4a58670292c9ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.532189 21805 tablet_service.cc:1511] Processing CreateTablet for tablet d1c6875e1ff948dba4a58670292c9ff0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6992365a91b34b91897113568aad9b49]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:10.533586 21805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c6875e1ff948dba4a58670292c9ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.534878 21931 tablet_bootstrap.cc:492] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36: Bootstrap starting.
I20260709 12:23:10.538337 21932 tablet_bootstrap.cc:492] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24: Bootstrap starting.
I20260709 12:23:10.541339 21931 tablet_bootstrap.cc:654] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.545912 21881 tablet_service.cc:1511] Processing CreateTablet for tablet d1c6875e1ff948dba4a58670292c9ff0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6992365a91b34b91897113568aad9b49]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:10.547305 21881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c6875e1ff948dba4a58670292c9ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.560304 21932 tablet_bootstrap.cc:654] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.564644 21936 tablet_bootstrap.cc:492] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f: Bootstrap starting.
I20260709 12:23:10.567514 21932 tablet_bootstrap.cc:492] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24: No bootstrap required, opened a new log
I20260709 12:23:10.568081 21932 ts_tablet_manager.cc:1403] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.008s
I20260709 12:23:10.569223 21931 tablet_bootstrap.cc:492] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36: No bootstrap required, opened a new log
I20260709 12:23:10.569792 21931 ts_tablet_manager.cc:1403] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.010s
I20260709 12:23:10.571121 21932 raft_consensus.cc:359] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.571923 21932 raft_consensus.cc:385] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.572225 21932 raft_consensus.cc:740] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45cee1af84c4cd3a5167ce0cc1ced24, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.572595 21936 tablet_bootstrap.cc:654] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.572888 21931 raft_consensus.cc:359] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.573154 21932 consensus_queue.cc:260] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.573688 21931 raft_consensus.cc:385] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.574913 21931 raft_consensus.cc:740] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a299caffcb41e1a0b3dc8016674c36, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.575911 21931 consensus_queue.cc:260] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.578214 21932 ts_tablet_manager.cc:1434] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:23:10.578214 21931 ts_tablet_manager.cc:1434] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:10.579396 21932 tablet_bootstrap.cc:492] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24: Bootstrap starting.
I20260709 12:23:10.581820 21931 tablet_bootstrap.cc:492] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36: Bootstrap starting.
I20260709 12:23:10.585523 21935 raft_consensus.cc:493] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.586098 21935 raft_consensus.cc:515] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.586982 21932 tablet_bootstrap.cc:654] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.589152 21935 leader_election.cc:290] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193), d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093)
I20260709 12:23:10.589761 21816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf52f122f84407fb812799e6134927c" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5152ccc7b54049908b1333b66cfc2f" is_pre_election: true
I20260709 12:23:10.592628 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf52f122f84407fb812799e6134927c" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" is_pre_election: true
I20260709 12:23:10.593526 21891 raft_consensus.cc:2468] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 0.
I20260709 12:23:10.593992 21936 tablet_bootstrap.cc:492] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f: No bootstrap required, opened a new log
W20260709 12:23:10.591135 21704 leader_election.cc:343] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.594515 21936 ts_tablet_manager.cc:1403] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 12:23:10.595212 21703 leader_election.cc:304] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a299caffcb41e1a0b3dc8016674c36, d45cee1af84c4cd3a5167ce0cc1ced24; no voters: ea5152ccc7b54049908b1333b66cfc2f
I20260709 12:23:10.597028 21935 raft_consensus.cc:2804] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.597400 21935 raft_consensus.cc:493] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.597761 21935 raft_consensus.cc:3060] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.600708 21936 raft_consensus.cc:359] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.596051 21931 tablet_bootstrap.cc:654] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.601990 21936 raft_consensus.cc:385] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.602566 21936 raft_consensus.cc:740] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5152ccc7b54049908b1333b66cfc2f, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.603596 21936 consensus_queue.cc:260] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.605854 21936 ts_tablet_manager.cc:1434] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:10.606976 21936 tablet_bootstrap.cc:492] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f: Bootstrap starting.
I20260709 12:23:10.618937 21935 raft_consensus.cc:515] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
W20260709 12:23:10.620441 21686 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:10.621577 21931 tablet_bootstrap.cc:492] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36: No bootstrap required, opened a new log
I20260709 12:23:10.622319 21816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf52f122f84407fb812799e6134927c" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5152ccc7b54049908b1333b66cfc2f"
I20260709 12:23:10.623553 21935 leader_election.cc:290] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 election: Requested vote from peers ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193), d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093)
I20260709 12:23:10.623924 21931 ts_tablet_manager.cc:1403] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.012s
I20260709 12:23:10.624756 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf52f122f84407fb812799e6134927c" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24"
I20260709 12:23:10.625784 21891 raft_consensus.cc:3060] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.627548 21936 tablet_bootstrap.cc:654] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.628566 21931 raft_consensus.cc:359] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.629324 21931 raft_consensus.cc:385] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.629608 21931 raft_consensus.cc:740] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a299caffcb41e1a0b3dc8016674c36, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.630434 21931 consensus_queue.cc:260] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
W20260709 12:23:10.624855 21704 leader_election.cc:343] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.632853 21931 ts_tablet_manager.cc:1434] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:10.633387 21936 tablet_bootstrap.cc:492] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f: No bootstrap required, opened a new log
I20260709 12:23:10.634006 21936 ts_tablet_manager.cc:1403] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.004s
I20260709 12:23:10.635872 21941 raft_consensus.cc:493] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.636446 21941 raft_consensus.cc:515] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.637485 21936 raft_consensus.cc:359] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.638054 21891 raft_consensus.cc:2468] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 1.
I20260709 12:23:10.638379 21936 raft_consensus.cc:385] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.638818 21936 raft_consensus.cc:740] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5152ccc7b54049908b1333b66cfc2f, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.639211 21703 leader_election.cc:304] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a299caffcb41e1a0b3dc8016674c36, d45cee1af84c4cd3a5167ce0cc1ced24; no voters: ea5152ccc7b54049908b1333b66cfc2f
I20260709 12:23:10.639829 21936 consensus_queue.cc:260] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.641323 21935 raft_consensus.cc:2804] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.641942 21935 raft_consensus.cc:697] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Becoming Leader. State: Replica: c6a299caffcb41e1a0b3dc8016674c36, State: Running, Role: LEADER
I20260709 12:23:10.642884 21935 consensus_queue.cc:237] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.623569 21932 tablet_bootstrap.cc:492] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24: No bootstrap required, opened a new log
I20260709 12:23:10.644639 21932 ts_tablet_manager.cc:1403] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.004s
I20260709 12:23:10.648422 21941 leader_election.cc:290] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1:34193), d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093)
I20260709 12:23:10.649850 21932 raft_consensus.cc:359] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.650683 21932 raft_consensus.cc:385] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.650976 21932 raft_consensus.cc:740] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45cee1af84c4cd3a5167ce0cc1ced24, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.651970 21932 consensus_queue.cc:260] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.659090 21932 ts_tablet_manager.cc:1434] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:23:10.660807 21938 raft_consensus.cc:493] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.661458 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c6875e1ff948dba4a58670292c9ff0" candidate_uuid: "ea5152ccc7b54049908b1333b66cfc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" is_pre_election: true
I20260709 12:23:10.661392 21938 raft_consensus.cc:515] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.662485 21891 raft_consensus.cc:2468] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5152ccc7b54049908b1333b66cfc2f in term 0.
I20260709 12:23:10.663954 21779 leader_election.cc:304] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45cee1af84c4cd3a5167ce0cc1ced24, ea5152ccc7b54049908b1333b66cfc2f; no voters: 
I20260709 12:23:10.664211 21938 leader_election.cc:290] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1:34193), ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193)
I20260709 12:23:10.664819 21941 raft_consensus.cc:2804] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.669675 21941 raft_consensus.cc:493] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.670181 21941 raft_consensus.cc:3060] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.687785 21816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c6875e1ff948dba4a58670292c9ff0" candidate_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5152ccc7b54049908b1333b66cfc2f" is_pre_election: true
I20260709 12:23:10.695303 21941 raft_consensus.cc:515] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.696700 21816 raft_consensus.cc:2393] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d45cee1af84c4cd3a5167ce0cc1ced24 in current term 1: Already voted for candidate ea5152ccc7b54049908b1333b66cfc2f in this term.
I20260709 12:23:10.700599 21936 ts_tablet_manager.cc:1434] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f: Time spent starting tablet: real 0.066s	user 0.014s	sys 0.021s
I20260709 12:23:10.701098 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c6875e1ff948dba4a58670292c9ff0" candidate_uuid: "ea5152ccc7b54049908b1333b66cfc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a299caffcb41e1a0b3dc8016674c36" is_pre_election: true
I20260709 12:23:10.701853 21941 leader_election.cc:290] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [CANDIDATE]: Term 1 election: Requested vote from peers c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1:34193), d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093)
I20260709 12:23:10.701932 21741 raft_consensus.cc:2468] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5152ccc7b54049908b1333b66cfc2f in term 0.
I20260709 12:23:10.702499 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c6875e1ff948dba4a58670292c9ff0" candidate_uuid: "ea5152ccc7b54049908b1333b66cfc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24"
I20260709 12:23:10.703148 21891 raft_consensus.cc:3060] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.707927 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c6875e1ff948dba4a58670292c9ff0" candidate_uuid: "ea5152ccc7b54049908b1333b66cfc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a299caffcb41e1a0b3dc8016674c36"
I20260709 12:23:10.708621 21741 raft_consensus.cc:3060] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.711153 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c6875e1ff948dba4a58670292c9ff0" candidate_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a299caffcb41e1a0b3dc8016674c36" is_pre_election: true
I20260709 12:23:10.711954 21891 raft_consensus.cc:2468] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5152ccc7b54049908b1333b66cfc2f in term 1.
I20260709 12:23:10.713281 21779 leader_election.cc:304] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45cee1af84c4cd3a5167ce0cc1ced24, ea5152ccc7b54049908b1333b66cfc2f; no voters: 
I20260709 12:23:10.713383 21855 leader_election.cc:304] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45cee1af84c4cd3a5167ce0cc1ced24; no voters: c6a299caffcb41e1a0b3dc8016674c36, ea5152ccc7b54049908b1333b66cfc2f
I20260709 12:23:10.714236 21941 raft_consensus.cc:2804] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.714473 21938 raft_consensus.cc:2749] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.713672 21638 catalog_manager.cc:5697] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "c6a299caffcb41e1a0b3dc8016674c36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.715600 21941 raft_consensus.cc:697] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 1 LEADER]: Becoming Leader. State: Replica: ea5152ccc7b54049908b1333b66cfc2f, State: Running, Role: LEADER
I20260709 12:23:10.716511 21941 consensus_queue.cc:237] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.716986 21741 raft_consensus.cc:2468] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5152ccc7b54049908b1333b66cfc2f in term 1.
I20260709 12:23:10.725550 21636 catalog_manager.cc:5697] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2). New cstate: current_term: 1 leader_uuid: "ea5152ccc7b54049908b1333b66cfc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.758998 21741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40d1b0a0f2154e0686becf745ed6402d"
dest_uuid: "c6a299caffcb41e1a0b3dc8016674c36"
mode: GRACEFUL
new_leader_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24"
 from {username='slave'} at 127.0.0.1:60754
I20260709 12:23:10.759673 21741 raft_consensus.cc:606] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Received request to transfer leadership to TS d45cee1af84c4cd3a5167ce0cc1ced24
I20260709 12:23:10.777040 21816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1c6875e1ff948dba4a58670292c9ff0"
dest_uuid: "ea5152ccc7b54049908b1333b66cfc2f"
mode: GRACEFUL
new_leader_uuid: "c6a299caffcb41e1a0b3dc8016674c36"
 from {username='slave'} at 127.0.0.1:45872
I20260709 12:23:10.777670 21816 raft_consensus.cc:606] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 1 LEADER]: Received request to transfer leadership to TS c6a299caffcb41e1a0b3dc8016674c36
I20260709 12:23:10.781622 21941 raft_consensus.cc:493] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.782262 21941 raft_consensus.cc:515] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.784320 21941 leader_election.cc:290] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1:34193), d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093)
I20260709 12:23:10.785066 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf52f122f84407fb812799e6134927c" candidate_uuid: "ea5152ccc7b54049908b1333b66cfc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a299caffcb41e1a0b3dc8016674c36" is_pre_election: true
I20260709 12:23:10.785545 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf52f122f84407fb812799e6134927c" candidate_uuid: "ea5152ccc7b54049908b1333b66cfc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" is_pre_election: true
I20260709 12:23:10.786408 21891 raft_consensus.cc:2393] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea5152ccc7b54049908b1333b66cfc2f in current term 1: Already voted for candidate c6a299caffcb41e1a0b3dc8016674c36 in this term.
I20260709 12:23:10.787386 21779 leader_election.cc:304] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea5152ccc7b54049908b1333b66cfc2f; no voters: c6a299caffcb41e1a0b3dc8016674c36, d45cee1af84c4cd3a5167ce0cc1ced24
I20260709 12:23:10.788345 21941 raft_consensus.cc:3060] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.794708 21941 raft_consensus.cc:2749] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.835177 21935 consensus_queue.cc:1048] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.841212 21935 consensus_queue.cc:1048] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.857165 21944 consensus_queue.cc:1048] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.881989 21975 raft_consensus.cc:993] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36: : Instructing follower d45cee1af84c4cd3a5167ce0cc1ced24 to start an election
I20260709 12:23:10.882612 21969 raft_consensus.cc:1081] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Signalling peer d45cee1af84c4cd3a5167ce0cc1ced24 to start an election
I20260709 12:23:10.884490 21969 consensus_queue.cc:1048] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.909828 21891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40d1b0a0f2154e0686becf745ed6402d"
dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24"
 from {username='slave'} at 127.0.0.1:48232
I20260709 12:23:10.910651 21891 raft_consensus.cc:493] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:10.911083 21891 raft_consensus.cc:3060] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.922698 21891 raft_consensus.cc:515] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.923987 21890 raft_consensus.cc:1240] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Rejecting Update request from peer c6a299caffcb41e1a0b3dc8016674c36 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:10.926014 21891 leader_election.cc:290] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [CANDIDATE]: Term 2 election: Requested vote from peers c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1:34193), ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193)
I20260709 12:23:10.926749 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d1b0a0f2154e0686becf745ed6402d" candidate_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6a299caffcb41e1a0b3dc8016674c36"
I20260709 12:23:10.927563 21741 raft_consensus.cc:3055] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:10.926951 21815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d1b0a0f2154e0686becf745ed6402d" candidate_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea5152ccc7b54049908b1333b66cfc2f"
I20260709 12:23:10.927914 21741 raft_consensus.cc:740] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a299caffcb41e1a0b3dc8016674c36, State: Running, Role: LEADER
I20260709 12:23:10.928340 21815 raft_consensus.cc:3060] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.928766 21741 consensus_queue.cc:260] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.930100 21741 raft_consensus.cc:3060] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.936767 21815 raft_consensus.cc:2468] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45cee1af84c4cd3a5167ce0cc1ced24 in term 2.
I20260709 12:23:10.937292 21741 raft_consensus.cc:2468] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45cee1af84c4cd3a5167ce0cc1ced24 in term 2.
I20260709 12:23:10.938079 21855 leader_election.cc:304] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45cee1af84c4cd3a5167ce0cc1ced24, ea5152ccc7b54049908b1333b66cfc2f; no voters: 
I20260709 12:23:10.938921 21938 raft_consensus.cc:2804] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:10.940342 21938 raft_consensus.cc:697] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 LEADER]: Becoming Leader. State: Replica: d45cee1af84c4cd3a5167ce0cc1ced24, State: Running, Role: LEADER
I20260709 12:23:10.941118 21938 consensus_queue.cc:237] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:10.947099 21638 catalog_manager.cc:5697] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 reported cstate change: term changed from 1 to 2, leader changed from c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1) to d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.109581 21941 consensus_queue.cc:1048] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.119796 21941 consensus_queue.cc:1048] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.160276 21944 consensus_queue.cc:1048] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.182611 21981 raft_consensus.cc:993] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f: : Instructing follower c6a299caffcb41e1a0b3dc8016674c36 to start an election
I20260709 12:23:11.183336 21959 raft_consensus.cc:1081] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 1 LEADER]: Signalling peer c6a299caffcb41e1a0b3dc8016674c36 to start an election
I20260709 12:23:11.185799 21741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1c6875e1ff948dba4a58670292c9ff0"
dest_uuid: "c6a299caffcb41e1a0b3dc8016674c36"
 from {username='slave'} at 127.0.0.1:60746
I20260709 12:23:11.186517 21741 raft_consensus.cc:493] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.186908 21741 raft_consensus.cc:3060] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.200282 21741 raft_consensus.cc:515] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:11.204027 21890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c6875e1ff948dba4a58670292c9ff0" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24"
I20260709 12:23:11.204659 21890 raft_consensus.cc:3060] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.204901 21816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c6875e1ff948dba4a58670292c9ff0" candidate_uuid: "c6a299caffcb41e1a0b3dc8016674c36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea5152ccc7b54049908b1333b66cfc2f"
I20260709 12:23:11.205514 21816 raft_consensus.cc:3055] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.205869 21816 raft_consensus.cc:740] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea5152ccc7b54049908b1333b66cfc2f, State: Running, Role: LEADER
I20260709 12:23:11.206703 21816 consensus_queue.cc:260] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:11.214663 21944 consensus_queue.cc:1048] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.218822 21890 raft_consensus.cc:2468] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 2.
I20260709 12:23:11.220150 21741 leader_election.cc:290] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 2 election: Requested vote from peers ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193), d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093)
I20260709 12:23:11.223839 21703 leader_election.cc:304] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a299caffcb41e1a0b3dc8016674c36, d45cee1af84c4cd3a5167ce0cc1ced24; no voters: 
I20260709 12:23:11.225206 21969 raft_consensus.cc:2804] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.225723 21969 raft_consensus.cc:697] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 2 LEADER]: Becoming Leader. State: Replica: c6a299caffcb41e1a0b3dc8016674c36, State: Running, Role: LEADER
I20260709 12:23:11.226665 21969 consensus_queue.cc:237] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:11.465114 21741 raft_consensus.cc:1275] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 2 FOLLOWER]: Refusing update from remote peer d45cee1af84c4cd3a5167ce0cc1ced24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:11.467322 21938 consensus_queue.cc:1048] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:11.484458 21815 raft_consensus.cc:1275] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [term 2 FOLLOWER]: Refusing update from remote peer d45cee1af84c4cd3a5167ce0cc1ced24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:11.487097 21891 raft_consensus.cc:1240] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Rejecting Update request from peer ea5152ccc7b54049908b1333b66cfc2f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:23:11.494063 21816 raft_consensus.cc:3060] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.492256 21987 consensus_queue.cc:1048] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:11.498590 21638 catalog_manager.cc:5697] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 reported cstate change: term changed from 1 to 2, leader changed from ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2) to c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "c6a299caffcb41e1a0b3dc8016674c36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.501804 21816 raft_consensus.cc:2468] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a299caffcb41e1a0b3dc8016674c36 in term 2.
I20260709 12:23:11.660518 11916 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:23:11.662119 11916 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:23:11.662457 11916 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:23:11.676170 21741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edf52f122f84407fb812799e6134927c"
dest_uuid: "c6a299caffcb41e1a0b3dc8016674c36"
mode: GRACEFUL
new_leader_uuid: "ea5152ccc7b54049908b1333b66cfc2f"
 from {username='slave'} at 127.0.0.1:60764
I20260709 12:23:11.676743 21741 raft_consensus.cc:606] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Received request to transfer leadership to TS ea5152ccc7b54049908b1333b66cfc2f
I20260709 12:23:11.677940 11916 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:23:11.711748 21891 raft_consensus.cc:1275] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Refusing update from remote peer c6a299caffcb41e1a0b3dc8016674c36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:11.713122 21969 consensus_queue.cc:1048] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.724062 21816 raft_consensus.cc:1275] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 2 FOLLOWER]: Refusing update from remote peer c6a299caffcb41e1a0b3dc8016674c36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:11.725706 21969 consensus_queue.cc:1048] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:11.769954 21975 raft_consensus.cc:993] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36: : Instructing follower ea5152ccc7b54049908b1333b66cfc2f to start an election
I20260709 12:23:11.770582 21969 raft_consensus.cc:1081] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Signalling peer ea5152ccc7b54049908b1333b66cfc2f to start an election
I20260709 12:23:11.772298 21816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edf52f122f84407fb812799e6134927c"
dest_uuid: "ea5152ccc7b54049908b1333b66cfc2f"
 from {username='slave'} at 127.0.0.1:45860
I20260709 12:23:11.772931 21816 raft_consensus.cc:493] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.773267 21816 raft_consensus.cc:3060] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.780318 21816 raft_consensus.cc:515] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:11.782272 21816 leader_election.cc:290] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [CANDIDATE]: Term 2 election: Requested vote from peers c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1:34193), d45cee1af84c4cd3a5167ce0cc1ced24 (127.11.163.3:37093)
I20260709 12:23:11.783181 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf52f122f84407fb812799e6134927c" candidate_uuid: "ea5152ccc7b54049908b1333b66cfc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6a299caffcb41e1a0b3dc8016674c36"
I20260709 12:23:11.783326 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf52f122f84407fb812799e6134927c" candidate_uuid: "ea5152ccc7b54049908b1333b66cfc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24"
I20260709 12:23:11.783885 21741 raft_consensus.cc:3055] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.784000 21891 raft_consensus.cc:3060] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.784301 21741 raft_consensus.cc:740] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a299caffcb41e1a0b3dc8016674c36, State: Running, Role: LEADER
I20260709 12:23:11.785072 21741 consensus_queue.cc:260] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:11.786106 21741 raft_consensus.cc:3060] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.789534 21891 raft_consensus.cc:2468] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5152ccc7b54049908b1333b66cfc2f in term 2.
I20260709 12:23:11.790709 21779 leader_election.cc:304] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45cee1af84c4cd3a5167ce0cc1ced24, ea5152ccc7b54049908b1333b66cfc2f; no voters: 
I20260709 12:23:11.791167 21741 raft_consensus.cc:2468] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5152ccc7b54049908b1333b66cfc2f in term 2.
I20260709 12:23:11.791422 21959 raft_consensus.cc:2804] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.792012 21959 raft_consensus.cc:697] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 2 LEADER]: Becoming Leader. State: Replica: ea5152ccc7b54049908b1333b66cfc2f, State: Running, Role: LEADER
I20260709 12:23:11.792837 21959 consensus_queue.cc:237] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } }
I20260709 12:23:11.799337 21636 catalog_manager.cc:5697] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f reported cstate change: term changed from 1 to 2, leader changed from c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1) to ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2). New cstate: current_term: 2 leader_uuid: "ea5152ccc7b54049908b1333b66cfc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a299caffcb41e1a0b3dc8016674c36" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea5152ccc7b54049908b1333b66cfc2f" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 35193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45cee1af84c4cd3a5167ce0cc1ced24" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.824748 11916 tablet_server.cc:179] TabletServer@127.11.163.1:0 shutting down...
I20260709 12:23:11.848002 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:11.848794 11916 tablet_replica.cc:333] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36: stopping tablet replica
I20260709 12:23:11.849504 11916 raft_consensus.cc:2243] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.850453 11916 raft_consensus.cc:2272] T d1c6875e1ff948dba4a58670292c9ff0 P c6a299caffcb41e1a0b3dc8016674c36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.852967 11916 tablet_replica.cc:333] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36: stopping tablet replica
I20260709 12:23:11.853559 11916 raft_consensus.cc:2243] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.854025 11916 raft_consensus.cc:2272] T edf52f122f84407fb812799e6134927c P c6a299caffcb41e1a0b3dc8016674c36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.856377 11916 tablet_replica.cc:333] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36: stopping tablet replica
I20260709 12:23:11.856945 11916 raft_consensus.cc:2243] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.857795 11916 raft_consensus.cc:2272] T 22591a8c91e64120b68be49073288cd6 P c6a299caffcb41e1a0b3dc8016674c36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.860334 11916 tablet_replica.cc:333] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36: stopping tablet replica
I20260709 12:23:11.860878 11916 raft_consensus.cc:2243] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.861342 11916 raft_consensus.cc:2272] T 40d1b0a0f2154e0686becf745ed6402d P c6a299caffcb41e1a0b3dc8016674c36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.886286 11916 tablet_server.cc:196] TabletServer@127.11.163.1:0 shutdown complete.
I20260709 12:23:11.898876 11916 tablet_server.cc:179] TabletServer@127.11.163.2:0 shutting down...
W20260709 12:23:11.917879 21855 consensus_peers.cc:597] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 -> Peer c6a299caffcb41e1a0b3dc8016674c36 (127.11.163.1:34193): Couldn't send request to peer c6a299caffcb41e1a0b3dc8016674c36. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:34193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.924094 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:11.924817 11916 tablet_replica.cc:333] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f: stopping tablet replica
I20260709 12:23:11.925664 11916 raft_consensus.cc:2243] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.926703 11916 pending_rounds.cc:70] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f: Trying to abort 1 pending ops.
I20260709 12:23:11.926963 11916 pending_rounds.cc:77] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305624747190751232 op_type: NO_OP noop_request { }
I20260709 12:23:11.927315 11916 raft_consensus.cc:2889] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:11.927724 11916 raft_consensus.cc:2272] T edf52f122f84407fb812799e6134927c P ea5152ccc7b54049908b1333b66cfc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.930328 11916 tablet_replica.cc:333] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f: stopping tablet replica
I20260709 12:23:11.930914 11916 raft_consensus.cc:2243] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.931391 11916 raft_consensus.cc:2272] T d1c6875e1ff948dba4a58670292c9ff0 P ea5152ccc7b54049908b1333b66cfc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.933622 11916 tablet_replica.cc:333] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f: stopping tablet replica
I20260709 12:23:11.934194 11916 raft_consensus.cc:2243] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.934650 11916 raft_consensus.cc:2272] T 40d1b0a0f2154e0686becf745ed6402d P ea5152ccc7b54049908b1333b66cfc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.937453 11916 tablet_replica.cc:333] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f: stopping tablet replica
I20260709 12:23:11.937989 11916 raft_consensus.cc:2243] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.938448 11916 raft_consensus.cc:2272] T 22591a8c91e64120b68be49073288cd6 P ea5152ccc7b54049908b1333b66cfc2f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:11.943761 21855 consensus_peers.cc:597] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 -> Peer ea5152ccc7b54049908b1333b66cfc2f (127.11.163.2:35193): Couldn't send request to peer ea5152ccc7b54049908b1333b66cfc2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.963920 11916 tablet_server.cc:196] TabletServer@127.11.163.2:0 shutdown complete.
I20260709 12:23:11.977725 11916 tablet_server.cc:179] TabletServer@127.11.163.3:0 shutting down...
I20260709 12:23:11.997141 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:11.998164 11916 tablet_replica.cc:333] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24: stopping tablet replica
I20260709 12:23:11.998860 11916 raft_consensus.cc:2243] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.999396 11916 raft_consensus.cc:2272] T d1c6875e1ff948dba4a58670292c9ff0 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:12.002074 11916 tablet_replica.cc:333] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24: stopping tablet replica
I20260709 12:23:12.002692 11916 raft_consensus.cc:2243] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:12.003142 11916 raft_consensus.cc:2272] T edf52f122f84407fb812799e6134927c P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:12.005879 11916 tablet_replica.cc:333] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24: stopping tablet replica
I20260709 12:23:12.006428 11916 raft_consensus.cc:2243] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:12.006847 11916 raft_consensus.cc:2272] T 22591a8c91e64120b68be49073288cd6 P d45cee1af84c4cd3a5167ce0cc1ced24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:12.008795 11916 tablet_replica.cc:333] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24: stopping tablet replica
I20260709 12:23:12.009267 11916 raft_consensus.cc:2243] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:12.010072 11916 raft_consensus.cc:2272] T 40d1b0a0f2154e0686becf745ed6402d P d45cee1af84c4cd3a5167ce0cc1ced24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:12.033704 11916 tablet_server.cc:196] TabletServer@127.11.163.3:0 shutdown complete.
I20260709 12:23:12.047215 11916 master.cc:562] Master@127.11.163.62:41065 shutting down...
I20260709 12:23:12.065217 11916 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:12.065737 11916 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:12.066102 11916 tablet_replica.cc:333] T 00000000000000000000000000000000 P d52a4979bcc944c1ba0236ef3567a18b: stopping tablet replica
W20260709 12:23:12.291087 21669 debug-util.cc:398] Leaking SignalData structure 0x7b0800364960 after lost signal to thread 11919
W20260709 12:23:13.083389 11916 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21669)
W20260709 12:23:14.083997 11916 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21669)
W20260709 12:23:15.084405 11916 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 21669)
I20260709 12:23:16.102285 11916 master.cc:584] Master@127.11.163.62:41065 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (6656 ms)
[----------] 6 tests from LeaderRebalancerTest (357135 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:23:16.133338 11916 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.163.62:35441
I20260709 12:23:16.134521 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:16.139676 21996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:16.141211 21997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:16.141321 21999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:16.141683 11916 server_base.cc:1061] running on GCE node
I20260709 12:23:16.142622 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:16.142830 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:16.143009 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599796142991 us; error 0 us; skew 500 ppm
I20260709 12:23:16.143617 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:16.145884 11916 webserver.cc:533] Webserver started at http://127.11.163.62:35249/ using document root <none> and password file <none>
I20260709 12:23:16.146402 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:16.146605 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:16.146875 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:16.148010 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/master-0-root/instance:
uuid: "d135a127dc3e42b0a11ed567c60a5ea3"
format_stamp: "Formatted at 2026-07-09 12:23:16 on dist-test-slave-z9f9"
I20260709 12:23:16.152588 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:16.155925 22004 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:16.156654 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:16.156944 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/master-0-root
uuid: "d135a127dc3e42b0a11ed567c60a5ea3"
format_stamp: "Formatted at 2026-07-09 12:23:16 on dist-test-slave-z9f9"
I20260709 12:23:16.157228 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:16.176546 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:16.177631 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:16.213824 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.62:35441
I20260709 12:23:16.213928 22055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.62:35441 every 8 connection(s)
I20260709 12:23:16.217883 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.229840 22056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3: Bootstrap starting.
I20260709 12:23:16.234530 22056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.238821 22056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3: No bootstrap required, opened a new log
I20260709 12:23:16.240962 22056 raft_consensus.cc:359] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d135a127dc3e42b0a11ed567c60a5ea3" member_type: VOTER }
I20260709 12:23:16.241362 22056 raft_consensus.cc:385] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.241554 22056 raft_consensus.cc:740] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d135a127dc3e42b0a11ed567c60a5ea3, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.242180 22056 consensus_queue.cc:260] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d135a127dc3e42b0a11ed567c60a5ea3" member_type: VOTER }
I20260709 12:23:16.242604 22056 raft_consensus.cc:399] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:16.242787 22056 raft_consensus.cc:493] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:16.243000 22056 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.248184 22056 raft_consensus.cc:515] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d135a127dc3e42b0a11ed567c60a5ea3" member_type: VOTER }
I20260709 12:23:16.248672 22056 leader_election.cc:304] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d135a127dc3e42b0a11ed567c60a5ea3; no voters: 
I20260709 12:23:16.249739 22056 leader_election.cc:290] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:16.250190 22059 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:16.251608 22059 raft_consensus.cc:697] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [term 1 LEADER]: Becoming Leader. State: Replica: d135a127dc3e42b0a11ed567c60a5ea3, State: Running, Role: LEADER
I20260709 12:23:16.252323 22059 consensus_queue.cc:237] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d135a127dc3e42b0a11ed567c60a5ea3" member_type: VOTER }
I20260709 12:23:16.253063 22056 sys_catalog.cc:565] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:16.256778 22061 sys_catalog.cc:455] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d135a127dc3e42b0a11ed567c60a5ea3. Latest consensus state: current_term: 1 leader_uuid: "d135a127dc3e42b0a11ed567c60a5ea3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d135a127dc3e42b0a11ed567c60a5ea3" member_type: VOTER } }
I20260709 12:23:16.257668 22061 sys_catalog.cc:458] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:16.256500 22060 sys_catalog.cc:455] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d135a127dc3e42b0a11ed567c60a5ea3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d135a127dc3e42b0a11ed567c60a5ea3" member_type: VOTER } }
I20260709 12:23:16.258420 22060 sys_catalog.cc:458] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:16.261809 22066 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:16.266621 22066 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:16.272845 11916 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:16.276566 22066 catalog_manager.cc:1383] Generated new cluster ID: 4055def51784479c9977a14994fbcaff
I20260709 12:23:16.276875 22066 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:16.307969 22066 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:16.309295 22066 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:16.325076 22066 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3: Generated new TSK 0
I20260709 12:23:16.325682 22066 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:16.340281 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:16.346457 22077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:16.347894 22078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:16.349375 22080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:16.349951 11916 server_base.cc:1061] running on GCE node
I20260709 12:23:16.350881 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:16.351063 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:16.351197 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599796351186 us; error 0 us; skew 500 ppm
I20260709 12:23:16.351749 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:16.354049 11916 webserver.cc:533] Webserver started at http://127.11.163.1:45585/ using document root <none> and password file <none>
I20260709 12:23:16.354565 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:16.354730 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:16.355054 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:16.356469 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-0-root/instance:
uuid: "1961a8b455844403ba3e96ade32c62e6"
format_stamp: "Formatted at 2026-07-09 12:23:16 on dist-test-slave-z9f9"
I20260709 12:23:16.361511 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:23:16.365136 22085 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:16.366024 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:16.366384 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-0-root
uuid: "1961a8b455844403ba3e96ade32c62e6"
format_stamp: "Formatted at 2026-07-09 12:23:16 on dist-test-slave-z9f9"
I20260709 12:23:16.366712 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:16.380295 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:16.381548 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:16.383316 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:16.385579 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:16.385800 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:16.386104 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:16.386286 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:16.426743 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.1:41447
I20260709 12:23:16.426851 22147 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.1:41447 every 8 connection(s)
I20260709 12:23:16.431872 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:16.439390 22152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:16.441143 22153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:16.444093 22155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:16.444382 11916 server_base.cc:1061] running on GCE node
I20260709 12:23:16.446646 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:16.446941 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:16.447153 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599796447133 us; error 0 us; skew 500 ppm
I20260709 12:23:16.447930 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:16.447932 22148 heartbeater.cc:344] Connected to a master server at 127.11.163.62:35441
I20260709 12:23:16.448640 22148 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:16.449606 22148 heartbeater.cc:507] Master 127.11.163.62:35441 requested a full tablet report, sending...
I20260709 12:23:16.451020 11916 webserver.cc:533] Webserver started at http://127.11.163.2:32809/ using document root <none> and password file <none>
I20260709 12:23:16.451777 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:16.452029 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:16.451953 22021 ts_manager.cc:194] Registered new tserver with Master: 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447)
I20260709 12:23:16.452548 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:16.454111 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-1-root/instance:
uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
format_stamp: "Formatted at 2026-07-09 12:23:16 on dist-test-slave-z9f9"
I20260709 12:23:16.454646 22021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36558
I20260709 12:23:16.459082 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:23:16.462838 22160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:16.463771 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:16.464090 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-1-root
uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
format_stamp: "Formatted at 2026-07-09 12:23:16 on dist-test-slave-z9f9"
I20260709 12:23:16.464372 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:16.475769 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:16.476886 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:16.478291 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:16.480679 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:16.480877 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:16.481148 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:16.481312 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:16.519886 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.2:41363
I20260709 12:23:16.520010 22224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.2:41363 every 8 connection(s)
I20260709 12:23:16.524794 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:16.532933 22229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:16.533092 22228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:16.536939 11916 server_base.cc:1061] running on GCE node
I20260709 12:23:16.537331 22225 heartbeater.cc:344] Connected to a master server at 127.11.163.62:35441
W20260709 12:23:16.537477 22231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:16.537804 22225 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:16.538712 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:16.538707 22225 heartbeater.cc:507] Master 127.11.163.62:35441 requested a full tablet report, sending...
W20260709 12:23:16.538990 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:16.539274 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599796539255 us; error 0 us; skew 500 ppm
I20260709 12:23:16.539947 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:16.541126 22021 ts_manager.cc:194] Registered new tserver with Master: 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:16.542563 11916 webserver.cc:533] Webserver started at http://127.11.163.3:33201/ using document root <none> and password file <none>
I20260709 12:23:16.542856 22021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36570
I20260709 12:23:16.543159 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:16.543479 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:16.543792 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:16.545001 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-2-root/instance:
uuid: "69d10fe9c342437e82e166e1fae2f373"
format_stamp: "Formatted at 2026-07-09 12:23:16 on dist-test-slave-z9f9"
I20260709 12:23:16.549587 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:16.553087 22236 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:16.553879 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:16.554283 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-2-root
uuid: "69d10fe9c342437e82e166e1fae2f373"
format_stamp: "Formatted at 2026-07-09 12:23:16 on dist-test-slave-z9f9"
I20260709 12:23:16.554592 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599438829268-11916-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:16.565702 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:16.566944 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:16.568500 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:16.570737 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:16.570978 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:16.571230 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:16.571408 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:16.611507 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.3:32891
I20260709 12:23:16.611662 22298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.3:32891 every 8 connection(s)
I20260709 12:23:16.626179 22299 heartbeater.cc:344] Connected to a master server at 127.11.163.62:35441
I20260709 12:23:16.626796 22299 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:16.627643 22299 heartbeater.cc:507] Master 127.11.163.62:35441 requested a full tablet report, sending...
I20260709 12:23:16.629678 22021 ts_manager.cc:194] Registered new tserver with Master: 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:16.630694 11916 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015922088s
I20260709 12:23:16.631346 22021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36574
I20260709 12:23:16.655316 22021 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36582:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:16.657912 22021 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:16.731501 22264 tablet_service.cc:1511] Processing CreateTablet for tablet 1a988e71e2184f30b491ca8b79297888 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:16.733002 22264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a988e71e2184f30b491ca8b79297888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.733050 22262 tablet_service.cc:1511] Processing CreateTablet for tablet 4da28cc087bf4d35987931c43924880b (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:16.734536 22262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da28cc087bf4d35987931c43924880b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.736192 22263 tablet_service.cc:1511] Processing CreateTablet for tablet 6117ae0919d641858d3d0f01771e8235 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:16.737699 22263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6117ae0919d641858d3d0f01771e8235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.740235 22261 tablet_service.cc:1511] Processing CreateTablet for tablet f983b1b0b120466c8fc0ed57bccc75ea (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:16.741628 22261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f983b1b0b120466c8fc0ed57bccc75ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.756111 22260 tablet_service.cc:1511] Processing CreateTablet for tablet f082a8768d0f41d784bee6b15953d02c (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:16.757709 22260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f082a8768d0f41d784bee6b15953d02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.758160 22259 tablet_service.cc:1511] Processing CreateTablet for tablet 4758cb763e4d42a686d2b9980b22cd3c (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:16.761371 22258 tablet_service.cc:1511] Processing CreateTablet for tablet de9afac631f146f3b6f05430fce53fd8 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:16.762276 22257 tablet_service.cc:1511] Processing CreateTablet for tablet 761cfccd5770414ca935bda6f6140032 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:16.763760 22259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4758cb763e4d42a686d2b9980b22cd3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.764487 22258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9afac631f146f3b6f05430fce53fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.767599 22256 tablet_service.cc:1511] Processing CreateTablet for tablet 40d40f3527564fcf9ae7a26091aadbca (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:16.769001 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d40f3527564fcf9ae7a26091aadbca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.771823 22257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 761cfccd5770414ca935bda6f6140032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.804560 22189 tablet_service.cc:1511] Processing CreateTablet for tablet 1a988e71e2184f30b491ca8b79297888 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:16.806710 22315 tablet_bootstrap.cc:492] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:16.806991 22188 tablet_service.cc:1511] Processing CreateTablet for tablet 6117ae0919d641858d3d0f01771e8235 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:16.809497 22113 tablet_service.cc:1511] Processing CreateTablet for tablet 1a988e71e2184f30b491ca8b79297888 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:16.810945 22113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a988e71e2184f30b491ca8b79297888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.812498 22111 tablet_service.cc:1511] Processing CreateTablet for tablet 4da28cc087bf4d35987931c43924880b (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:16.813867 22111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da28cc087bf4d35987931c43924880b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.817524 22315 tablet_bootstrap.cc:654] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.820461 22107 tablet_service.cc:1511] Processing CreateTablet for tablet de9afac631f146f3b6f05430fce53fd8 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:16.817250 22110 tablet_service.cc:1511] Processing CreateTablet for tablet f983b1b0b120466c8fc0ed57bccc75ea (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:16.822113 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9afac631f146f3b6f05430fce53fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.822671 22112 tablet_service.cc:1511] Processing CreateTablet for tablet 6117ae0919d641858d3d0f01771e8235 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:16.823570 22109 tablet_service.cc:1511] Processing CreateTablet for tablet f082a8768d0f41d784bee6b15953d02c (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:16.823539 22106 tablet_service.cc:1511] Processing CreateTablet for tablet 761cfccd5770414ca935bda6f6140032 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:16.826756 22187 tablet_service.cc:1511] Processing CreateTablet for tablet 4da28cc087bf4d35987931c43924880b (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:16.818862 22108 tablet_service.cc:1511] Processing CreateTablet for tablet 4758cb763e4d42a686d2b9980b22cd3c (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:16.831167 22182 tablet_service.cc:1511] Processing CreateTablet for tablet de9afac631f146f3b6f05430fce53fd8 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:16.832917 22184 tablet_service.cc:1511] Processing CreateTablet for tablet f082a8768d0f41d784bee6b15953d02c (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:16.834558 22183 tablet_service.cc:1511] Processing CreateTablet for tablet 4758cb763e4d42a686d2b9980b22cd3c (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:16.828301 22186 tablet_service.cc:1511] Processing CreateTablet for tablet f983b1b0b120466c8fc0ed57bccc75ea (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:16.836208 22105 tablet_service.cc:1511] Processing CreateTablet for tablet 40d40f3527564fcf9ae7a26091aadbca (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:16.837298 22189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a988e71e2184f30b491ca8b79297888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.840464 22183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4758cb763e4d42a686d2b9980b22cd3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.844197 22182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9afac631f146f3b6f05430fce53fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.848008 22184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f082a8768d0f41d784bee6b15953d02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.850940 22186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f983b1b0b120466c8fc0ed57bccc75ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.852867 22188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6117ae0919d641858d3d0f01771e8235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.854570 22187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da28cc087bf4d35987931c43924880b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.858168 22112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6117ae0919d641858d3d0f01771e8235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.860774 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 761cfccd5770414ca935bda6f6140032 (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:16.862732 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 761cfccd5770414ca935bda6f6140032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.865178 22180 tablet_service.cc:1511] Processing CreateTablet for tablet 40d40f3527564fcf9ae7a26091aadbca (DEFAULT_TABLE table=test-workload [id=2bc55213ce814af6b915367ffa116f34]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:16.867676 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d40f3527564fcf9ae7a26091aadbca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.875883 22108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4758cb763e4d42a686d2b9980b22cd3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.877640 22110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f983b1b0b120466c8fc0ed57bccc75ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.883879 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d40f3527564fcf9ae7a26091aadbca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.889047 22109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f082a8768d0f41d784bee6b15953d02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.896679 22317 tablet_bootstrap.cc:492] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:16.900911 22315 tablet_bootstrap.cc:492] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:16.901510 22315 ts_tablet_manager.cc:1403] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.095s	user 0.039s	sys 0.048s
I20260709 12:23:16.903189 22317 tablet_bootstrap.cc:654] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.903839 22106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 761cfccd5770414ca935bda6f6140032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.904618 22315 raft_consensus.cc:359] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:16.905434 22315 raft_consensus.cc:385] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.905745 22315 raft_consensus.cc:740] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.906687 22315 consensus_queue.cc:260] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:16.933498 22315 ts_tablet_manager.cc:1434] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.032s	user 0.012s	sys 0.011s
I20260709 12:23:16.934337 22299 heartbeater.cc:499] Master 127.11.163.62:35441 was elected leader, sending a full tablet report...
I20260709 12:23:16.958424 22318 tablet_bootstrap.cc:492] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:16.968468 22318 tablet_bootstrap.cc:654] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.980939 22317 tablet_bootstrap.cc:492] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:16.981442 22317 ts_tablet_manager.cc:1403] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.085s	user 0.024s	sys 0.010s
I20260709 12:23:16.957454 22315 tablet_bootstrap.cc:492] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:16.995934 22317 raft_consensus.cc:359] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:16.996724 22317 raft_consensus.cc:385] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.997015 22317 raft_consensus.cc:740] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.997967 22317 consensus_queue.cc:260] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:17.030925 22317 ts_tablet_manager.cc:1434] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.049s	user 0.015s	sys 0.021s
I20260709 12:23:17.031905 22148 heartbeater.cc:499] Master 127.11.163.62:35441 was elected leader, sending a full tablet report...
I20260709 12:23:17.040683 22322 raft_consensus.cc:493] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.041354 22322 raft_consensus.cc:515] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:17.050364 22317 tablet_bootstrap.cc:492] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:17.053902 22322 leader_election.cc:290] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:17.056977 22315 tablet_bootstrap.cc:654] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.057878 22317 tablet_bootstrap.cc:654] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.070096 22317 tablet_bootstrap.cc:492] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:17.070322 22318 tablet_bootstrap.cc:492] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:17.070789 22317 ts_tablet_manager.cc:1403] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.005s
I20260709 12:23:17.073316 22318 ts_tablet_manager.cc:1403] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.115s	user 0.022s	sys 0.037s
I20260709 12:23:17.076005 22317 raft_consensus.cc:359] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.076840 22317 raft_consensus.cc:385] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.077150 22317 raft_consensus.cc:740] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.077924 22317 consensus_queue.cc:260] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.075068 22315 tablet_bootstrap.cc:492] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:17.079958 22315 ts_tablet_manager.cc:1403] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.008s
I20260709 12:23:17.080229 22317 ts_tablet_manager.cc:1434] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:17.081367 22317 tablet_bootstrap.cc:492] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:17.087718 22317 tablet_bootstrap.cc:654] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.089139 22315 raft_consensus.cc:359] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.089999 22315 raft_consensus.cc:385] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.090301 22315 raft_consensus.cc:740] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.078778 22318 raft_consensus.cc:359] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.091810 22318 raft_consensus.cc:385] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.092106 22318 raft_consensus.cc:740] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.092864 22318 consensus_queue.cc:260] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.091143 22315 consensus_queue.cc:260] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.097323 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:17.097944 22315 ts_tablet_manager.cc:1434] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:23:17.099052 22315 tablet_bootstrap.cc:492] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:17.099336 22317 tablet_bootstrap.cc:492] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
W20260709 12:23:17.099179 22089 leader_election.cc:343] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.100054 22317 ts_tablet_manager.cc:1403] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.012s
I20260709 12:23:17.101599 22225 heartbeater.cc:499] Master 127.11.163.62:35441 was elected leader, sending a full tablet report...
I20260709 12:23:17.103209 22317 raft_consensus.cc:359] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.104029 22317 raft_consensus.cc:385] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.104329 22317 raft_consensus.cc:740] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.105252 22317 consensus_queue.cc:260] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.105747 22318 ts_tablet_manager.cc:1434] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.002s
I20260709 12:23:17.106854 22318 tablet_bootstrap.cc:492] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:17.107682 22317 ts_tablet_manager.cc:1434] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:17.108803 22317 tablet_bootstrap.cc:492] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:17.112038 22318 tablet_bootstrap.cc:654] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.114998 22317 tablet_bootstrap.cc:654] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.115053 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:17.116946 22315 tablet_bootstrap.cc:654] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:17.117643 22088 leader_election.cc:343] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.118177 22088 leader_election.cc:304] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6; no voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:17.119933 22323 raft_consensus.cc:2749] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:17.123996 22318 tablet_bootstrap.cc:492] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:17.124608 22318 ts_tablet_manager.cc:1403] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 12:23:17.126022 22315 tablet_bootstrap.cc:492] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:17.126618 22315 ts_tablet_manager.cc:1403] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 12:23:17.128542 22318 raft_consensus.cc:359] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.129340 22318 raft_consensus.cc:385] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.129644 22318 raft_consensus.cc:740] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.129638 22315 raft_consensus.cc:359] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.130687 22315 raft_consensus.cc:385] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.130887 22318 consensus_queue.cc:260] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.131016 22315 raft_consensus.cc:740] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.134078 22317 tablet_bootstrap.cc:492] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:17.133638 22315 consensus_queue.cc:260] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.134873 22317 ts_tablet_manager.cc:1403] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.026s	user 0.001s	sys 0.023s
I20260709 12:23:17.138093 22317 raft_consensus.cc:359] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.138871 22317 raft_consensus.cc:385] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.139214 22317 raft_consensus.cc:740] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.140149 22317 consensus_queue.cc:260] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.142449 22317 ts_tablet_manager.cc:1434] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:17.147114 22318 ts_tablet_manager.cc:1434] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:23:17.148276 22317 tablet_bootstrap.cc:492] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:17.143803 22333 raft_consensus.cc:493] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.145547 22315 ts_tablet_manager.cc:1434] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:23:17.148276 22318 tablet_bootstrap.cc:492] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:17.150053 22333 raft_consensus.cc:515] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.150753 22315 tablet_bootstrap.cc:492] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:17.157572 22318 tablet_bootstrap.cc:654] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.160552 22333 leader_election.cc:290] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.161955 22320 raft_consensus.cc:493] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.162570 22320 raft_consensus.cc:515] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.163177 22317 tablet_bootstrap.cc:654] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.163590 22315 tablet_bootstrap.cc:654] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.167263 22320 leader_election.cc:290] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:17.190882 22320 raft_consensus.cc:493] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.191535 22320 raft_consensus.cc:515] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.194180 22320 leader_election.cc:290] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:17.199069 22320 raft_consensus.cc:493] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.199623 22320 raft_consensus.cc:515] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.203128 22320 leader_election.cc:290] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:17.206328 22315 tablet_bootstrap.cc:492] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:17.206954 22315 ts_tablet_manager.cc:1403] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.002s
I20260709 12:23:17.209985 22315 raft_consensus.cc:359] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.210707 22315 raft_consensus.cc:385] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.211019 22315 raft_consensus.cc:740] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.211983 22315 consensus_queue.cc:260] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.216377 22315 ts_tablet_manager.cc:1434] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:23:17.217374 22315 tablet_bootstrap.cc:492] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:17.226828 22333 raft_consensus.cc:493] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.227478 22333 raft_consensus.cc:515] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.229676 22333 leader_election.cc:290] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.231741 22315 tablet_bootstrap.cc:654] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.232321 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f983b1b0b120466c8fc0ed57bccc75ea" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:17.234063 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d40f3527564fcf9ae7a26091aadbca" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
W20260709 12:23:17.234724 22240 leader_election.cc:343] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.235566 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
W20260709 12:23:17.235857 22240 leader_election.cc:343] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.236217 22123 raft_consensus.cc:2468] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 0.
I20260709 12:23:17.237238 22240 leader_election.cc:304] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:17.237998 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f082a8768d0f41d784bee6b15953d02c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:17.238229 22320 raft_consensus.cc:2804] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.234701 22317 tablet_bootstrap.cc:492] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:17.238831 22320 raft_consensus.cc:493] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.239276 22317 ts_tablet_manager.cc:1403] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.091s	user 0.030s	sys 0.042s
I20260709 12:23:17.240099 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9afac631f146f3b6f05430fce53fd8" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
W20260709 12:23:17.240264 22164 leader_election.cc:343] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.240942 22123 raft_consensus.cc:2468] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:17.241995 22164 leader_election.cc:304] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:17.243086 22318 tablet_bootstrap.cc:492] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:17.239312 22320 raft_consensus.cc:3060] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.243717 22318 ts_tablet_manager.cc:1403] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.025s
I20260709 12:23:17.247596 22333 raft_consensus.cc:2804] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.248055 22333 raft_consensus.cc:493] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.248413 22333 raft_consensus.cc:3060] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.248539 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f983b1b0b120466c8fc0ed57bccc75ea" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:17.250335 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d40f3527564fcf9ae7a26091aadbca" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:17.251932 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
W20260709 12:23:17.253311 22239 leader_election.cc:343] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.253814 22239 leader_election.cc:304] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69d10fe9c342437e82e166e1fae2f373; no voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10
I20260709 12:23:17.254586 22317 raft_consensus.cc:359] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.246996 22318 raft_consensus.cc:359] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.255620 22317 raft_consensus.cc:385] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.255921 22318 raft_consensus.cc:385] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.256084 22317 raft_consensus.cc:740] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.256587 22318 raft_consensus.cc:740] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.259621 22333 raft_consensus.cc:515] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.259838 22317 consensus_queue.cc:260] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.263599 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9afac631f146f3b6f05430fce53fd8" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:17.264436 22123 raft_consensus.cc:3060] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.264176 22320 raft_consensus.cc:515] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
W20260709 12:23:17.267390 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:17.278302 22317 ts_tablet_manager.cc:1434] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:23:17.279012 22318 consensus_queue.cc:260] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.281826 22344 raft_consensus.cc:2749] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:17.289951 22317 tablet_bootstrap.cc:492] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
W20260709 12:23:17.291460 22239 leader_election.cc:343] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.292109 22239 leader_election.cc:304] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69d10fe9c342437e82e166e1fae2f373; no voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10
I20260709 12:23:17.293327 22318 ts_tablet_manager.cc:1434] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 12:23:17.294890 22318 tablet_bootstrap.cc:492] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:17.299741 22344 raft_consensus.cc:2749] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:17.300575 22239 leader_election.cc:343] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.302609 22320 leader_election.cc:290] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:17.303421 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:17.304131 22122 raft_consensus.cc:3060] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.304376 22315 tablet_bootstrap.cc:492] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:17.305027 22315 ts_tablet_manager.cc:1403] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.088s	user 0.050s	sys 0.026s
I20260709 12:23:17.308295 22315 raft_consensus.cc:359] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.309141 22315 raft_consensus.cc:385] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.309510 22315 raft_consensus.cc:740] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.310236 22315 consensus_queue.cc:260] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.312319 22317 tablet_bootstrap.cc:654] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.312649 22315 ts_tablet_manager.cc:1434] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:17.313701 22315 tablet_bootstrap.cc:492] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:17.316625 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:17.319227 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f082a8768d0f41d784bee6b15953d02c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:17.319936 22274 raft_consensus.cc:2468] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:17.320516 22315 tablet_bootstrap.cc:654] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.321390 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9afac631f146f3b6f05430fce53fd8" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:17.322973 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9afac631f146f3b6f05430fce53fd8" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
W20260709 12:23:17.324293 22239 leader_election.cc:343] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.326292 22164 leader_election.cc:304] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 1961a8b455844403ba3e96ade32c62e6
I20260709 12:23:17.327601 22329 raft_consensus.cc:2804] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.328105 22329 raft_consensus.cc:493] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.328523 22329 raft_consensus.cc:3060] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:17.332178 22164 leader_election.cc:343] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.332845 22317 tablet_bootstrap.cc:492] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:17.333153 22315 tablet_bootstrap.cc:492] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:17.333431 22317 ts_tablet_manager.cc:1403] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.006s
I20260709 12:23:17.333827 22315 ts_tablet_manager.cc:1403] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 12:23:17.301826 22333 leader_election.cc:290] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
W20260709 12:23:17.333213 22164 leader_election.cc:343] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.315248 22122 raft_consensus.cc:2468] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 1.
I20260709 12:23:17.336416 22240 leader_election.cc:304] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 1a0eabdd4fd148ce8418bda7c9d79c10
I20260709 12:23:17.336928 22317 raft_consensus.cc:359] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.337709 22317 raft_consensus.cc:385] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.338188 22317 raft_consensus.cc:740] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.337558 22315 raft_consensus.cc:359] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.338770 22315 raft_consensus.cc:385] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.339248 22315 raft_consensus.cc:740] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.338945 22317 consensus_queue.cc:260] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.339561 22329 raft_consensus.cc:515] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.340263 22315 consensus_queue.cc:260] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.337726 22123 raft_consensus.cc:2468] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:17.341735 22329 leader_election.cc:290] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.337658 22344 raft_consensus.cc:2804] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.342970 22344 raft_consensus.cc:697] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Becoming Leader. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:17.343974 22164 leader_election.cc:304] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:17.343931 22344 consensus_queue.cc:237] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.343146 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f082a8768d0f41d784bee6b15953d02c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:17.345772 22122 raft_consensus.cc:3060] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.346526 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f082a8768d0f41d784bee6b15953d02c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:17.347173 22274 raft_consensus.cc:3060] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.347668 22315 ts_tablet_manager.cc:1434] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:23:17.348855 22315 tablet_bootstrap.cc:492] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:17.351257 22317 ts_tablet_manager.cc:1434] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:23:17.353021 22317 tablet_bootstrap.cc:492] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:17.353631 22323 raft_consensus.cc:493] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.340991 22318 tablet_bootstrap.cc:654] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.354204 22323 raft_consensus.cc:515] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.356251 22315 tablet_bootstrap.cc:654] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.357386 22323 leader_election.cc:290] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.357753 22329 raft_consensus.cc:2804] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.353884 22122 raft_consensus.cc:2468] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:17.359184 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da28cc087bf4d35987931c43924880b" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:17.357684 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da28cc087bf4d35987931c43924880b" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
W20260709 12:23:17.361380 22088 leader_election.cc:343] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:17.362555 22089 leader_election.cc:343] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.363013 22089 leader_election.cc:304] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6; no voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:17.364199 22323 raft_consensus.cc:2749] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:17.364471 22317 tablet_bootstrap.cc:654] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.359202 22329 raft_consensus.cc:697] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:17.366386 22329 consensus_queue.cc:237] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.369010 22164 leader_election.cc:304] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:17.370329 22333 raft_consensus.cc:2804] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.370847 22333 raft_consensus.cc:697] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:17.371709 22333 consensus_queue.cc:237] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.372128 22320 raft_consensus.cc:493] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.372766 22315 tablet_bootstrap.cc:492] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:17.373430 22315 ts_tablet_manager.cc:1403] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.009s
I20260709 12:23:17.372876 22320 raft_consensus.cc:515] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.377143 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9afac631f146f3b6f05430fce53fd8" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:17.377367 22315 raft_consensus.cc:359] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.379163 22320 leader_election.cc:290] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:17.378316 22123 raft_consensus.cc:2393] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69d10fe9c342437e82e166e1fae2f373 in current term 1: Already voted for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in this term.
I20260709 12:23:17.380761 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9afac631f146f3b6f05430fce53fd8" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:17.381564 22317 tablet_bootstrap.cc:492] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:17.382184 22317 ts_tablet_manager.cc:1403] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.005s
I20260709 12:23:17.382629 22239 leader_election.cc:304] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69d10fe9c342437e82e166e1fae2f373; no voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10
I20260709 12:23:17.383616 22320 raft_consensus.cc:3060] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.385459 22318 tablet_bootstrap.cc:492] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:17.381582 22315 raft_consensus.cc:385] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.385967 22318 ts_tablet_manager.cc:1403] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.091s	user 0.006s	sys 0.007s
I20260709 12:23:17.386163 22315 raft_consensus.cc:740] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.387044 22315 consensus_queue.cc:260] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.389483 22318 raft_consensus.cc:359] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.385599 22317 raft_consensus.cc:359] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.390357 22318 raft_consensus.cc:385] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.390442 22317 raft_consensus.cc:385] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.390683 22318 raft_consensus.cc:740] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.390890 22317 raft_consensus.cc:740] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.389531 22315 ts_tablet_manager.cc:1434] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:17.391881 22320 raft_consensus.cc:2749] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:17.391853 22317 consensus_queue.cc:260] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.393121 22315 tablet_bootstrap.cc:492] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:17.394824 22274 raft_consensus.cc:2468] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:17.391486 22318 consensus_queue.cc:260] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.397020 22318 ts_tablet_manager.cc:1434] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:23:17.398200 22317 ts_tablet_manager.cc:1434] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 12:23:17.402500 22020 catalog_manager.cc:5697] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "69d10fe9c342437e82e166e1fae2f373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.403692 22318 tablet_bootstrap.cc:492] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:17.403837 22317 tablet_bootstrap.cc:492] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:17.410637 22318 tablet_bootstrap.cc:654] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.411266 22317 tablet_bootstrap.cc:654] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.403878 22315 tablet_bootstrap.cc:654] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.427664 22315 tablet_bootstrap.cc:492] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:17.427664 22317 tablet_bootstrap.cc:492] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:17.428197 22315 ts_tablet_manager.cc:1403] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.001s
I20260709 12:23:17.428229 22317 ts_tablet_manager.cc:1403] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 12:23:17.430891 22315 raft_consensus.cc:359] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:17.431622 22315 raft_consensus.cc:385] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.431885 22315 raft_consensus.cc:740] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.432349 22317 raft_consensus.cc:359] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.432525 22315 consensus_queue.cc:260] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:17.433089 22317 raft_consensus.cc:385] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.433337 22318 tablet_bootstrap.cc:492] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:17.433456 22317 raft_consensus.cc:740] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.434773 22318 ts_tablet_manager.cc:1403] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.016s
I20260709 12:23:17.435143 22317 consensus_queue.cc:260] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.436874 22317 ts_tablet_manager.cc:1434] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:17.437739 22317 tablet_bootstrap.cc:492] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:17.437901 22318 raft_consensus.cc:359] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.438589 22318 raft_consensus.cc:385] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.438850 22318 raft_consensus.cc:740] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.439595 22318 consensus_queue.cc:260] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.441277 22315 ts_tablet_manager.cc:1434] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:23:17.441895 22318 ts_tablet_manager.cc:1434] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:17.442286 22315 tablet_bootstrap.cc:492] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:17.442966 22318 tablet_bootstrap.cc:492] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:17.444161 22317 tablet_bootstrap.cc:654] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.446971 22019 catalog_manager.cc:5697] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.449174 22315 tablet_bootstrap.cc:654] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.451562 22318 tablet_bootstrap.cc:654] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.466744 22318 tablet_bootstrap.cc:492] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:17.467314 22318 ts_tablet_manager.cc:1403] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.017s
I20260709 12:23:17.470582 22318 raft_consensus.cc:359] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.471246 22318 raft_consensus.cc:385] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.471612 22318 raft_consensus.cc:740] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.472612 22318 consensus_queue.cc:260] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.475790 22318 ts_tablet_manager.cc:1434] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:17.477226 22318 tablet_bootstrap.cc:492] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:17.476316 22019 catalog_manager.cc:5697] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.487058 22318 tablet_bootstrap.cc:654] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.510928 22317 tablet_bootstrap.cc:492] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:17.510969 22315 tablet_bootstrap.cc:492] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:17.511680 22329 raft_consensus.cc:493] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.511703 22317 ts_tablet_manager.cc:1403] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.074s	user 0.027s	sys 0.042s
I20260709 12:23:17.512284 22318 tablet_bootstrap.cc:492] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:17.512145 22329 raft_consensus.cc:515] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.512784 22315 ts_tablet_manager.cc:1403] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.071s	user 0.045s	sys 0.015s
I20260709 12:23:17.512830 22318 ts_tablet_manager.cc:1403] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.016s
I20260709 12:23:17.514286 22329 leader_election.cc:290] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.515442 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f983b1b0b120466c8fc0ed57bccc75ea" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:17.515455 22317 raft_consensus.cc:359] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.516599 22317 raft_consensus.cc:385] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.516422 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f983b1b0b120466c8fc0ed57bccc75ea" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:17.516239 22318 raft_consensus.cc:359] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:17.517168 22317 raft_consensus.cc:740] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.517112 22315 raft_consensus.cc:359] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.517387 22274 raft_consensus.cc:2468] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:17.517477 22318 raft_consensus.cc:385] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.518152 22315 raft_consensus.cc:385] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.518337 22318 raft_consensus.cc:740] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.518512 22315 raft_consensus.cc:740] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.518790 22317 consensus_queue.cc:260] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.519129 22164 leader_election.cc:304] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:17.519542 22315 consensus_queue.cc:260] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.520308 22329 raft_consensus.cc:2804] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.520673 22329 raft_consensus.cc:493] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.521009 22329 raft_consensus.cc:3060] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.521610 22317 ts_tablet_manager.cc:1434] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:17.522469 22123 raft_consensus.cc:2468] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:17.521713 22315 ts_tablet_manager.cc:1434] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:23:17.519672 22318 consensus_queue.cc:260] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:17.529420 22329 raft_consensus.cc:515] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.531597 22329 leader_election.cc:290] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.532651 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f983b1b0b120466c8fc0ed57bccc75ea" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:17.533125 22318 ts_tablet_manager.cc:1434] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:23:17.533326 22123 raft_consensus.cc:3060] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.534269 22318 tablet_bootstrap.cc:492] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:17.535626 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f983b1b0b120466c8fc0ed57bccc75ea" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:17.536265 22274 raft_consensus.cc:3060] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.541857 22318 tablet_bootstrap.cc:654] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.552182 22318 tablet_bootstrap.cc:492] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:17.552577 22123 raft_consensus.cc:2468] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:17.552683 22318 ts_tablet_manager.cc:1403] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.011s
I20260709 12:23:17.554157 22274 raft_consensus.cc:2468] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:17.555835 22164 leader_election.cc:304] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:17.556787 22329 raft_consensus.cc:2804] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.556674 22318 raft_consensus.cc:359] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.557444 22329 raft_consensus.cc:697] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:17.557545 22318 raft_consensus.cc:385] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.557951 22318 raft_consensus.cc:740] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.558367 22329 consensus_queue.cc:237] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.558763 22318 consensus_queue.cc:260] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.561074 22318 ts_tablet_manager.cc:1434] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:23:17.562064 22318 tablet_bootstrap.cc:492] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:17.567759 22318 tablet_bootstrap.cc:654] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.567291 22020 catalog_manager.cc:5697] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.572845 22318 tablet_bootstrap.cc:492] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:17.573201 22318 ts_tablet_manager.cc:1403] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:23:17.574620 22344 raft_consensus.cc:493] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.575138 22344 raft_consensus.cc:515] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.575657 22318 raft_consensus.cc:359] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.576368 22318 raft_consensus.cc:385] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.576632 22318 raft_consensus.cc:740] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.577407 22344 leader_election.cc:290] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:17.577324 22318 consensus_queue.cc:260] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.578325 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761cfccd5770414ca935bda6f6140032" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:17.578987 22123 raft_consensus.cc:2468] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 0.
I20260709 12:23:17.579623 22318 ts_tablet_manager.cc:1434] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:17.579623 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761cfccd5770414ca935bda6f6140032" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:17.580272 22240 leader_election.cc:304] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:17.580763 22199 raft_consensus.cc:2468] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 0.
I20260709 12:23:17.581295 22344 raft_consensus.cc:2804] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.581722 22344 raft_consensus.cc:493] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.582093 22344 raft_consensus.cc:3060] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.588773 22344 raft_consensus.cc:515] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.590576 22344 leader_election.cc:290] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:17.591426 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761cfccd5770414ca935bda6f6140032" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:17.591846 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761cfccd5770414ca935bda6f6140032" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:17.592311 22123 raft_consensus.cc:3060] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.592525 22199 raft_consensus.cc:3060] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.600687 22199 raft_consensus.cc:2468] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 1.
I20260709 12:23:17.600687 22123 raft_consensus.cc:2468] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 1.
I20260709 12:23:17.601586 22323 raft_consensus.cc:493] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.602147 22323 raft_consensus.cc:515] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.602249 22240 leader_election.cc:304] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:17.603204 22344 raft_consensus.cc:2804] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.603722 22344 raft_consensus.cc:697] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Becoming Leader. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:17.604423 22323 leader_election.cc:290] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.604980 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6117ae0919d641858d3d0f01771e8235" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:17.605003 22344 consensus_queue.cc:237] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.605818 22199 raft_consensus.cc:2468] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 0.
I20260709 12:23:17.606117 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6117ae0919d641858d3d0f01771e8235" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:17.606791 22274 raft_consensus.cc:2468] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 0.
I20260709 12:23:17.606992 22088 leader_election.cc:304] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:17.607981 22323 raft_consensus.cc:2804] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.608333 22323 raft_consensus.cc:493] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.608716 22323 raft_consensus.cc:3060] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.616864 22323 raft_consensus.cc:515] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.616838 22020 catalog_manager.cc:5697] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "69d10fe9c342437e82e166e1fae2f373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.618806 22323 leader_election.cc:290] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 election: Requested vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.619701 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6117ae0919d641858d3d0f01771e8235" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:17.619891 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6117ae0919d641858d3d0f01771e8235" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:17.620235 22199 raft_consensus.cc:3060] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.622560 22274 raft_consensus.cc:3060] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.628372 22274 raft_consensus.cc:2468] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 1.
I20260709 12:23:17.628990 22199 raft_consensus.cc:2468] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 1.
I20260709 12:23:17.629534 22089 leader_election.cc:304] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:17.630332 22323 raft_consensus.cc:2804] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.631189 22323 raft_consensus.cc:697] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 1 LEADER]: Becoming Leader. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:17.632083 22323 consensus_queue.cc:237] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.633860 22344 raft_consensus.cc:493] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.634413 22344 raft_consensus.cc:515] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:17.637511 22368 raft_consensus.cc:493] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.637702 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:17.638176 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:17.638495 22123 raft_consensus.cc:2468] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 0.
I20260709 12:23:17.638139 22368 raft_consensus.cc:515] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.639055 22199 raft_consensus.cc:2468] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 0.
I20260709 12:23:17.639632 22240 leader_election.cc:304] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:17.637635 22344 leader_election.cc:290] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:17.640486 22320 raft_consensus.cc:2804] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.641013 22320 raft_consensus.cc:493] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.641336 22320 raft_consensus.cc:3060] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.640802 22020 catalog_manager.cc:5697] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "1961a8b455844403ba3e96ade32c62e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.644342 22368 leader_election.cc:290] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.645043 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d40f3527564fcf9ae7a26091aadbca" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:17.645531 22199 raft_consensus.cc:2468] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 0.
I20260709 12:23:17.646683 22088 leader_election.cc:304] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:17.647109 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d40f3527564fcf9ae7a26091aadbca" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:17.647599 22368 raft_consensus.cc:2804] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.647787 22274 raft_consensus.cc:2468] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 0.
I20260709 12:23:17.648051 22368 raft_consensus.cc:493] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.648454 22368 raft_consensus.cc:3060] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.649216 22320 raft_consensus.cc:515] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:17.651763 22320 leader_election.cc:290] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:17.652427 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:17.652390 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:17.653218 22123 raft_consensus.cc:3060] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.653273 22199 raft_consensus.cc:3060] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.656972 22368 raft_consensus.cc:515] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.659909 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d40f3527564fcf9ae7a26091aadbca" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:17.660439 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d40f3527564fcf9ae7a26091aadbca" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:17.660624 22198 raft_consensus.cc:3060] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.661157 22368 leader_election.cc:290] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 election: Requested vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.661077 22274 raft_consensus.cc:3060] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.661026 22199 raft_consensus.cc:2468] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 1.
I20260709 12:23:17.662832 22239 leader_election.cc:304] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:17.661026 22123 raft_consensus.cc:2468] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 1.
I20260709 12:23:17.663743 22320 raft_consensus.cc:2804] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.664292 22320 raft_consensus.cc:697] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Becoming Leader. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:17.665136 22320 consensus_queue.cc:237] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:17.669350 22274 raft_consensus.cc:2468] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 1.
I20260709 12:23:17.670578 22089 leader_election.cc:304] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:17.671326 22368 raft_consensus.cc:2804] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.671453 22198 raft_consensus.cc:2468] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 1.
I20260709 12:23:17.671885 22368 raft_consensus.cc:697] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 1 LEADER]: Becoming Leader. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:17.672739 22368 consensus_queue.cc:237] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.673915 22020 catalog_manager.cc:5697] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "69d10fe9c342437e82e166e1fae2f373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.683372 22019 catalog_manager.cc:5697] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "1961a8b455844403ba3e96ade32c62e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.702359 22329 raft_consensus.cc:493] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.703024 22329 raft_consensus.cc:515] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.705137 22329 leader_election.cc:290] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.706130 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da28cc087bf4d35987931c43924880b" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:17.706231 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da28cc087bf4d35987931c43924880b" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:17.707027 22123 raft_consensus.cc:2468] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:17.707073 22274 raft_consensus.cc:2468] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:17.708174 22164 leader_election.cc:304] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:17.708811 22329 raft_consensus.cc:2804] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.709108 22329 raft_consensus.cc:493] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.709396 22329 raft_consensus.cc:3060] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.714587 22329 raft_consensus.cc:515] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.716218 22329 leader_election.cc:290] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.717124 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da28cc087bf4d35987931c43924880b" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:17.717350 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da28cc087bf4d35987931c43924880b" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:17.717715 22123 raft_consensus.cc:3060] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.718027 22274 raft_consensus.cc:3060] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.723165 22123 raft_consensus.cc:2468] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:17.723167 22274 raft_consensus.cc:2468] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:17.724493 22164 leader_election.cc:304] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:17.725183 22329 raft_consensus.cc:2804] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.725644 22329 raft_consensus.cc:697] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:17.726560 22329 consensus_queue.cc:237] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.734441 22019 catalog_manager.cc:5697] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.781005 22329 raft_consensus.cc:493] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.781698 22329 raft_consensus.cc:515] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:17.783594 22329 leader_election.cc:290] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:17.784417 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:17.784739 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:17.785109 22123 raft_consensus.cc:2393] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in current term 1: Already voted for candidate 69d10fe9c342437e82e166e1fae2f373 in this term.
I20260709 12:23:17.786484 22164 leader_election.cc:304] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:17.787180 22329 raft_consensus.cc:3060] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.792243 22329 raft_consensus.cc:2749] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:17.817122 22329 consensus_queue.cc:1048] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.830421 22333 consensus_queue.cc:1048] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.907763 22274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888"
dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
mode: GRACEFUL
new_leader_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:53928
I20260709 12:23:17.908504 22274 raft_consensus.cc:606] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Received request to transfer leadership to TS 1961a8b455844403ba3e96ade32c62e6
I20260709 12:23:17.908624 22320 consensus_queue.cc:1048] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:17.914000 22329 consensus_queue.cc:1048] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.924135 22344 consensus_queue.cc:1048] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.940773 22334 consensus_queue.cc:1048] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:17.942593 22198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4da28cc087bf4d35987931c43924880b"
dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
mode: GRACEFUL
new_leader_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:48816
I20260709 12:23:17.943289 22198 raft_consensus.cc:606] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Received request to transfer leadership to TS 1961a8b455844403ba3e96ade32c62e6
I20260709 12:23:17.951918 22198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f983b1b0b120466c8fc0ed57bccc75ea"
dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
mode: GRACEFUL
new_leader_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:48816
I20260709 12:23:17.952621 22198 raft_consensus.cc:606] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Received request to transfer leadership to TS 1961a8b455844403ba3e96ade32c62e6
I20260709 12:23:17.961409 22274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c"
dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
mode: GRACEFUL
new_leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
 from {username='slave'} at 127.0.0.1:53928
I20260709 12:23:17.962040 22274 raft_consensus.cc:606] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Received request to transfer leadership to TS 1a0eabdd4fd148ce8418bda7c9d79c10
I20260709 12:23:17.970353 22274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "761cfccd5770414ca935bda6f6140032"
dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
mode: GRACEFUL
new_leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
 from {username='slave'} at 127.0.0.1:53928
I20260709 12:23:17.970878 22274 raft_consensus.cc:606] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Received request to transfer leadership to TS 1a0eabdd4fd148ce8418bda7c9d79c10
I20260709 12:23:17.983621 22123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40d40f3527564fcf9ae7a26091aadbca"
dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
mode: GRACEFUL
new_leader_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:43080
I20260709 12:23:17.984223 22123 raft_consensus.cc:606] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 1 LEADER]: Received request to transfer leadership to TS 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:18.041942 22368 consensus_queue.cc:1048] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.053996 22368 consensus_queue.cc:1048] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.072877 22334 consensus_queue.cc:1048] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.083843 22334 consensus_queue.cc:1048] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.091522 22344 consensus_queue.cc:1048] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.093425 22334 raft_consensus.cc:993] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10: : Instructing follower 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:18.094012 22333 raft_consensus.cc:1081] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Signalling peer 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:18.095539 22122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f983b1b0b120466c8fc0ed57bccc75ea"
dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:43052
I20260709 12:23:18.096138 22122 raft_consensus.cc:493] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.096577 22122 raft_consensus.cc:3060] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.098939 22381 raft_consensus.cc:993] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373: : Instructing follower 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:18.099483 22320 raft_consensus.cc:1081] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Signalling peer 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:18.101227 22121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888"
dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:43064
I20260709 12:23:18.103353 22121 raft_consensus.cc:493] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.103760 22121 raft_consensus.cc:3060] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.106938 22122 raft_consensus.cc:515] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.110565 22333 consensus_queue.cc:1048] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.112082 22121 raft_consensus.cc:515] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:18.112417 22344 consensus_queue.cc:1048] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.114775 22122 leader_election.cc:290] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Requested vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:18.116075 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f983b1b0b120466c8fc0ed57bccc75ea" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:18.116748 22273 raft_consensus.cc:3060] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.117444 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:18.118134 22272 raft_consensus.cc:3055] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.118480 22272 raft_consensus.cc:740] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:18.118378 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:18.119683 22272 consensus_queue.cc:260] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:18.120687 22272 raft_consensus.cc:3060] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.123929 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f983b1b0b120466c8fc0ed57bccc75ea" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:18.124583 22198 raft_consensus.cc:3055] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.124917 22198 raft_consensus.cc:740] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:18.125062 22121 leader_election.cc:290] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Requested vote from peers 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:18.134248 22272 raft_consensus.cc:2468] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 2.
I20260709 12:23:18.137355 22089 leader_election.cc:304] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 1a0eabdd4fd148ce8418bda7c9d79c10
I20260709 12:23:18.138907 22368 raft_consensus.cc:2804] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.128257 22198 consensus_queue.cc:260] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.139559 22368 raft_consensus.cc:697] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Becoming Leader. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:18.140676 22198 raft_consensus.cc:3060] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.140793 22368 consensus_queue.cc:237] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:18.151628 22323 consensus_queue.cc:1048] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:18.154453 22198 raft_consensus.cc:2468] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 2.
I20260709 12:23:18.155772 22088 leader_election.cc:304] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:18.159868 22323 raft_consensus.cc:2804] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.160405 22323 raft_consensus.cc:697] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Becoming Leader. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:18.161172 22323 consensus_queue.cc:237] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.161773 22021 catalog_manager.cc:5697] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 reported cstate change: term changed from 1 to 2, leader changed from 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3) to 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "1961a8b455844403ba3e96ade32c62e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.143859 22273 raft_consensus.cc:2468] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 2.
I20260709 12:23:18.145381 22333 consensus_queue.cc:1048] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.174391 22396 consensus_queue.cc:1048] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:18.174966 22381 consensus_queue.cc:1048] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:18.181054 22020 catalog_manager.cc:5697] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 reported cstate change: term changed from 1 to 2, leader changed from 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2) to 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "1961a8b455844403ba3e96ade32c62e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.200512 22333 raft_consensus.cc:993] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10: : Instructing follower 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:18.200977 22333 raft_consensus.cc:1081] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Signalling peer 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:18.204157 22388 raft_consensus.cc:993] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6: : Instructing follower 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:18.204592 22388 raft_consensus.cc:1081] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 1 LEADER]: Signalling peer 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:18.205008 22123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4da28cc087bf4d35987931c43924880b"
dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:43052
I20260709 12:23:18.205698 22123 raft_consensus.cc:493] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.206045 22123 raft_consensus.cc:3060] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.207973 22273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40d40f3527564fcf9ae7a26091aadbca"
dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:53916
I20260709 12:23:18.208552 22273 raft_consensus.cc:493] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.208879 22273 raft_consensus.cc:3060] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.211661 22381 consensus_queue.cc:1048] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.212262 22123 raft_consensus.cc:515] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.214354 22123 leader_election.cc:290] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Requested vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:18.215095 22273 raft_consensus.cc:515] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.216940 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da28cc087bf4d35987931c43924880b" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:18.217495 22273 leader_election.cc:290] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 2 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:18.217612 22199 raft_consensus.cc:3055] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.218089 22199 raft_consensus.cc:740] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:18.219363 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d40f3527564fcf9ae7a26091aadbca" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:18.220010 22198 raft_consensus.cc:3060] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.220934 22199 consensus_queue.cc:260] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.222582 22381 raft_consensus.cc:993] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373: : Instructing follower 1a0eabdd4fd148ce8418bda7c9d79c10 to start an election
I20260709 12:23:18.223109 22381 raft_consensus.cc:1081] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Signalling peer 1a0eabdd4fd148ce8418bda7c9d79c10 to start an election
I20260709 12:23:18.223235 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d40f3527564fcf9ae7a26091aadbca" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:18.223640 22199 raft_consensus.cc:3060] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.224016 22123 raft_consensus.cc:3055] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.224370 22123 raft_consensus.cc:740] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:18.224870 22197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "761cfccd5770414ca935bda6f6140032"
dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
 from {username='slave'} at 127.0.0.1:48814
I20260709 12:23:18.225509 22197 raft_consensus.cc:493] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.225940 22197 raft_consensus.cc:3060] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.225558 22123 consensus_queue.cc:260] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.227015 22123 raft_consensus.cc:3060] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.227864 22198 raft_consensus.cc:2468] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 2.
I20260709 12:23:18.229139 22239 leader_election.cc:304] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:18.233762 22197 raft_consensus.cc:515] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.236160 22197 leader_election.cc:290] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 2 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:18.236868 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761cfccd5770414ca935bda6f6140032" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:18.237560 22122 raft_consensus.cc:3060] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.237757 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da28cc087bf4d35987931c43924880b" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:18.239495 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761cfccd5770414ca935bda6f6140032" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:18.240124 22381 raft_consensus.cc:2804] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.240679 22199 raft_consensus.cc:2468] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 2.
I20260709 12:23:18.241117 22381 raft_consensus.cc:697] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 2 LEADER]: Becoming Leader. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:18.242022 22088 leader_election.cc:304] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:18.236838 22123 raft_consensus.cc:2468] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 2.
I20260709 12:23:18.243064 22396 raft_consensus.cc:2804] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.244432 22396 raft_consensus.cc:697] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Becoming Leader. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:18.242101 22381 consensus_queue.cc:237] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.240360 22272 raft_consensus.cc:3055] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.245321 22396 consensus_queue.cc:237] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.245821 22272 raft_consensus.cc:740] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:18.247093 22122 raft_consensus.cc:2468] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 2.
I20260709 12:23:18.246748 22272 consensus_queue.cc:260] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.248136 22272 raft_consensus.cc:3060] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.240351 22273 raft_consensus.cc:3060] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.254863 22019 catalog_manager.cc:5697] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 reported cstate change: term changed from 1 to 2, leader changed from 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2) to 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "1961a8b455844403ba3e96ade32c62e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.256471 22273 raft_consensus.cc:2468] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 2.
I20260709 12:23:18.256588 22272 raft_consensus.cc:2468] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 2.
I20260709 12:23:18.257956 22164 leader_election.cc:304] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:18.257540 22020 catalog_manager.cc:5697] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 reported cstate change: term changed from 1 to 2, leader changed from 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1) to 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "69d10fe9c342437e82e166e1fae2f373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:18.259335 22334 raft_consensus.cc:2804] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.259864 22334 raft_consensus.cc:697] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:18.260699 22334 consensus_queue.cc:237] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.268913 22021 catalog_manager.cc:5697] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 1 to 2, leader changed from 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3) to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 2 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.309737 22344 raft_consensus.cc:993] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373: : Instructing follower 1a0eabdd4fd148ce8418bda7c9d79c10 to start an election
I20260709 12:23:18.310261 22381 raft_consensus.cc:1081] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Signalling peer 1a0eabdd4fd148ce8418bda7c9d79c10 to start an election
I20260709 12:23:18.311800 22199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c"
dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
 from {username='slave'} at 127.0.0.1:48814
I20260709 12:23:18.312307 22199 raft_consensus.cc:493] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.312624 22199 raft_consensus.cc:3060] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.317956 22199 raft_consensus.cc:515] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.319814 22199 leader_election.cc:290] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 2 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:18.321010 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:18.321393 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:18.321755 22122 raft_consensus.cc:3060] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.322075 22272 raft_consensus.cc:3055] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.322431 22272 raft_consensus.cc:740] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:18.323302 22272 consensus_queue.cc:260] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.324626 22272 raft_consensus.cc:3060] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.329528 22122 raft_consensus.cc:2468] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 2.
I20260709 12:23:18.330969 22164 leader_election.cc:304] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:18.331840 22334 raft_consensus.cc:2804] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.332261 22272 raft_consensus.cc:2468] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 2.
I20260709 12:23:18.332379 22334 raft_consensus.cc:697] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:18.333437 22334 consensus_queue.cc:237] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:18.340622 22021 catalog_manager.cc:5697] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 1 to 2, leader changed from 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3) to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 2 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.598510 22199 raft_consensus.cc:1275] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.599905 22396 consensus_queue.cc:1048] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.608103 22272 raft_consensus.cc:1275] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.609617 22323 consensus_queue.cc:1048] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.636933 22199 raft_consensus.cc:1275] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.638502 22381 consensus_queue.cc:1048] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.647450 22122 raft_consensus.cc:1275] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.649856 22402 consensus_queue.cc:1048] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:18.661402 22272 raft_consensus.cc:1275] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.662063 22273 raft_consensus.cc:1275] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Refusing update from remote peer 1a0eabdd4fd148ce8418bda7c9d79c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.662788 22323 consensus_queue.cc:1048] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.663554 22334 consensus_queue.cc:1048] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.672207 22199 raft_consensus.cc:3060] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.675201 22273 raft_consensus.cc:1275] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.677218 22396 consensus_queue.cc:1048] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.672194 22122 raft_consensus.cc:1275] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Refusing update from remote peer 1a0eabdd4fd148ce8418bda7c9d79c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.682778 22334 consensus_queue.cc:1048] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.688207 22198 raft_consensus.cc:1275] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.689419 22199 raft_consensus.cc:1275] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.690518 22323 consensus_queue.cc:1048] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.691998 22323 consensus_queue.cc:1048] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.774313 22273 raft_consensus.cc:1275] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Refusing update from remote peer 1a0eabdd4fd148ce8418bda7c9d79c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.775768 22334 consensus_queue.cc:1048] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.784113 22122 raft_consensus.cc:1275] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Refusing update from remote peer 1a0eabdd4fd148ce8418bda7c9d79c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.785573 22333 consensus_queue.cc:1048] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:21.017050 22019 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36586:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:21.019943 22019 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:21.077584 22110 tablet_service.cc:1511] Processing CreateTablet for tablet 5198a48e24f245628c71c2115fdb1c4c (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:21.078704 22180 tablet_service.cc:1511] Processing CreateTablet for tablet 5198a48e24f245628c71c2115fdb1c4c (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:21.079571 22110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5198a48e24f245628c71c2115fdb1c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.080621 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5198a48e24f245628c71c2115fdb1c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.082944 22112 tablet_service.cc:1511] Processing CreateTablet for tablet 9d5836e7f2e943ee95b3d6480e287796 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:21.084626 22112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d5836e7f2e943ee95b3d6480e287796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.080673 22263 tablet_service.cc:1511] Processing CreateTablet for tablet 5198a48e24f245628c71c2115fdb1c4c (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:21.089162 22263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5198a48e24f245628c71c2115fdb1c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.096138 22264 tablet_service.cc:1511] Processing CreateTablet for tablet 9d5836e7f2e943ee95b3d6480e287796 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:21.097779 22264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d5836e7f2e943ee95b3d6480e287796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.097589 22105 tablet_service.cc:1511] Processing CreateTablet for tablet bb0382d6294b479eb8ea32602f9963e4 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:21.099128 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0382d6294b479eb8ea32602f9963e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.100708 22109 tablet_service.cc:1511] Processing CreateTablet for tablet 107fba7885024b38bed11fd59be1c274 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:21.101176 22262 tablet_service.cc:1511] Processing CreateTablet for tablet bb0382d6294b479eb8ea32602f9963e4 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:21.102566 22262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0382d6294b479eb8ea32602f9963e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.107263 22258 tablet_service.cc:1511] Processing CreateTablet for tablet 107fba7885024b38bed11fd59be1c274 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:21.107714 22260 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8d4f8b821a4c2b84251f2ee3589ed8 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:21.109273 22258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107fba7885024b38bed11fd59be1c274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.111330 22417 tablet_bootstrap.cc:492] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:21.119820 22109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107fba7885024b38bed11fd59be1c274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.125008 22186 tablet_service.cc:1511] Processing CreateTablet for tablet 9d5836e7f2e943ee95b3d6480e287796 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:21.125823 22188 tablet_service.cc:1511] Processing CreateTablet for tablet bb0382d6294b479eb8ea32602f9963e4 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:21.126777 22186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d5836e7f2e943ee95b3d6480e287796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.128329 22189 tablet_service.cc:1511] Processing CreateTablet for tablet 107fba7885024b38bed11fd59be1c274 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:21.129930 22189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107fba7885024b38bed11fd59be1c274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.131415 22260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8d4f8b821a4c2b84251f2ee3589ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.132752 22187 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8d4f8b821a4c2b84251f2ee3589ed8 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:21.134181 22187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8d4f8b821a4c2b84251f2ee3589ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.135969 22182 tablet_service.cc:1511] Processing CreateTablet for tablet eb2ac6a3f97441fda4fc6b8ebaf77eb2 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:21.136674 22183 tablet_service.cc:1511] Processing CreateTablet for tablet af99285e428d4b28a92ad68f4db3415d (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:21.137414 22182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2ac6a3f97441fda4fc6b8ebaf77eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.129954 22181 tablet_service.cc:1511] Processing CreateTablet for tablet b9f9846b2af742c38a543ec2fdc9365d (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:21.139192 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f9846b2af742c38a543ec2fdc9365d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.141149 22183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af99285e428d4b28a92ad68f4db3415d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.142905 22188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0382d6294b479eb8ea32602f9963e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.157311 22256 tablet_service.cc:1511] Processing CreateTablet for tablet af99285e428d4b28a92ad68f4db3415d (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:21.157675 22257 tablet_service.cc:1511] Processing CreateTablet for tablet b9f9846b2af742c38a543ec2fdc9365d (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:21.158941 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af99285e428d4b28a92ad68f4db3415d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.159690 22257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f9846b2af742c38a543ec2fdc9365d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.172629 22110 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8d4f8b821a4c2b84251f2ee3589ed8 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:21.174120 22110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8d4f8b821a4c2b84251f2ee3589ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.183220 22261 tablet_service.cc:1511] Processing CreateTablet for tablet eb2ac6a3f97441fda4fc6b8ebaf77eb2 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:21.184789 22261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2ac6a3f97441fda4fc6b8ebaf77eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.205803 22259 tablet_service.cc:1511] Processing CreateTablet for tablet 7e537ee7307b46c0aa74d261e08b058c (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:21.207304 22259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e537ee7307b46c0aa74d261e08b058c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.217659 22184 tablet_service.cc:1511] Processing CreateTablet for tablet 7e537ee7307b46c0aa74d261e08b058c (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:21.219302 22184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e537ee7307b46c0aa74d261e08b058c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.222975 22106 tablet_service.cc:1511] Processing CreateTablet for tablet b9f9846b2af742c38a543ec2fdc9365d (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:21.224835 22106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f9846b2af742c38a543ec2fdc9365d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.231236 22108 tablet_service.cc:1511] Processing CreateTablet for tablet eb2ac6a3f97441fda4fc6b8ebaf77eb2 (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:21.233098 22108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2ac6a3f97441fda4fc6b8ebaf77eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.250242 22112 tablet_service.cc:1511] Processing CreateTablet for tablet af99285e428d4b28a92ad68f4db3415d (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:21.252059 22112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af99285e428d4b28a92ad68f4db3415d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.276522 22418 tablet_bootstrap.cc:492] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:21.263322 22417 tablet_bootstrap.cc:654] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:21.286732 22007 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.163.2:41363, user_credentials={real_user=slave}} blocked reactor thread for 66853.2us
I20260709 12:23:21.290658 22420 tablet_bootstrap.cc:492] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
W20260709 12:23:21.309486 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:21.325393 22105 tablet_service.cc:1511] Processing CreateTablet for tablet 7e537ee7307b46c0aa74d261e08b058c (DEFAULT_TABLE table=soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:21.327284 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e537ee7307b46c0aa74d261e08b058c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.323570 22420 tablet_bootstrap.cc:654] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.355312 22418 tablet_bootstrap.cc:654] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.361920 22417 tablet_bootstrap.cc:492] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:21.362474 22417 ts_tablet_manager.cc:1403] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.252s	user 0.014s	sys 0.015s
I20260709 12:23:21.365942 22417 raft_consensus.cc:359] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.367058 22417 raft_consensus.cc:385] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.367447 22417 raft_consensus.cc:740] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.368443 22417 consensus_queue.cc:260] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.372323 22417 ts_tablet_manager.cc:1434] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 12:23:21.372550 22418 tablet_bootstrap.cc:492] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:21.373163 22418 ts_tablet_manager.cc:1403] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.003s
I20260709 12:23:21.373587 22417 tablet_bootstrap.cc:492] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:21.376549 22418 raft_consensus.cc:359] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.379508 22418 raft_consensus.cc:385] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.379842 22418 raft_consensus.cc:740] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.380523 22418 consensus_queue.cc:260] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.383256 22418 ts_tablet_manager.cc:1434] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 12:23:21.384061 22417 tablet_bootstrap.cc:654] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.384286 22418 tablet_bootstrap.cc:492] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:21.389086 22420 tablet_bootstrap.cc:492] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:21.389671 22420 ts_tablet_manager.cc:1403] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.008s
I20260709 12:23:21.392263 22418 tablet_bootstrap.cc:654] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.393078 22420 raft_consensus.cc:359] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.393951 22420 raft_consensus.cc:385] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.394245 22420 raft_consensus.cc:740] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.395116 22420 consensus_queue.cc:260] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.398077 22420 ts_tablet_manager.cc:1434] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:21.398296 22417 tablet_bootstrap.cc:492] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:21.398809 22417 ts_tablet_manager.cc:1403] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 12:23:21.399163 22420 tablet_bootstrap.cc:492] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:21.401975 22417 raft_consensus.cc:359] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.402721 22417 raft_consensus.cc:385] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.403072 22417 raft_consensus.cc:740] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.404372 22418 tablet_bootstrap.cc:492] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:21.403919 22417 consensus_queue.cc:260] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.404973 22418 ts_tablet_manager.cc:1403] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.001s
I20260709 12:23:21.406704 22420 tablet_bootstrap.cc:654] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.406904 22417 ts_tablet_manager.cc:1434] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:23:21.410507 22417 tablet_bootstrap.cc:492] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:21.410570 22418 raft_consensus.cc:359] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.411669 22418 raft_consensus.cc:385] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.412060 22418 raft_consensus.cc:740] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.413255 22418 consensus_queue.cc:260] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.416189 22418 ts_tablet_manager.cc:1434] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:21.417167 22418 tablet_bootstrap.cc:492] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:21.421530 22417 tablet_bootstrap.cc:654] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.422050 22420 tablet_bootstrap.cc:492] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:21.422665 22420 ts_tablet_manager.cc:1403] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.005s
I20260709 12:23:21.424568 22418 tablet_bootstrap.cc:654] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.429576 22420 raft_consensus.cc:359] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.430415 22420 raft_consensus.cc:385] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.430712 22420 raft_consensus.cc:740] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.431352 22418 tablet_bootstrap.cc:492] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:21.431936 22418 ts_tablet_manager.cc:1403] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 12:23:21.431620 22420 consensus_queue.cc:260] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.434110 22420 ts_tablet_manager.cc:1434] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:23:21.435097 22420 tablet_bootstrap.cc:492] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:21.435392 22418 raft_consensus.cc:359] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.436190 22418 raft_consensus.cc:385] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.436492 22418 raft_consensus.cc:740] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.437397 22418 consensus_queue.cc:260] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.440019 22418 ts_tablet_manager.cc:1434] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:21.441115 22418 tablet_bootstrap.cc:492] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:21.442695 22420 tablet_bootstrap.cc:654] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.448961 22418 tablet_bootstrap.cc:654] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.477245 22417 tablet_bootstrap.cc:492] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:21.477800 22417 ts_tablet_manager.cc:1403] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.068s	user 0.025s	sys 0.029s
I20260709 12:23:21.478166 22420 tablet_bootstrap.cc:492] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:21.478195 22418 tablet_bootstrap.cc:492] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:21.478916 22420 ts_tablet_manager.cc:1403] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.024s
I20260709 12:23:21.478961 22418 ts_tablet_manager.cc:1403] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.021s
I20260709 12:23:21.480609 22417 raft_consensus.cc:359] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.481245 22417 raft_consensus.cc:385] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.481510 22417 raft_consensus.cc:740] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.482201 22420 raft_consensus.cc:359] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.482565 22418 raft_consensus.cc:359] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.482211 22417 consensus_queue.cc:260] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.483351 22420 raft_consensus.cc:385] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.483556 22418 raft_consensus.cc:385] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.483810 22420 raft_consensus.cc:740] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.483953 22418 raft_consensus.cc:740] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.484741 22418 consensus_queue.cc:260] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.484741 22420 consensus_queue.cc:260] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.485483 22417 ts_tablet_manager.cc:1434] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:23:21.486945 22417 tablet_bootstrap.cc:492] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:21.487375 22420 ts_tablet_manager.cc:1434] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:23:21.488498 22420 tablet_bootstrap.cc:492] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:21.494362 22417 tablet_bootstrap.cc:654] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.495194 22420 tablet_bootstrap.cc:654] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.487377 22418 ts_tablet_manager.cc:1434] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:21.496606 22418 tablet_bootstrap.cc:492] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:21.503727 22418 tablet_bootstrap.cc:654] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.516002 22333 raft_consensus.cc:493] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.516860 22333 raft_consensus.cc:515] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.521334 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af99285e428d4b28a92ad68f4db3415d" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
W20260709 12:23:21.523923 22164 leader_election.cc:343] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:21.525712 22333 leader_election.cc:290] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.527997 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af99285e428d4b28a92ad68f4db3415d" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
W20260709 12:23:21.530544 22164 leader_election.cc:343] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:21.531139 22164 leader_election.cc:304] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:21.532996 22333 raft_consensus.cc:2749] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:21.534714 22420 tablet_bootstrap.cc:492] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:21.535372 22418 tablet_bootstrap.cc:492] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:21.535300 22420 ts_tablet_manager.cc:1403] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 12:23:21.535991 22418 ts_tablet_manager.cc:1403] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.021s
I20260709 12:23:21.538488 22417 tablet_bootstrap.cc:492] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:21.538872 22420 raft_consensus.cc:359] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.539119 22418 raft_consensus.cc:359] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.540050 22420 raft_consensus.cc:385] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.540100 22418 raft_consensus.cc:385] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.540511 22420 raft_consensus.cc:740] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.539052 22417 ts_tablet_manager.cc:1403] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.025s
I20260709 12:23:21.540591 22418 raft_consensus.cc:740] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.541462 22420 consensus_queue.cc:260] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.541821 22418 consensus_queue.cc:260] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.543982 22420 ts_tablet_manager.cc:1434] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:21.544262 22418 ts_tablet_manager.cc:1434] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:21.544260 22417 raft_consensus.cc:359] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.545107 22417 raft_consensus.cc:385] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.545461 22417 raft_consensus.cc:740] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.545632 22418 tablet_bootstrap.cc:492] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:21.546360 22417 consensus_queue.cc:260] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.549057 22417 ts_tablet_manager.cc:1434] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:21.550050 22417 tablet_bootstrap.cc:492] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:21.552065 22419 raft_consensus.cc:493] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.552627 22419 raft_consensus.cc:515] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.554759 22418 tablet_bootstrap.cc:654] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.557505 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5836e7f2e943ee95b3d6480e287796" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:21.557818 22419 leader_election.cc:290] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.557576 22417 tablet_bootstrap.cc:654] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:21.559651 22088 leader_election.cc:343] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:21.562211 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5836e7f2e943ee95b3d6480e287796" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
W20260709 12:23:21.563905 22089 leader_election.cc:343] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:21.564396 22089 leader_election.cc:304] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6; no voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:21.565567 22419 raft_consensus.cc:2749] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:21.567890 22420 tablet_bootstrap.cc:492] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:21.590534 22418 tablet_bootstrap.cc:492] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:21.591150 22418 ts_tablet_manager.cc:1403] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.021s
I20260709 12:23:21.594698 22418 raft_consensus.cc:359] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.595606 22418 raft_consensus.cc:385] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.595985 22418 raft_consensus.cc:740] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.596899 22418 consensus_queue.cc:260] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.599794 22418 ts_tablet_manager.cc:1434] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:21.599983 22417 tablet_bootstrap.cc:492] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:21.600644 22417 ts_tablet_manager.cc:1403] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.013s
I20260709 12:23:21.601356 22418 tablet_bootstrap.cc:492] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:21.602998 22420 tablet_bootstrap.cc:654] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.604292 22417 raft_consensus.cc:359] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.605229 22417 raft_consensus.cc:385] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.605590 22417 raft_consensus.cc:740] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.606614 22417 consensus_queue.cc:260] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.609548 22417 ts_tablet_manager.cc:1434] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:21.609980 22418 tablet_bootstrap.cc:654] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.611045 22417 tablet_bootstrap.cc:492] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:21.620610 22417 tablet_bootstrap.cc:654] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.628595 22418 tablet_bootstrap.cc:492] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:21.628851 22417 tablet_bootstrap.cc:492] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:21.629241 22418 ts_tablet_manager.cc:1403] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.012s
I20260709 12:23:21.629390 22417 ts_tablet_manager.cc:1403] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:23:21.629758 22420 tablet_bootstrap.cc:492] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:21.629959 22434 raft_consensus.cc:493] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.630362 22420 ts_tablet_manager.cc:1403] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.005s
I20260709 12:23:21.630447 22434 raft_consensus.cc:515] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.632798 22417 raft_consensus.cc:359] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.632989 22418 raft_consensus.cc:359] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.633651 22417 raft_consensus.cc:385] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.633790 22418 raft_consensus.cc:385] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.634047 22417 raft_consensus.cc:740] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.634171 22418 raft_consensus.cc:740] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.633841 22420 raft_consensus.cc:359] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.635040 22420 raft_consensus.cc:385] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.635408 22420 raft_consensus.cc:740] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.635120 22418 consensus_queue.cc:260] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.635120 22417 consensus_queue.cc:260] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.638212 22418 ts_tablet_manager.cc:1434] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:21.638473 22417 ts_tablet_manager.cc:1434] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:23:21.639364 22418 tablet_bootstrap.cc:492] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:21.639868 22417 tablet_bootstrap.cc:492] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:21.642071 22402 raft_consensus.cc:493] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.642601 22402 raft_consensus.cc:515] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.645040 22402 leader_election.cc:290] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:21.646823 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af99285e428d4b28a92ad68f4db3415d" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:21.647375 22418 tablet_bootstrap.cc:654] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.647449 22417 tablet_bootstrap.cc:654] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:21.648660 22240 leader_election.cc:343] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:21.635218 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8d4f8b821a4c2b84251f2ee3589ed8" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:21.650554 22123 raft_consensus.cc:2468] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:21.652182 22164 leader_election.cc:304] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:21.636510 22420 consensus_queue.cc:260] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.653710 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af99285e428d4b28a92ad68f4db3415d" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:21.654387 22199 raft_consensus.cc:2468] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 0.
I20260709 12:23:21.654745 22420 ts_tablet_manager.cc:1434] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 12:23:21.655232 22333 raft_consensus.cc:2804] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:21.655651 22333 raft_consensus.cc:493] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.655987 22333 raft_consensus.cc:3060] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.660678 22417 tablet_bootstrap.cc:492] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:21.660714 22418 tablet_bootstrap.cc:492] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:21.661458 22417 ts_tablet_manager.cc:1403] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 12:23:21.661458 22418 ts_tablet_manager.cc:1403] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.011s
I20260709 12:23:21.664124 22419 raft_consensus.cc:493] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.664594 22419 raft_consensus.cc:515] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.664690 22417 raft_consensus.cc:359] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.664893 22418 raft_consensus.cc:359] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.665622 22418 raft_consensus.cc:385] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.665591 22417 raft_consensus.cc:385] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.666057 22418 raft_consensus.cc:740] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.666100 22417 raft_consensus.cc:740] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.666869 22419 leader_election.cc:290] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.667104 22418 consensus_queue.cc:260] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.667104 22417 consensus_queue.cc:260] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.670218 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5198a48e24f245628c71c2115fdb1c4c" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:21.670617 22417 ts_tablet_manager.cc:1434] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:23:21.670986 22272 raft_consensus.cc:2468] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 0.
I20260709 12:23:21.671913 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5198a48e24f245628c71c2115fdb1c4c" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:21.672262 22417 tablet_bootstrap.cc:492] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
I20260709 12:23:21.672649 22199 raft_consensus.cc:2468] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 0.
I20260709 12:23:21.674052 22088 leader_election.cc:304] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:21.674295 22420 tablet_bootstrap.cc:492] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:21.674991 22419 raft_consensus.cc:2804] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:21.675395 22419 raft_consensus.cc:493] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.675789 22419 raft_consensus.cc:3060] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.682706 22417 tablet_bootstrap.cc:654] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.683974 22239 leader_election.cc:304] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 1961a8b455844403ba3e96ade32c62e6
I20260709 12:23:21.635746 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8d4f8b821a4c2b84251f2ee3589ed8" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:21.632970 22434 leader_election.cc:290] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.691387 22402 raft_consensus.cc:2804] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:21.692059 22402 raft_consensus.cc:493] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.695804 22402 raft_consensus.cc:3060] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.697242 22417 tablet_bootstrap.cc:492] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:21.699318 22417 ts_tablet_manager.cc:1403] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.009s
I20260709 12:23:21.702998 22417 raft_consensus.cc:359] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.703699 22417 raft_consensus.cc:385] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.704063 22417 raft_consensus.cc:740] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.705108 22417 consensus_queue.cc:260] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.708570 22420 tablet_bootstrap.cc:654] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:21.714731 22164 leader_election.cc:343] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:21.717209 22333 raft_consensus.cc:515] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.725072 22417 ts_tablet_manager.cc:1434] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.025s	user 0.018s	sys 0.005s
I20260709 12:23:21.726552 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8d4f8b821a4c2b84251f2ee3589ed8" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:21.728609 22417 tablet_bootstrap.cc:492] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6: Bootstrap starting.
W20260709 12:23:21.729449 22164 leader_election.cc:343] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:21.732982 22333 leader_election.cc:290] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.734979 22333 raft_consensus.cc:493] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.735244 22417 tablet_bootstrap.cc:654] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.735610 22333 raft_consensus.cc:515] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.739833 22418 ts_tablet_manager.cc:1434] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.078s	user 0.036s	sys 0.036s
I20260709 12:23:21.741230 22418 tablet_bootstrap.cc:492] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10: Bootstrap starting.
I20260709 12:23:21.723170 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8d4f8b821a4c2b84251f2ee3589ed8" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:21.741833 22123 raft_consensus.cc:3060] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.747599 22418 tablet_bootstrap.cc:654] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.750422 22123 raft_consensus.cc:2468] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:21.751060 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e537ee7307b46c0aa74d261e08b058c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:21.751726 22164 leader_election.cc:304] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:21.752032 22122 raft_consensus.cc:2468] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:21.754068 22443 raft_consensus.cc:2804] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:21.759558 22164 leader_election.cc:304] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:21.762626 22434 raft_consensus.cc:2804] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:21.763003 22434 raft_consensus.cc:493] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.763345 22434 raft_consensus.cc:3060] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.721290 22419 raft_consensus.cc:515] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.769399 22402 raft_consensus.cc:515] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.758443 22443 raft_consensus.cc:697] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:21.772006 22333 leader_election.cc:290] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.774354 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e537ee7307b46c0aa74d261e08b058c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:21.774430 22443 consensus_queue.cc:237] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.775270 22273 raft_consensus.cc:2468] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:21.776713 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af99285e428d4b28a92ad68f4db3415d" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:21.777400 22123 raft_consensus.cc:3060] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.777599 22418 tablet_bootstrap.cc:492] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10: No bootstrap required, opened a new log
I20260709 12:23:21.778115 22418 ts_tablet_manager.cc:1403] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.008s
I20260709 12:23:21.779703 22417 tablet_bootstrap.cc:492] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6: No bootstrap required, opened a new log
I20260709 12:23:21.780191 22417 ts_tablet_manager.cc:1403] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.024s
I20260709 12:23:21.781893 22434 raft_consensus.cc:515] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.783671 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5198a48e24f245628c71c2115fdb1c4c" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:21.785017 22417 raft_consensus.cc:359] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.785568 22418 raft_consensus.cc:359] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.788987 22418 raft_consensus.cc:385] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.792817 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e537ee7307b46c0aa74d261e08b058c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:21.796500 22418 raft_consensus.cc:740] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.796800 22272 raft_consensus.cc:3060] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.793797 22019 catalog_manager.cc:5697] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.797406 22418 consensus_queue.cc:260] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.794030 22444 raft_consensus.cc:493] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.798635 22444 raft_consensus.cc:515] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.800132 22418 ts_tablet_manager.cc:1434] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 12:23:21.801494 22444 leader_election.cc:290] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:21.802129 22333 raft_consensus.cc:493] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.802742 22333 raft_consensus.cc:515] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.804823 22272 raft_consensus.cc:2468] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:21.805436 22333 leader_election.cc:290] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.786268 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5198a48e24f245628c71c2115fdb1c4c" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:21.807729 22273 raft_consensus.cc:3060] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.787739 22199 raft_consensus.cc:3060] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.792577 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e537ee7307b46c0aa74d261e08b058c" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:21.812063 22122 raft_consensus.cc:3060] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.812331 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0382d6294b479eb8ea32602f9963e4" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:21.813333 22121 raft_consensus.cc:2468] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 0.
I20260709 12:23:21.789551 22420 tablet_bootstrap.cc:492] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:21.814815 22420 ts_tablet_manager.cc:1403] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.004s
I20260709 12:23:21.819674 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0382d6294b479eb8ea32602f9963e4" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:21.820451 22197 raft_consensus.cc:2468] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 0.
I20260709 12:23:21.822340 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107fba7885024b38bed11fd59be1c274" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:21.823047 22121 raft_consensus.cc:2468] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:21.823069 22240 leader_election.cc:304] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:21.792603 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af99285e428d4b28a92ad68f4db3415d" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:21.827786 22198 raft_consensus.cc:3060] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.827822 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107fba7885024b38bed11fd59be1c274" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:21.828605 22274 raft_consensus.cc:2468] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:21.788249 22434 leader_election.cc:290] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.785977 22402 leader_election.cc:290] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:21.789592 22419 leader_election.cc:290] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 election: Requested vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.829881 22456 raft_consensus.cc:2804] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:21.788436 22417 raft_consensus.cc:385] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.830775 22456 raft_consensus.cc:493] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.830818 22417 raft_consensus.cc:740] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.818928 22420 raft_consensus.cc:359] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.831257 22456 raft_consensus.cc:3060] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.832782 22417 consensus_queue.cc:260] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.833218 22164 leader_election.cc:304] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:21.834220 22164 leader_election.cc:304] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:21.834977 22443 raft_consensus.cc:2804] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:21.835129 22417 ts_tablet_manager.cc:1434] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 12:23:21.835511 22443 raft_consensus.cc:697] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:21.835788 22454 raft_consensus.cc:2804] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:21.846295 22454 raft_consensus.cc:493] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.846661 22454 raft_consensus.cc:3060] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.846750 22443 consensus_queue.cc:237] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.838551 22198 raft_consensus.cc:2468] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 1.
I20260709 12:23:21.832804 22420 raft_consensus.cc:385] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.850418 22420 raft_consensus.cc:740] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.851497 22239 leader_election.cc:304] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:21.851348 22420 consensus_queue.cc:260] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.852721 22402 raft_consensus.cc:2804] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:21.795689 22123 raft_consensus.cc:2468] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 1.
I20260709 12:23:21.855144 22454 raft_consensus.cc:515] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.856844 22420 ts_tablet_manager.cc:1434] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:23:21.841849 22273 raft_consensus.cc:2468] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 1.
I20260709 12:23:21.844523 22122 raft_consensus.cc:2468] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:21.859552 22420 tablet_bootstrap.cc:492] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:21.860355 22089 leader_election.cc:304] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:21.861441 22446 raft_consensus.cc:2804] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:21.861922 22446 raft_consensus.cc:697] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 1 LEADER]: Becoming Leader. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:21.858146 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107fba7885024b38bed11fd59be1c274" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:21.864877 22123 raft_consensus.cc:3060] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.866664 22434 raft_consensus.cc:493] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.845590 22199 raft_consensus.cc:2468] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 1.
I20260709 12:23:21.844190 22456 raft_consensus.cc:515] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.858911 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107fba7885024b38bed11fd59be1c274" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:21.867980 22434 raft_consensus.cc:515] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.870433 22456 leader_election.cc:290] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:21.873804 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0382d6294b479eb8ea32602f9963e4" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:21.874722 22122 raft_consensus.cc:3060] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.868360 22454 leader_election.cc:290] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.878667 22434 leader_election.cc:290] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.880235 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0382d6294b479eb8ea32602f9963e4" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:21.862824 22446 consensus_queue.cc:237] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.880896 22197 raft_consensus.cc:3060] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.881007 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f9846b2af742c38a543ec2fdc9365d" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:21.884874 22420 tablet_bootstrap.cc:654] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.884480 22021 catalog_manager.cc:5697] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:21.889366 22164 leader_election.cc:343] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:21.890403 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f9846b2af742c38a543ec2fdc9365d" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:21.892134 22197 raft_consensus.cc:2468] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 1.
I20260709 12:23:21.892637 22402 raft_consensus.cc:697] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Becoming Leader. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:21.893942 22121 raft_consensus.cc:2468] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:21.894829 22402 consensus_queue.cc:237] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.888342 22272 raft_consensus.cc:3060] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.904083 22164 leader_election.cc:304] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:21.904337 22239 leader_election.cc:304] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:21.905323 22123 raft_consensus.cc:2468] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:21.905841 22456 raft_consensus.cc:2804] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:21.906414 22456 raft_consensus.cc:697] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Becoming Leader. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:21.907208 22434 raft_consensus.cc:2804] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:21.908120 22164 leader_election.cc:304] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:21.902323 22122 raft_consensus.cc:2468] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 1.
I20260709 12:23:21.908820 22272 raft_consensus.cc:2468] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:21.907351 22456 consensus_queue.cc:237] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.908325 22434 raft_consensus.cc:493] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.911605 22454 raft_consensus.cc:2804] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:21.911841 22434 raft_consensus.cc:3060] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.912220 22454 raft_consensus.cc:697] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:21.913062 22454 consensus_queue.cc:237] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.921092 22434 raft_consensus.cc:515] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.924260 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f9846b2af742c38a543ec2fdc9365d" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:21.924839 22122 raft_consensus.cc:3060] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.930656 22019 catalog_manager.cc:5697] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "1961a8b455844403ba3e96ade32c62e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.935916 22021 catalog_manager.cc:5697] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "69d10fe9c342437e82e166e1fae2f373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.938512 22434 leader_election.cc:290] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:21.938956 22122 raft_consensus.cc:2468] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:21.940215 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f9846b2af742c38a543ec2fdc9365d" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:21.940271 22164 leader_election.cc:304] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
W20260709 12:23:21.941843 22164 leader_election.cc:343] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:21.942469 22420 tablet_bootstrap.cc:492] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:21.943005 22420 ts_tablet_manager.cc:1403] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.006s
I20260709 12:23:21.943636 22434 raft_consensus.cc:2804] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:21.944142 22434 raft_consensus.cc:697] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:21.944902 22434 consensus_queue.cc:237] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.946337 22420 raft_consensus.cc:359] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.947082 22420 raft_consensus.cc:385] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.947381 22420 raft_consensus.cc:740] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.948159 22420 consensus_queue.cc:260] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.950675 22420 ts_tablet_manager.cc:1434] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:23:21.951804 22420 tablet_bootstrap.cc:492] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:21.958487 22420 tablet_bootstrap.cc:654] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.959012 22021 catalog_manager.cc:5697] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.962610 22019 catalog_manager.cc:5697] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3). New cstate: current_term: 1 leader_uuid: "69d10fe9c342437e82e166e1fae2f373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.969311 22420 tablet_bootstrap.cc:492] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:21.969861 22420 ts_tablet_manager.cc:1403] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.013s
I20260709 12:23:21.973598 22021 catalog_manager.cc:5697] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.974116 22420 raft_consensus.cc:359] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.974740 22420 raft_consensus.cc:385] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.974977 22420 raft_consensus.cc:740] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.975589 22420 consensus_queue.cc:260] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.977484 22420 ts_tablet_manager.cc:1434] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:21.978643 22420 tablet_bootstrap.cc:492] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373: Bootstrap starting.
I20260709 12:23:21.983579 22420 tablet_bootstrap.cc:654] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.988559 22420 tablet_bootstrap.cc:492] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373: No bootstrap required, opened a new log
I20260709 12:23:21.988971 22420 ts_tablet_manager.cc:1403] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373: Time spent bootstrapping tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:23:21.991173 22420 raft_consensus.cc:359] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.991750 22420 raft_consensus.cc:385] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.991969 22420 raft_consensus.cc:740] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.992476 22420 consensus_queue.cc:260] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:21.994318 22420 ts_tablet_manager.cc:1434] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:23:22.081523 22454 raft_consensus.cc:493] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.082042 22454 raft_consensus.cc:515] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.083881 22454 leader_election.cc:290] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:22.084731 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2ac6a3f97441fda4fc6b8ebaf77eb2" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:22.085003 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2ac6a3f97441fda4fc6b8ebaf77eb2" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:22.085374 22122 raft_consensus.cc:2468] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:22.085676 22272 raft_consensus.cc:2468] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:22.086520 22164 leader_election.cc:304] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:22.087249 22454 raft_consensus.cc:2804] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:22.087582 22454 raft_consensus.cc:493] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.087867 22454 raft_consensus.cc:3060] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.092944 22454 raft_consensus.cc:515] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.094595 22454 leader_election.cc:290] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:22.095466 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2ac6a3f97441fda4fc6b8ebaf77eb2" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:22.096117 22122 raft_consensus.cc:3060] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.095885 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2ac6a3f97441fda4fc6b8ebaf77eb2" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:22.096694 22272 raft_consensus.cc:3060] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.097851 22454 raft_consensus.cc:493] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.098542 22454 raft_consensus.cc:515] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.100410 22454 leader_election.cc:290] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:22.101094 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5836e7f2e943ee95b3d6480e287796" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:22.101619 22123 raft_consensus.cc:2468] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:22.103325 22122 raft_consensus.cc:2468] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:22.104372 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5836e7f2e943ee95b3d6480e287796" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373" is_pre_election: true
I20260709 12:23:22.104499 22164 leader_election.cc:304] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:22.104887 22273 raft_consensus.cc:2468] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 0.
I20260709 12:23:22.105542 22164 leader_election.cc:304] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:22.105763 22454 raft_consensus.cc:2804] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:22.106194 22454 raft_consensus.cc:493] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.106370 22434 raft_consensus.cc:2804] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:22.106885 22434 raft_consensus.cc:697] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:22.103613 22272 raft_consensus.cc:2468] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:22.107784 22454 raft_consensus.cc:3060] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.107596 22434 consensus_queue.cc:237] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.114887 22454 raft_consensus.cc:515] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.115875 22019 catalog_manager.cc:5697] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.116767 22454 leader_election.cc:290] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:22.117444 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5836e7f2e943ee95b3d6480e287796" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:22.117863 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5836e7f2e943ee95b3d6480e287796" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:22.118162 22122 raft_consensus.cc:3060] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.118489 22272 raft_consensus.cc:3060] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.125702 22122 raft_consensus.cc:2468] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:22.125702 22272 raft_consensus.cc:2468] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 1.
I20260709 12:23:22.127298 22164 leader_election.cc:304] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10; no voters: 
I20260709 12:23:22.128131 22454 raft_consensus.cc:2804] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:22.128702 22454 raft_consensus.cc:697] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:22.129388 22454 consensus_queue.cc:237] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.137461 22019 catalog_manager.cc:5697] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.155483 22454 consensus_queue.cc:1048] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.165844 22272 raft_consensus.cc:3060] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.175607 22454 consensus_queue.cc:1048] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.184264 22199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d5836e7f2e943ee95b3d6480e287796"
dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
mode: GRACEFUL
new_leader_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:48816
I20260709 12:23:22.184985 22199 raft_consensus.cc:606] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Received request to transfer leadership to TS 1961a8b455844403ba3e96ade32c62e6
I20260709 12:23:22.191744 22272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb0382d6294b479eb8ea32602f9963e4"
dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
mode: GRACEFUL
new_leader_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:53928
I20260709 12:23:22.192365 22272 raft_consensus.cc:606] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Received request to transfer leadership to TS 1961a8b455844403ba3e96ade32c62e6
I20260709 12:23:22.197676 22199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107fba7885024b38bed11fd59be1c274"
dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
mode: GRACEFUL
new_leader_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:48816
I20260709 12:23:22.198197 22199 raft_consensus.cc:606] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Received request to transfer leadership to TS 1961a8b455844403ba3e96ade32c62e6
I20260709 12:23:22.205447 22272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af99285e428d4b28a92ad68f4db3415d"
dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
mode: GRACEFUL
new_leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
 from {username='slave'} at 127.0.0.1:53928
I20260709 12:23:22.205920 22272 raft_consensus.cc:606] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Received request to transfer leadership to TS 1a0eabdd4fd148ce8418bda7c9d79c10
I20260709 12:23:22.215747 22199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e537ee7307b46c0aa74d261e08b058c"
dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
mode: GRACEFUL
new_leader_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:48816
I20260709 12:23:22.216223 22199 raft_consensus.cc:606] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Received request to transfer leadership to TS 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:22.266287 22402 raft_consensus.cc:493] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.266834 22402 raft_consensus.cc:515] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.268836 22402 leader_election.cc:290] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:22.269646 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f9846b2af742c38a543ec2fdc9365d" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1961a8b455844403ba3e96ade32c62e6" is_pre_election: true
I20260709 12:23:22.269981 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f9846b2af742c38a543ec2fdc9365d" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" is_pre_election: true
I20260709 12:23:22.270541 22122 raft_consensus.cc:2393] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69d10fe9c342437e82e166e1fae2f373 in current term 1: Already voted for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in this term.
I20260709 12:23:22.271924 22239 leader_election.cc:304] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69d10fe9c342437e82e166e1fae2f373; no voters: 1961a8b455844403ba3e96ade32c62e6, 1a0eabdd4fd148ce8418bda7c9d79c10
I20260709 12:23:22.272694 22402 raft_consensus.cc:3060] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.279403 22402 raft_consensus.cc:2749] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:22.285514 22434 consensus_queue.cc:1048] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:22.285897 22446 consensus_queue.cc:1048] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:22.288422 22434 consensus_queue.cc:1048] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.306383 22419 consensus_queue.cc:1048] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.319850 22456 consensus_queue.cc:1048] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.322520 22443 consensus_queue.cc:1048] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.323364 22333 raft_consensus.cc:993] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10: : Instructing follower 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:22.324007 22333 raft_consensus.cc:1081] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Signalling peer 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:22.325369 22456 consensus_queue.cc:1048] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:22.329788 22273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e537ee7307b46c0aa74d261e08b058c"
dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:53920
I20260709 12:23:22.330662 22273 raft_consensus.cc:493] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:22.331199 22273 raft_consensus.cc:3060] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.345376 22273 raft_consensus.cc:515] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.346680 22454 consensus_queue.cc:1048] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.348428 22273 leader_election.cc:290] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 2 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:22.350852 22199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e537ee7307b46c0aa74d261e08b058c" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:22.351500 22199 raft_consensus.cc:3055] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:22.351851 22199 raft_consensus.cc:740] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:22.352115 22274 raft_consensus.cc:1240] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Rejecting Update request from peer 1a0eabdd4fd148ce8418bda7c9d79c10 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:22.352804 22199 consensus_queue.cc:260] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.355508 22199 raft_consensus.cc:3060] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.360498 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e537ee7307b46c0aa74d261e08b058c" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:22.361196 22123 raft_consensus.cc:3060] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.362520 22456 consensus_queue.cc:1048] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:22.368095 22454 consensus_queue.cc:1048] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.383133 22456 consensus_queue.cc:1048] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.389684 22123 raft_consensus.cc:2468] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 2.
I20260709 12:23:22.390894 22240 leader_election.cc:304] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:22.391812 22443 raft_consensus.cc:993] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10: : Instructing follower 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:22.391978 22456 raft_consensus.cc:2804] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:22.392388 22443 raft_consensus.cc:1081] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Signalling peer 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:22.392800 22456 raft_consensus.cc:697] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 2 LEADER]: Becoming Leader. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:22.393760 22456 consensus_queue.cc:237] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.398638 22458 raft_consensus.cc:993] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373: : Instructing follower 1a0eabdd4fd148ce8418bda7c9d79c10 to start an election
I20260709 12:23:22.399166 22458 raft_consensus.cc:1081] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Signalling peer 1a0eabdd4fd148ce8418bda7c9d79c10 to start an election
I20260709 12:23:22.404534 22444 raft_consensus.cc:993] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373: : Instructing follower 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:22.404953 22444 raft_consensus.cc:1081] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Signalling peer 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:22.406730 22196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af99285e428d4b28a92ad68f4db3415d"
dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
 from {username='slave'} at 127.0.0.1:48814
I20260709 12:23:22.407366 22196 raft_consensus.cc:493] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:22.407768 22196 raft_consensus.cc:3060] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.408432 22199 raft_consensus.cc:2468] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 2.
I20260709 12:23:22.420327 22333 consensus_queue.cc:1048] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.422086 22196 raft_consensus.cc:515] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.422436 22119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb0382d6294b479eb8ea32602f9963e4"
dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:43064
I20260709 12:23:22.423123 22119 raft_consensus.cc:493] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:22.423542 22119 raft_consensus.cc:3060] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.424314 22196 leader_election.cc:290] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 2 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:22.427927 22121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "107fba7885024b38bed11fd59be1c274"
dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:43052
I20260709 12:23:22.428572 22121 raft_consensus.cc:493] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:22.428958 22121 raft_consensus.cc:3060] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.432986 22274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af99285e428d4b28a92ad68f4db3415d" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:22.433670 22274 raft_consensus.cc:3055] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:22.433964 22274 raft_consensus.cc:740] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:22.434532 22119 raft_consensus.cc:515] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.434818 22274 consensus_queue.cc:260] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.436257 22274 raft_consensus.cc:3060] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.436753 22121 raft_consensus.cc:515] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.441169 22273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107fba7885024b38bed11fd59be1c274" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:22.441839 22273 raft_consensus.cc:3060] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.442023 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0382d6294b479eb8ea32602f9963e4" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:22.443645 22119 leader_election.cc:290] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Requested vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:22.445780 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af99285e428d4b28a92ad68f4db3415d" candidate_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:22.459632 22122 raft_consensus.cc:3060] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.463086 22019 catalog_manager.cc:5697] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 reported cstate change: term changed from 1 to 2, leader changed from 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2) to 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "69d10fe9c342437e82e166e1fae2f373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:22.453898 22273 raft_consensus.cc:2468] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 2.
I20260709 12:23:22.466969 22089 leader_election.cc:304] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:22.468232 22419 raft_consensus.cc:2804] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:22.445248 22121 leader_election.cc:290] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Requested vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:22.447446 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0382d6294b479eb8ea32602f9963e4" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:22.469338 22271 raft_consensus.cc:3055] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:22.468739 22419 raft_consensus.cc:697] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Becoming Leader. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:22.469731 22271 raft_consensus.cc:740] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:22.458777 22274 raft_consensus.cc:2468] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 2.
I20260709 12:23:22.466197 22122 raft_consensus.cc:2468] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0eabdd4fd148ce8418bda7c9d79c10 in term 2.
I20260709 12:23:22.470419 22419 consensus_queue.cc:237] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.470669 22271 consensus_queue.cc:260] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.472152 22271 raft_consensus.cc:3060] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.472594 22164 leader_election.cc:304] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:22.473425 22333 raft_consensus.cc:2804] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:22.473902 22333 raft_consensus.cc:697] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 LEADER]: Becoming Leader. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:22.474709 22333 consensus_queue.cc:237] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.458163 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107fba7885024b38bed11fd59be1c274" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:22.477891 22196 raft_consensus.cc:3055] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:22.478235 22196 raft_consensus.cc:740] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:22.479053 22196 consensus_queue.cc:260] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.480394 22196 raft_consensus.cc:3060] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.479633 22019 catalog_manager.cc:5697] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 reported cstate change: term changed from 1 to 2, leader changed from 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2) to 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "1961a8b455844403ba3e96ade32c62e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.482275 22271 raft_consensus.cc:2468] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 2.
I20260709 12:23:22.483415 22089 leader_election.cc:304] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 1a0eabdd4fd148ce8418bda7c9d79c10
I20260709 12:23:22.484570 22419 raft_consensus.cc:2804] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:22.485038 22419 raft_consensus.cc:697] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Becoming Leader. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:22.486282 22419 consensus_queue.cc:237] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.488476 22018 catalog_manager.cc:5697] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 reported cstate change: term changed from 1 to 2, leader changed from 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3) to 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2). New cstate: current_term: 2 leader_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.491631 22196 raft_consensus.cc:2468] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 2.
I20260709 12:23:22.501034 22021 catalog_manager.cc:5697] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 reported cstate change: term changed from 1 to 2, leader changed from 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3) to 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "1961a8b455844403ba3e96ade32c62e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.536321 22333 consensus_queue.cc:1048] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.546552 22434 consensus_queue.cc:1048] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.595291 22434 consensus_queue.cc:1048] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.602227 22454 raft_consensus.cc:993] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10: : Instructing follower 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:22.602754 22443 raft_consensus.cc:1081] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Signalling peer 1961a8b455844403ba3e96ade32c62e6 to start an election
I20260709 12:23:22.605288 22121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d5836e7f2e943ee95b3d6480e287796"
dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
 from {username='slave'} at 127.0.0.1:43052
I20260709 12:23:22.605926 22121 raft_consensus.cc:493] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:22.606340 22121 raft_consensus.cc:3060] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.608534 22434 consensus_queue.cc:1048] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.616425 22121 raft_consensus.cc:515] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.618709 22121 leader_election.cc:290] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Requested vote from peers 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363), 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3:32891)
I20260709 12:23:22.620122 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5836e7f2e943ee95b3d6480e287796" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:22.620697 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d5836e7f2e943ee95b3d6480e287796" candidate_uuid: "1961a8b455844403ba3e96ade32c62e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
I20260709 12:23:22.620940 22196 raft_consensus.cc:3055] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:22.621342 22271 raft_consensus.cc:3060] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.621447 22196 raft_consensus.cc:740] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:22.622570 22196 consensus_queue.cc:260] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.623971 22196 raft_consensus.cc:3060] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.627941 22271 raft_consensus.cc:2468] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 2.
I20260709 12:23:22.629256 22089 leader_election.cc:304] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:22.629995 22419 raft_consensus.cc:2804] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:22.630445 22419 raft_consensus.cc:697] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Becoming Leader. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:22.630863 22196 raft_consensus.cc:2468] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1961a8b455844403ba3e96ade32c62e6 in term 2.
I20260709 12:23:22.631289 22419 consensus_queue.cc:237] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:22.639127 22021 catalog_manager.cc:5697] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 reported cstate change: term changed from 1 to 2, leader changed from 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2) to 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "1961a8b455844403ba3e96ade32c62e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.784402 22121 raft_consensus.cc:1275] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.786043 22456 consensus_queue.cc:1048] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.796530 22196 raft_consensus.cc:1275] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.805006 22456 consensus_queue.cc:1048] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.874173 22121 raft_consensus.cc:1275] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Refusing update from remote peer 1a0eabdd4fd148ce8418bda7c9d79c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.874655 22197 raft_consensus.cc:1275] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.875411 22434 consensus_queue.cc:1048] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.876057 22419 consensus_queue.cc:1048] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.890115 22271 raft_consensus.cc:1275] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Refusing update from remote peer 1a0eabdd4fd148ce8418bda7c9d79c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.891561 22274 raft_consensus.cc:1275] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.891841 22443 consensus_queue.cc:1048] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:22.896477 22419 consensus_queue.cc:1048] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.948330 22271 raft_consensus.cc:1275] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.949627 22419 consensus_queue.cc:1048] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.959103 22196 raft_consensus.cc:3060] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.967301 22196 raft_consensus.cc:1275] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.968825 22493 consensus_queue.cc:1048] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:23.021937 22271 raft_consensus.cc:1275] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:23.023267 22493 consensus_queue.cc:1048] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:23.031142 22196 raft_consensus.cc:1275] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Refusing update from remote peer 1961a8b455844403ba3e96ade32c62e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:23.033913 22493 consensus_queue.cc:1048] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:25.219596 22021 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36586:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:23:25.240046 22021 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36586:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:23:25.282990 11916 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:25.432296 22539 tablet.cc:1724] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.450837 22538 tablet.cc:1724] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:25.488974 22164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:41447, user_credentials={real_user=slave}} blocked reactor thread for 77654.7us
W20260709 12:23:25.496528 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.2:41363, user_credentials={real_user=slave}} blocked reactor thread for 51798.7us
I20260709 12:23:25.497437 22550 tablet.cc:1724] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:25.522435 22226 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:b9f9846b2af742c38a543ec2fdc9365d)
I20260709 12:23:25.426311 22534 tablet.cc:1724] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:25.531599 22226 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:b9f9846b2af742c38a543ec2fdc9365d)
W20260709 12:23:25.564653 22545 log.cc:927] Time spent T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:23:25.455780 22531 tablet.cc:1724] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.624902 22561 tablet.cc:1724] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.625245 22538 tablet.cc:1724] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:25.635407 22164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:41447, user_credentials={real_user=slave}} blocked reactor thread for 96962.3us
I20260709 12:23:25.643116 22534 tablet.cc:1724] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.582065 22556 tablet.cc:1724] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:25.646678 22089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.3:32891, user_credentials={real_user=slave}} blocked reactor thread for 52351.6us
W20260709 12:23:25.663198 22149 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:5198a48e24f245628c71c2115fdb1c4c)
I20260709 12:23:25.668345 22550 tablet.cc:1724] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.680460 22539 tablet.cc:1724] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.690027 22565 tablet.cc:1724] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.700107 22122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107fba7885024b38bed11fd59be1c274"
dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
mode: GRACEFUL
new_leader_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:56442
I20260709 12:23:25.699883 22557 tablet.cc:1724] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.700759 22122 raft_consensus.cc:606] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Received request to transfer leadership to TS 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:25.706336 22534 tablet.cc:1724] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.712285 22566 tablet.cc:1724] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.741248 22539 tablet.cc:1724] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.764046 22556 tablet.cc:1724] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.769960 22569 tablet.cc:1724] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.770764 22565 tablet.cc:1724] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.776664 22571 tablet.cc:1724] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.764446 22557 tablet.cc:1724] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.779484 22533 raft_consensus.cc:993] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6: : Instructing follower 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:25.780010 22533 raft_consensus.cc:1081] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Signalling peer 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:25.782830 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "107fba7885024b38bed11fd59be1c274"
dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:53916
I20260709 12:23:25.783483 22269 raft_consensus.cc:493] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.783860 22269 raft_consensus.cc:3060] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.787290 22534 tablet.cc:1724] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.798631 22269 raft_consensus.cc:515] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:25.764595 22550 tablet.cc:1724] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.811054 22566 tablet.cc:1724] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.818125 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107fba7885024b38bed11fd59be1c274" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:25.818835 22119 raft_consensus.cc:3055] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:25.819139 22119 raft_consensus.cc:740] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:25.819970 22119 consensus_queue.cc:260] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:25.822136 22119 raft_consensus.cc:3060] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.823077 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107fba7885024b38bed11fd59be1c274" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:25.823741 22197 raft_consensus.cc:3060] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.827526 22269 leader_election.cc:290] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 3 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:25.836179 22569 tablet.cc:1724] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.841820 22566 tablet.cc:1724] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.843281 22197 raft_consensus.cc:2468] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 3.
I20260709 12:23:25.842698 22565 tablet.cc:1724] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:25.848536 22239 leader_election.cc:304] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:25.849582 22564 raft_consensus.cc:2804] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:25.850054 22564 raft_consensus.cc:697] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 3 LEADER]: Becoming Leader. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:25.850880 22564 consensus_queue.cc:237] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:25.853852 22119 raft_consensus.cc:2468] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 3.
I20260709 12:23:25.855046 22197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9f9846b2af742c38a543ec2fdc9365d"
dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
mode: GRACEFUL
new_leader_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:49828
I20260709 12:23:25.855786 22197 raft_consensus.cc:606] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Received request to transfer leadership to TS 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:25.857306 11916 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:23:25.857978 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:25.863541 22018 catalog_manager.cc:6242] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3: soft_deleted_table [id=d4a8da6fc76d423d8096f4cbe46a5e7c] alter complete (version 1)
I20260709 12:23:25.876559 22119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888"
dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
mode: GRACEFUL
new_leader_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:56442
I20260709 12:23:25.877116 22119 raft_consensus.cc:606] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Received request to transfer leadership to TS 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:25.879829 22197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c"
dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
mode: GRACEFUL
new_leader_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:49828
I20260709 12:23:25.880530 22197 raft_consensus.cc:606] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 LEADER]: Received request to transfer leadership to TS 69d10fe9c342437e82e166e1fae2f373
I20260709 12:23:25.882046 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:25.882525 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:25.882578 22021 catalog_manager.cc:5697] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 reported cstate change: term changed from 2 to 3, leader changed from 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1) to 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3). New cstate: current_term: 3 leader_uuid: "69d10fe9c342437e82e166e1fae2f373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:25.895040 22533 raft_consensus.cc:993] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6: : Instructing follower 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:25.895670 22498 raft_consensus.cc:1081] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Signalling peer 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:25.897437 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888"
dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:53916
I20260709 12:23:25.897966 22269 raft_consensus.cc:493] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.898285 22269 raft_consensus.cc:3060] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.903929 22269 raft_consensus.cc:515] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:25.905598 22269 leader_election.cc:290] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 3 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:25.906531 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:25.906881 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a988e71e2184f30b491ca8b79297888" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:25.907267 22119 raft_consensus.cc:3055] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:25.907651 22119 raft_consensus.cc:740] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1961a8b455844403ba3e96ade32c62e6, State: Running, Role: LEADER
I20260709 12:23:25.907681 22197 raft_consensus.cc:3060] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.908488 22119 consensus_queue.cc:260] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:25.909746 22119 raft_consensus.cc:3060] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:25.914563 22197 raft_consensus.cc:2468] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 3.
I20260709 12:23:25.915568 22119 raft_consensus.cc:2468] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 3.
I20260709 12:23:25.915812 22239 leader_election.cc:304] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0eabdd4fd148ce8418bda7c9d79c10, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:25.916898 22564 raft_consensus.cc:2804] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:25.917409 22564 raft_consensus.cc:697] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 3 LEADER]: Becoming Leader. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:25.918087 22564 consensus_queue.cc:237] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } }
I20260709 12:23:25.926363 22021 catalog_manager.cc:5697] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 reported cstate change: term changed from 2 to 3, leader changed from 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1) to 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3). New cstate: current_term: 3 leader_uuid: "69d10fe9c342437e82e166e1fae2f373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.221009 22540 raft_consensus.cc:993] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10: : Instructing follower 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:26.221570 22542 raft_consensus.cc:1081] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 LEADER]: Signalling peer 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:26.223026 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c"
dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:53920
I20260709 12:23:26.223658 22269 raft_consensus.cc:493] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.223928 22269 raft_consensus.cc:3060] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.229075 22269 raft_consensus.cc:515] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:26.230805 22269 leader_election.cc:290] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 3 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:26.231594 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:26.231878 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4758cb763e4d42a686d2b9980b22cd3c" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:26.232437 22119 raft_consensus.cc:3060] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.232618 22197 raft_consensus.cc:3055] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:26.233014 22122 raft_consensus.cc:1275] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:26.233078 22197 raft_consensus.cc:740] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:26.234117 22197 consensus_queue.cc:260] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:26.234565 22564 consensus_queue.cc:1048] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:26.235555 22197 raft_consensus.cc:3060] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.240598 22119 raft_consensus.cc:2468] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 3.
I20260709 12:23:26.241910 22240 leader_election.cc:304] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:26.242928 22496 raft_consensus.cc:2804] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:26.247651 22197 raft_consensus.cc:2468] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 3.
I20260709 12:23:26.252985 22496 raft_consensus.cc:697] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 3 LEADER]: Becoming Leader. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:26.254263 22496 consensus_queue.cc:237] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:26.257483 22197 raft_consensus.cc:1275] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:26.258996 22542 raft_consensus.cc:993] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10: : Instructing follower 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:26.259650 22542 raft_consensus.cc:1081] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Signalling peer 69d10fe9c342437e82e166e1fae2f373 to start an election
I20260709 12:23:26.262480 22496 consensus_queue.cc:1048] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:26.264154 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9f9846b2af742c38a543ec2fdc9365d"
dest_uuid: "69d10fe9c342437e82e166e1fae2f373"
 from {username='slave'} at 127.0.0.1:53920
I20260709 12:23:26.264797 22269 raft_consensus.cc:493] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.265172 22269 raft_consensus.cc:3060] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.267362 22019 catalog_manager.cc:5697] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 reported cstate change: term changed from 2 to 3, leader changed from 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2) to 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3). New cstate: current_term: 3 leader_uuid: "69d10fe9c342437e82e166e1fae2f373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.276396 22269 raft_consensus.cc:515] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:26.282683 22269 leader_election.cc:290] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 2 election: Requested vote from peers 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447), 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363)
I20260709 12:23:26.283571 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f9846b2af742c38a543ec2fdc9365d" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1961a8b455844403ba3e96ade32c62e6"
I20260709 12:23:26.284273 22122 raft_consensus.cc:3060] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.285053 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f9846b2af742c38a543ec2fdc9365d" candidate_uuid: "69d10fe9c342437e82e166e1fae2f373" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10"
I20260709 12:23:26.285710 22196 raft_consensus.cc:3055] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:26.286069 22196 raft_consensus.cc:740] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a0eabdd4fd148ce8418bda7c9d79c10, State: Running, Role: LEADER
I20260709 12:23:26.286986 22196 consensus_queue.cc:260] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:26.288334 22196 raft_consensus.cc:3060] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.290197 22122 raft_consensus.cc:2468] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 2.
I20260709 12:23:26.291461 22240 leader_election.cc:304] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1961a8b455844403ba3e96ade32c62e6, 69d10fe9c342437e82e166e1fae2f373; no voters: 
I20260709 12:23:26.292229 22496 raft_consensus.cc:2804] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:26.292699 22496 raft_consensus.cc:697] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 2 LEADER]: Becoming Leader. State: Replica: 69d10fe9c342437e82e166e1fae2f373, State: Running, Role: LEADER
I20260709 12:23:26.293874 22496 consensus_queue.cc:237] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } }
I20260709 12:23:26.294818 22196 raft_consensus.cc:2468] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69d10fe9c342437e82e166e1fae2f373 in term 2.
I20260709 12:23:26.301159 22019 catalog_manager.cc:5697] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 reported cstate change: term changed from 1 to 2, leader changed from 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2) to 69d10fe9c342437e82e166e1fae2f373 (127.11.163.3). New cstate: current_term: 2 leader_uuid: "69d10fe9c342437e82e166e1fae2f373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d10fe9c342437e82e166e1fae2f373" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 32891 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.340224 22122 raft_consensus.cc:1275] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:26.341394 22496 consensus_queue.cc:1048] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.353058 22196 raft_consensus.cc:1275] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:26.354568 22580 consensus_queue.cc:1048] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.665618 22119 raft_consensus.cc:1275] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:26.667166 22580 consensus_queue.cc:1048] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.676795 22196 raft_consensus.cc:1275] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:26.678906 22496 consensus_queue.cc:1048] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.739253 22119 raft_consensus.cc:1275] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:26.740684 22496 consensus_queue.cc:1048] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1961a8b455844403ba3e96ade32c62e6" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 41447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.751603 22196 raft_consensus.cc:1275] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Refusing update from remote peer 69d10fe9c342437e82e166e1fae2f373: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:26.753153 22580 consensus_queue.cc:1048] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0eabdd4fd148ce8418bda7c9d79c10" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.883682 11916 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:26.889779 11916 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:26.890232 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.894898 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:26.895305 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:28.433218 11916 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:28.442220 11916 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:28.442807 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:28.450796 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:28.451465 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:29.412858 22221 debug-util.cc:398] Leaking SignalData structure 0x7b08001a1e20 after lost signal to thread 11919
W20260709 12:23:29.414415 22221 debug-util.cc:398] Leaking SignalData structure 0x7b08002630c0 after lost signal to thread 22055
W20260709 12:23:29.415998 22221 debug-util.cc:398] Leaking SignalData structure 0x7b0800198700 after lost signal to thread 22147
W20260709 12:23:29.417443 22221 debug-util.cc:398] Leaking SignalData structure 0x7b0800210160 after lost signal to thread 22224
W20260709 12:23:29.418864 22221 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2600 after lost signal to thread 22298
I20260709 12:23:29.453111 11916 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:29.464536 11916 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:29.465387 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:29.475450 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:29.476042 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:30.477588 11916 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:30.485992 11916 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:30.486632 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:30.494448 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:30.495023 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:31.496203 11916 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:31.501617 11916 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:31.502084 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:31.508878 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:31.509407 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:32.510633 11916 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:32.517146 11916 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:32.517720 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:32.523104 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:32.523663 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:33.524693 11916 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:33.530823 11916 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:33.531371 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:33.536681 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:33.537019 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:34.537958 11916 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:34.543111 11916 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:34.543648 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:34.549697 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:34.550145 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:35.551086 11916 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:35.556391 11916 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:35.556856 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:35.561780 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:35.562166 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:36.769332 11916 tablet_server.cc:179] TabletServer@127.11.163.1:0 shutting down...
W20260709 12:23:36.771323 22164 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260709 12:23:36.776896 22164 consensus_peers.cc:597] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 -> Peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Couldn't send request to peer 1961a8b455844403ba3e96ade32c62e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.823379 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:36.824487 11916 tablet_replica.cc:333] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.825829 11916 raft_consensus.cc:2243] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.827003 11916 raft_consensus.cc:2272] T b9f9846b2af742c38a543ec2fdc9365d P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.830000 11916 tablet_replica.cc:333] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.830639 11916 raft_consensus.cc:2243] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.831149 11916 raft_consensus.cc:2272] T af99285e428d4b28a92ad68f4db3415d P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.833509 11916 tablet_replica.cc:333] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.834148 11916 raft_consensus.cc:2243] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.834667 11916 raft_consensus.cc:2272] T 7e537ee7307b46c0aa74d261e08b058c P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.837155 11916 tablet_replica.cc:333] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.837723 11916 raft_consensus.cc:2243] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.838686 11916 raft_consensus.cc:2272] T bb0382d6294b479eb8ea32602f9963e4 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.841533 11916 tablet_replica.cc:333] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.842336 11916 raft_consensus.cc:2243] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.843417 11916 raft_consensus.cc:2272] T f983b1b0b120466c8fc0ed57bccc75ea P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.844147 22164 consensus_peers.cc:597] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 -> Peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Couldn't send request to peer 1961a8b455844403ba3e96ade32c62e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.846547 11916 tablet_replica.cc:333] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.847611 11916 raft_consensus.cc:2243] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.848359 11916 raft_consensus.cc:2272] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.851663 11916 tablet_replica.cc:333] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.852358 11916 raft_consensus.cc:2243] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.853416 11916 raft_consensus.cc:2272] T 6117ae0919d641858d3d0f01771e8235 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.856336 11916 tablet_replica.cc:333] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.857059 11916 raft_consensus.cc:2243] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.857751 11916 raft_consensus.cc:2272] T 4758cb763e4d42a686d2b9980b22cd3c P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.861248 11916 tablet_replica.cc:333] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.861989 11916 raft_consensus.cc:2243] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.862676 11916 raft_consensus.cc:2272] T 40d40f3527564fcf9ae7a26091aadbca P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.862759 22240 consensus_peers.cc:597] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Couldn't send request to peer 1961a8b455844403ba3e96ade32c62e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.865547 11916 tablet_replica.cc:333] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.866247 11916 raft_consensus.cc:2243] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.866792 11916 raft_consensus.cc:2272] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.869052 11916 tablet_replica.cc:333] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.869612 11916 raft_consensus.cc:2243] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.870200 11916 raft_consensus.cc:2272] T 107fba7885024b38bed11fd59be1c274 P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.872797 11916 tablet_replica.cc:333] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.873359 11916 raft_consensus.cc:2243] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.873814 11916 raft_consensus.cc:2272] T f082a8768d0f41d784bee6b15953d02c P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.876242 11916 tablet_replica.cc:333] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.876819 11916 raft_consensus.cc:2243] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.877902 11916 raft_consensus.cc:2272] T 4da28cc087bf4d35987931c43924880b P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.880985 11916 tablet_replica.cc:333] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.881572 11916 raft_consensus.cc:2243] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.882059 11916 raft_consensus.cc:2272] T 761cfccd5770414ca935bda6f6140032 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.885142 11916 tablet_replica.cc:333] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.885816 11916 raft_consensus.cc:2243] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.887548 11916 raft_consensus.cc:2272] T 9d5836e7f2e943ee95b3d6480e287796 P 1961a8b455844403ba3e96ade32c62e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.890506 11916 tablet_replica.cc:333] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.891077 11916 raft_consensus.cc:2243] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.891732 11916 raft_consensus.cc:2272] T 1a988e71e2184f30b491ca8b79297888 P 1961a8b455844403ba3e96ade32c62e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.894004 11916 tablet_replica.cc:333] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.894538 11916 raft_consensus.cc:2243] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.894984 11916 raft_consensus.cc:2272] T de9afac631f146f3b6f05430fce53fd8 P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.897280 11916 tablet_replica.cc:333] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6: stopping tablet replica
I20260709 12:23:36.897759 11916 raft_consensus.cc:2243] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.898607 11916 raft_consensus.cc:2272] T 5198a48e24f245628c71c2115fdb1c4c P 1961a8b455844403ba3e96ade32c62e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.928411 22240 connection.cc:573] client connection to 127.11.163.1:41447 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:23:36.929060 22240 consensus_peers.cc:597] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Couldn't send request to peer 1961a8b455844403ba3e96ade32c62e6. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.943620 11916 tablet_server.cc:196] TabletServer@127.11.163.1:0 shutdown complete.
W20260709 12:23:36.983700 22240 consensus_peers.cc:597] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Couldn't send request to peer 1961a8b455844403ba3e96ade32c62e6. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:41447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.995671 11916 tablet_server.cc:179] TabletServer@127.11.163.2:0 shutting down...
W20260709 12:23:37.003232 22239 consensus_peers.cc:597] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Couldn't send request to peer 1a0eabdd4fd148ce8418bda7c9d79c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.028298 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:37.029208 11916 tablet_replica.cc:333] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.030189 11916 raft_consensus.cc:2243] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.030853 11916 raft_consensus.cc:2272] T bb0382d6294b479eb8ea32602f9963e4 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.033707 11916 tablet_replica.cc:333] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.034348 11916 raft_consensus.cc:2243] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.034914 11916 raft_consensus.cc:2272] T 9d5836e7f2e943ee95b3d6480e287796 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.037443 11916 tablet_replica.cc:333] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.038117 11916 raft_consensus.cc:2243] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.038648 11916 raft_consensus.cc:2272] T 7e537ee7307b46c0aa74d261e08b058c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.041069 11916 tablet_replica.cc:333] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.041668 11916 raft_consensus.cc:2243] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.042155 11916 raft_consensus.cc:2272] T b9f9846b2af742c38a543ec2fdc9365d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.044687 11916 tablet_replica.cc:333] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.045315 11916 raft_consensus.cc:2243] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.046360 11916 raft_consensus.cc:2272] T af99285e428d4b28a92ad68f4db3415d P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.049063 11916 tablet_replica.cc:333] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.049881 11916 raft_consensus.cc:2243] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.050427 11916 raft_consensus.cc:2272] T 4758cb763e4d42a686d2b9980b22cd3c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.053120 11916 tablet_replica.cc:333] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.053773 11916 raft_consensus.cc:2243] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.054307 11916 raft_consensus.cc:2272] T 40d40f3527564fcf9ae7a26091aadbca P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.056725 11916 tablet_replica.cc:333] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.057368 11916 raft_consensus.cc:2243] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.058367 11916 raft_consensus.cc:2272] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.061082 11916 tablet_replica.cc:333] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.061712 11916 raft_consensus.cc:2243] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.062213 11916 raft_consensus.cc:2272] T 6117ae0919d641858d3d0f01771e8235 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.065101 11916 tablet_replica.cc:333] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.065836 11916 raft_consensus.cc:2243] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.066365 11916 raft_consensus.cc:2272] T 5198a48e24f245628c71c2115fdb1c4c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.068742 11916 tablet_replica.cc:333] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.069286 11916 raft_consensus.cc:2243] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.070268 11916 raft_consensus.cc:2272] T de9afac631f146f3b6f05430fce53fd8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.072718 11916 tablet_replica.cc:333] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.073279 11916 raft_consensus.cc:2243] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.073784 11916 raft_consensus.cc:2272] T 1a988e71e2184f30b491ca8b79297888 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.076119 11916 tablet_replica.cc:333] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.076653 11916 raft_consensus.cc:2243] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.077150 11916 raft_consensus.cc:2272] T 4da28cc087bf4d35987931c43924880b P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.079512 11916 tablet_replica.cc:333] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.080049 11916 raft_consensus.cc:2243] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.081038 11916 raft_consensus.cc:2272] T 761cfccd5770414ca935bda6f6140032 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.083690 11916 tablet_replica.cc:333] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.084225 11916 raft_consensus.cc:2243] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.085088 11916 raft_consensus.cc:2272] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.087802 11916 tablet_replica.cc:333] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.088378 11916 raft_consensus.cc:2243] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.089052 11916 raft_consensus.cc:2272] T 107fba7885024b38bed11fd59be1c274 P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.090070 22239 consensus_peers.cc:597] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Couldn't send request to peer 1a0eabdd4fd148ce8418bda7c9d79c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.091856 11916 tablet_replica.cc:333] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.092566 11916 raft_consensus.cc:2243] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.093523 11916 raft_consensus.cc:2272] T f082a8768d0f41d784bee6b15953d02c P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.096108 11916 tablet_replica.cc:333] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10: stopping tablet replica
I20260709 12:23:37.096681 11916 raft_consensus.cc:2243] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.097225 11916 raft_consensus.cc:2272] T f983b1b0b120466c8fc0ed57bccc75ea P 1a0eabdd4fd148ce8418bda7c9d79c10 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.142434 22240 consensus_peers.cc:597] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Couldn't send request to peer 1961a8b455844403ba3e96ade32c62e6. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:41447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.230197 22239 consensus_peers.cc:597] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Couldn't send request to peer 1a0eabdd4fd148ce8418bda7c9d79c10. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:41363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.262436 22239 consensus_peers.cc:597] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Couldn't send request to peer 1a0eabdd4fd148ce8418bda7c9d79c10. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:41363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.298758 22221 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1c00 after lost signal to thread 11919
W20260709 12:23:37.299892 22221 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1d00 after lost signal to thread 22055
W20260709 12:23:37.301054 22221 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3ee0 after lost signal to thread 22147
W20260709 12:23:37.302387 22221 debug-util.cc:398] Leaking SignalData structure 0x7b080015f220 after lost signal to thread 22224
W20260709 12:23:37.303367 22221 debug-util.cc:398] Leaking SignalData structure 0x7b08003de560 after lost signal to thread 22298
W20260709 12:23:37.318053 22240 consensus_peers.cc:597] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Couldn't send request to peer 1961a8b455844403ba3e96ade32c62e6. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:41447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.321758 22239 consensus_peers.cc:597] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Couldn't send request to peer 1a0eabdd4fd148ce8418bda7c9d79c10. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:41363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.328281 22240 consensus_peers.cc:597] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1961a8b455844403ba3e96ade32c62e6 (127.11.163.1:41447): Couldn't send request to peer 1961a8b455844403ba3e96ade32c62e6. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:41447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.337746 11916 tablet_server.cc:196] TabletServer@127.11.163.2:0 shutdown complete.
I20260709 12:23:37.380574 11916 tablet_server.cc:179] TabletServer@127.11.163.3:0 shutting down...
I20260709 12:23:37.414611 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:37.415346 11916 tablet_replica.cc:333] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.416162 11916 raft_consensus.cc:2243] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.416764 11916 raft_consensus.cc:2272] T 9d5836e7f2e943ee95b3d6480e287796 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.419386 11916 tablet_replica.cc:333] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.420163 11916 raft_consensus.cc:2243] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.421389 11916 raft_consensus.cc:2272] T b9f9846b2af742c38a543ec2fdc9365d P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.424360 22239 consensus_peers.cc:597] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 -> Peer 1a0eabdd4fd148ce8418bda7c9d79c10 (127.11.163.2:41363): Couldn't send request to peer 1a0eabdd4fd148ce8418bda7c9d79c10. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:41363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.424690 11916 tablet_replica.cc:333] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.425516 11916 raft_consensus.cc:2243] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.426738 11916 raft_consensus.cc:2272] T 7e537ee7307b46c0aa74d261e08b058c P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.430083 11916 tablet_replica.cc:333] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.430646 11916 raft_consensus.cc:2243] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.431118 11916 raft_consensus.cc:2272] T af99285e428d4b28a92ad68f4db3415d P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.433279 11916 tablet_replica.cc:333] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.433769 11916 raft_consensus.cc:2243] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.434227 11916 raft_consensus.cc:2272] T bb0382d6294b479eb8ea32602f9963e4 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.436182 11916 tablet_replica.cc:333] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.436690 11916 raft_consensus.cc:2243] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.437088 11916 raft_consensus.cc:2272] T 8c8d4f8b821a4c2b84251f2ee3589ed8 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.439136 11916 tablet_replica.cc:333] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.439741 11916 raft_consensus.cc:2243] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.440131 11916 raft_consensus.cc:2272] T f082a8768d0f41d784bee6b15953d02c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.442183 11916 tablet_replica.cc:333] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.442648 11916 raft_consensus.cc:2243] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.443418 11916 raft_consensus.cc:2272] T 107fba7885024b38bed11fd59be1c274 P 69d10fe9c342437e82e166e1fae2f373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.445330 11916 tablet_replica.cc:333] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.445799 11916 raft_consensus.cc:2243] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.446230 11916 raft_consensus.cc:2272] T eb2ac6a3f97441fda4fc6b8ebaf77eb2 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.448434 11916 tablet_replica.cc:333] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.449018 11916 raft_consensus.cc:2243] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.449395 11916 raft_consensus.cc:2272] T 6117ae0919d641858d3d0f01771e8235 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.451542 11916 tablet_replica.cc:333] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.452008 11916 raft_consensus.cc:2243] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.452450 11916 raft_consensus.cc:2272] T 5198a48e24f245628c71c2115fdb1c4c P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.454583 11916 tablet_replica.cc:333] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.455052 11916 raft_consensus.cc:2243] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.455899 11916 raft_consensus.cc:2272] T 1a988e71e2184f30b491ca8b79297888 P 69d10fe9c342437e82e166e1fae2f373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.458150 11916 tablet_replica.cc:333] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.458613 11916 raft_consensus.cc:2243] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.459033 11916 raft_consensus.cc:2272] T de9afac631f146f3b6f05430fce53fd8 P 69d10fe9c342437e82e166e1fae2f373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.461112 11916 tablet_replica.cc:333] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.461685 11916 raft_consensus.cc:2243] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.462081 11916 raft_consensus.cc:2272] T 4da28cc087bf4d35987931c43924880b P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.465441 11916 tablet_replica.cc:333] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.465940 11916 raft_consensus.cc:2243] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.466393 11916 raft_consensus.cc:2272] T 761cfccd5770414ca935bda6f6140032 P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.468724 11916 tablet_replica.cc:333] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.469173 11916 raft_consensus.cc:2243] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.469640 11916 raft_consensus.cc:2272] T f983b1b0b120466c8fc0ed57bccc75ea P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.472121 11916 tablet_replica.cc:333] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.472597 11916 raft_consensus.cc:2243] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.473397 11916 raft_consensus.cc:2272] T 4758cb763e4d42a686d2b9980b22cd3c P 69d10fe9c342437e82e166e1fae2f373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.475505 11916 tablet_replica.cc:333] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373: stopping tablet replica
I20260709 12:23:37.476424 11916 raft_consensus.cc:2243] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.477217 11916 raft_consensus.cc:2272] T 40d40f3527564fcf9ae7a26091aadbca P 69d10fe9c342437e82e166e1fae2f373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.521377 11916 tablet_server.cc:196] TabletServer@127.11.163.3:0 shutdown complete.
I20260709 12:23:37.561400 11916 master.cc:562] Master@127.11.163.62:35441 shutting down...
I20260709 12:23:37.584689 11916 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.585314 11916 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.585631 11916 tablet_replica.cc:333] T 00000000000000000000000000000000 P d135a127dc3e42b0a11ed567c60a5ea3: stopping tablet replica
I20260709 12:23:37.610587 11916 master.cc:584] Master@127.11.163.62:35441 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21533 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:23:37.666699 11916 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.163.62:43547
I20260709 12:23:37.668009 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:37.674332 22625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.674333 22624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.675060 22627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:37.676966 11916 server_base.cc:1061] running on GCE node
I20260709 12:23:37.678143 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:37.678330 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:37.678525 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599817678508 us; error 0 us; skew 500 ppm
I20260709 12:23:37.679113 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:37.682017 11916 webserver.cc:533] Webserver started at http://127.11.163.62:36981/ using document root <none> and password file <none>
I20260709 12:23:37.682524 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:37.682714 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:37.683010 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:37.684312 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/master-0-root/instance:
uuid: "3bac7ef92ce54f7196526e68cefc411b"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-z9f9"
I20260709 12:23:37.688707 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:37.692099 22632 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:37.692884 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:37.693171 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/master-0-root
uuid: "3bac7ef92ce54f7196526e68cefc411b"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-z9f9"
I20260709 12:23:37.693467 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:37.704581 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:37.705785 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:37.745096 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.62:43547
I20260709 12:23:37.745214 22683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.62:43547 every 8 connection(s)
I20260709 12:23:37.749023 22684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:37.761569 22684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b: Bootstrap starting.
I20260709 12:23:37.766786 22684 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:37.771274 22684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b: No bootstrap required, opened a new log
I20260709 12:23:37.773583 22684 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bac7ef92ce54f7196526e68cefc411b" member_type: VOTER }
I20260709 12:23:37.774008 22684 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:37.774184 22684 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bac7ef92ce54f7196526e68cefc411b, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.774703 22684 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bac7ef92ce54f7196526e68cefc411b" member_type: VOTER }
I20260709 12:23:37.775111 22684 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:37.775307 22684 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:37.775625 22684 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:37.780647 22684 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bac7ef92ce54f7196526e68cefc411b" member_type: VOTER }
I20260709 12:23:37.781175 22684 leader_election.cc:304] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3bac7ef92ce54f7196526e68cefc411b; no voters: 
I20260709 12:23:37.782351 22684 leader_election.cc:290] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:37.782761 22687 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:37.784415 22687 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [term 1 LEADER]: Becoming Leader. State: Replica: 3bac7ef92ce54f7196526e68cefc411b, State: Running, Role: LEADER
I20260709 12:23:37.785184 22687 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bac7ef92ce54f7196526e68cefc411b" member_type: VOTER }
I20260709 12:23:37.785377 22684 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:37.790838 22689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3bac7ef92ce54f7196526e68cefc411b. Latest consensus state: current_term: 1 leader_uuid: "3bac7ef92ce54f7196526e68cefc411b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bac7ef92ce54f7196526e68cefc411b" member_type: VOTER } }
I20260709 12:23:37.792006 22689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:37.792897 22688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3bac7ef92ce54f7196526e68cefc411b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bac7ef92ce54f7196526e68cefc411b" member_type: VOTER } }
I20260709 12:23:37.793650 22688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:37.795220 22697 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:37.804044 22697 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:37.805176 11916 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:37.813957 22697 catalog_manager.cc:1383] Generated new cluster ID: e3d8f9c9a5dd4f0f873c48ce40033987
I20260709 12:23:37.814224 22697 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:37.836800 22697 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:37.838166 22697 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:37.852665 22697 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b: Generated new TSK 0
I20260709 12:23:37.853332 22697 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:37.871857 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:37.878119 22705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.879212 22706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.881249 22708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:37.881770 11916 server_base.cc:1061] running on GCE node
I20260709 12:23:37.882884 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:37.883122 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:37.883349 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599817883286 us; error 0 us; skew 500 ppm
I20260709 12:23:37.884001 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:37.886420 11916 webserver.cc:533] Webserver started at http://127.11.163.1:44571/ using document root <none> and password file <none>
I20260709 12:23:37.887037 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:37.887252 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:37.887589 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:37.888799 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-0-root/instance:
uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-z9f9"
I20260709 12:23:37.893596 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:23:37.897694 22713 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:37.898582 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:37.898900 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-0-root
uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-z9f9"
I20260709 12:23:37.899206 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:37.912156 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:37.913439 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:37.914968 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:37.917273 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:37.917506 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:37.917742 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:37.917943 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:37.958026 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.1:39535
I20260709 12:23:37.958135 22775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.1:39535 every 8 connection(s)
I20260709 12:23:37.963824 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:37.971220 22780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.972299 22781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:37.975834 11916 server_base.cc:1061] running on GCE node
W20260709 12:23:37.976200 22783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:37.977396 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:37.977528 22776 heartbeater.cc:344] Connected to a master server at 127.11.163.62:43547
W20260709 12:23:37.977749 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:37.977979 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599817977957 us; error 0 us; skew 500 ppm
I20260709 12:23:37.977988 22776 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:37.978818 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:37.979009 22776 heartbeater.cc:507] Master 127.11.163.62:43547 requested a full tablet report, sending...
I20260709 12:23:37.981639 11916 webserver.cc:533] Webserver started at http://127.11.163.2:43423/ using document root <none> and password file <none>
I20260709 12:23:37.981777 22649 ts_manager.cc:194] Registered new tserver with Master: 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535)
I20260709 12:23:37.982259 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:37.982509 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:37.982784 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:37.983932 22649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36380
I20260709 12:23:37.984098 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-1-root/instance:
uuid: "9bdbf13de2db44bfbd10da434b8e6117"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-z9f9"
I20260709 12:23:37.989624 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:23:37.993129 22788 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:37.993868 11916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:37.994192 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-1-root
uuid: "9bdbf13de2db44bfbd10da434b8e6117"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-z9f9"
I20260709 12:23:37.994549 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:38.007712 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:38.009057 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:38.010721 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:38.013195 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:38.013463 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.013733 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:38.013934 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.056852 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.2:34803
I20260709 12:23:38.056983 22850 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.2:34803 every 8 connection(s)
I20260709 12:23:38.062498 11916 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:38.071973 22854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:38.073225 22855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.077239 22851 heartbeater.cc:344] Connected to a master server at 127.11.163.62:43547
W20260709 12:23:38.077092 22857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.077967 22851 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:38.078030 11916 server_base.cc:1061] running on GCE node
I20260709 12:23:38.079188 22851 heartbeater.cc:507] Master 127.11.163.62:43547 requested a full tablet report, sending...
I20260709 12:23:38.079372 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:38.079785 11916 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:38.080013 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783599818079992 us; error 0 us; skew 500 ppm
I20260709 12:23:38.080765 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:38.081779 22649 ts_manager.cc:194] Registered new tserver with Master: 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:38.083482 22649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36394
I20260709 12:23:38.083644 11916 webserver.cc:533] Webserver started at http://127.11.163.3:43295/ using document root <none> and password file <none>
I20260709 12:23:38.084287 11916 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:38.084519 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:38.084883 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:38.086175 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-2-root/instance:
uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-z9f9"
I20260709 12:23:38.091054 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:23:38.094756 22862 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.095819 11916 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:23:38.096180 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-2-root
uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-z9f9"
I20260709 12:23:38.096441 11916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFluxJm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599438829268-11916-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:38.122226 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:38.123657 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:38.125347 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:38.127928 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:38.128182 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.128525 11916 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:38.128715 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.174399 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.163.3:42343
I20260709 12:23:38.174523 22924 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.163.3:42343 every 8 connection(s)
I20260709 12:23:38.188905 22925 heartbeater.cc:344] Connected to a master server at 127.11.163.62:43547
I20260709 12:23:38.189429 22925 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:38.190287 22925 heartbeater.cc:507] Master 127.11.163.62:43547 requested a full tablet report, sending...
I20260709 12:23:38.192595 22649 ts_manager.cc:194] Registered new tserver with Master: 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:38.193670 11916 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016020733s
I20260709 12:23:38.194214 22649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36408
I20260709 12:23:38.221084 22649 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36422:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:38.224195 22649 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:38.303455 22889 tablet_service.cc:1511] Processing CreateTablet for tablet ad6a56d86e434f339eeb079bc2ff5ca2 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:38.303577 22890 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb1f075a92d4c9aa04e85f27c157501 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:38.305158 22890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb1f075a92d4c9aa04e85f27c157501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.305660 22888 tablet_service.cc:1511] Processing CreateTablet for tablet fbaf531a180742fbb42c6df195c1e8d5 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:38.307103 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbaf531a180742fbb42c6df195c1e8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.308543 22741 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb1f075a92d4c9aa04e85f27c157501 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:38.310061 22741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb1f075a92d4c9aa04e85f27c157501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.313692 22887 tablet_service.cc:1511] Processing CreateTablet for tablet 21524c63b92840cd816d9b959ac5bde0 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:38.320441 22737 tablet_service.cc:1511] Processing CreateTablet for tablet c1dd80af53b0476880518a8ba25eb088 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:38.311025 22889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6a56d86e434f339eeb079bc2ff5ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.321906 22737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1dd80af53b0476880518a8ba25eb088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.322069 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21524c63b92840cd816d9b959ac5bde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.316682 22739 tablet_service.cc:1511] Processing CreateTablet for tablet fbaf531a180742fbb42c6df195c1e8d5 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:38.325001 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbaf531a180742fbb42c6df195c1e8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.324641 22886 tablet_service.cc:1511] Processing CreateTablet for tablet c1dd80af53b0476880518a8ba25eb088 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:38.326086 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1dd80af53b0476880518a8ba25eb088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.317974 22738 tablet_service.cc:1511] Processing CreateTablet for tablet 21524c63b92840cd816d9b959ac5bde0 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:38.328881 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21524c63b92840cd816d9b959ac5bde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.329596 22816 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb1f075a92d4c9aa04e85f27c157501 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:38.330971 22816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb1f075a92d4c9aa04e85f27c157501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.318699 22740 tablet_service.cc:1511] Processing CreateTablet for tablet ad6a56d86e434f339eeb079bc2ff5ca2 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:38.332823 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6a56d86e434f339eeb079bc2ff5ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.332654 22815 tablet_service.cc:1511] Processing CreateTablet for tablet ad6a56d86e434f339eeb079bc2ff5ca2 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:38.334026 22815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6a56d86e434f339eeb079bc2ff5ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.335978 22814 tablet_service.cc:1511] Processing CreateTablet for tablet fbaf531a180742fbb42c6df195c1e8d5 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:38.337343 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbaf531a180742fbb42c6df195c1e8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.339648 22736 tablet_service.cc:1511] Processing CreateTablet for tablet 927889582dda463286d54cbc515ab560 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:38.340557 22813 tablet_service.cc:1511] Processing CreateTablet for tablet 21524c63b92840cd816d9b959ac5bde0 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:38.341943 22813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21524c63b92840cd816d9b959ac5bde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.344600 22812 tablet_service.cc:1511] Processing CreateTablet for tablet c1dd80af53b0476880518a8ba25eb088 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:38.346000 22812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1dd80af53b0476880518a8ba25eb088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.340965 22736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927889582dda463286d54cbc515ab560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.356112 22885 tablet_service.cc:1511] Processing CreateTablet for tablet 927889582dda463286d54cbc515ab560 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:38.357112 22811 tablet_service.cc:1511] Processing CreateTablet for tablet 927889582dda463286d54cbc515ab560 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:38.357729 22885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927889582dda463286d54cbc515ab560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.358531 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927889582dda463286d54cbc515ab560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.378516 22735 tablet_service.cc:1511] Processing CreateTablet for tablet 591fe2a214844dfd9b94f5a18c3d1f89 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:38.380086 22735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591fe2a214844dfd9b94f5a18c3d1f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.390834 22810 tablet_service.cc:1511] Processing CreateTablet for tablet 591fe2a214844dfd9b94f5a18c3d1f89 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:38.391975 22889 tablet_service.cc:1511] Processing CreateTablet for tablet 591fe2a214844dfd9b94f5a18c3d1f89 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:38.392334 22810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591fe2a214844dfd9b94f5a18c3d1f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.393309 22889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591fe2a214844dfd9b94f5a18c3d1f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.408313 22734 tablet_service.cc:1511] Processing CreateTablet for tablet f27ff9796a20441faf26a2610cc4e188 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:38.409192 22809 tablet_service.cc:1511] Processing CreateTablet for tablet f27ff9796a20441faf26a2610cc4e188 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:38.409847 22734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27ff9796a20441faf26a2610cc4e188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.410703 22809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27ff9796a20441faf26a2610cc4e188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.430236 22733 tablet_service.cc:1511] Processing CreateTablet for tablet 60582647a2494ea3a12a8a0f46a817a5 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:38.431768 22733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60582647a2494ea3a12a8a0f46a817a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.432737 22940 tablet_bootstrap.cc:492] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:38.434671 22885 tablet_service.cc:1511] Processing CreateTablet for tablet f27ff9796a20441faf26a2610cc4e188 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:38.437347 22885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27ff9796a20441faf26a2610cc4e188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.440001 22940 tablet_bootstrap.cc:654] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.459419 22940 tablet_bootstrap.cc:492] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:38.459991 22940 ts_tablet_manager.cc:1403] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.016s
I20260709 12:23:38.459779 22808 tablet_service.cc:1511] Processing CreateTablet for tablet 60582647a2494ea3a12a8a0f46a817a5 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:38.461202 22808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60582647a2494ea3a12a8a0f46a817a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.463295 22940 raft_consensus.cc:359] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.464130 22940 raft_consensus.cc:385] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.464428 22940 raft_consensus.cc:740] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.465420 22940 consensus_queue.cc:260] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.478060 22940 ts_tablet_manager.cc:1434] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 12:23:38.478821 22925 heartbeater.cc:499] Master 127.11.163.62:43547 was elected leader, sending a full tablet report...
I20260709 12:23:38.480510 22941 tablet_bootstrap.cc:492] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:38.491008 22887 tablet_service.cc:1511] Processing CreateTablet for tablet 60582647a2494ea3a12a8a0f46a817a5 (DEFAULT_TABLE table=test-workload [id=b7480cb9de324228a00c94b489841340]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:38.492549 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60582647a2494ea3a12a8a0f46a817a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.504797 22943 tablet_bootstrap.cc:492] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:38.507489 22940 tablet_bootstrap.cc:492] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:38.513834 22940 tablet_bootstrap.cc:654] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.520121 22941 tablet_bootstrap.cc:654] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.523639 22943 tablet_bootstrap.cc:654] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.534869 22940 tablet_bootstrap.cc:492] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:38.534869 22941 tablet_bootstrap.cc:492] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:38.535015 22943 tablet_bootstrap.cc:492] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:38.535539 22941 ts_tablet_manager.cc:1403] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.000s
I20260709 12:23:38.535562 22940 ts_tablet_manager.cc:1403] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.014s
I20260709 12:23:38.535816 22943 ts_tablet_manager.cc:1403] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.010s
I20260709 12:23:38.538806 22943 raft_consensus.cc:359] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.538807 22940 raft_consensus.cc:359] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:38.539498 22943 raft_consensus.cc:385] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.539268 22941 raft_consensus.cc:359] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.539723 22940 raft_consensus.cc:385] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.539932 22943 raft_consensus.cc:740] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.540097 22941 raft_consensus.cc:385] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.540133 22940 raft_consensus.cc:740] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.540866 22941 raft_consensus.cc:740] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.540915 22943 consensus_queue.cc:260] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.541188 22940 consensus_queue.cc:260] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:38.541713 22941 consensus_queue.cc:260] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.543690 22940 ts_tablet_manager.cc:1434] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:38.545079 22940 tablet_bootstrap.cc:492] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:38.548132 22941 ts_tablet_manager.cc:1434] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.007s
I20260709 12:23:38.549003 22776 heartbeater.cc:499] Master 127.11.163.62:43547 was elected leader, sending a full tablet report...
I20260709 12:23:38.552008 22940 tablet_bootstrap.cc:654] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.553678 22941 tablet_bootstrap.cc:492] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:38.562610 22851 heartbeater.cc:499] Master 127.11.163.62:43547 was elected leader, sending a full tablet report...
I20260709 12:23:38.563222 22943 ts_tablet_manager.cc:1434] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.017s
I20260709 12:23:38.564066 22941 tablet_bootstrap.cc:654] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.564335 22940 tablet_bootstrap.cc:492] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:38.564414 22943 tablet_bootstrap.cc:492] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:38.564963 22940 ts_tablet_manager.cc:1403] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 12:23:38.568984 22940 raft_consensus.cc:359] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.569993 22940 raft_consensus.cc:385] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.570367 22940 raft_consensus.cc:740] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.571382 22943 tablet_bootstrap.cc:654] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.571781 22940 consensus_queue.cc:260] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.574685 22940 ts_tablet_manager.cc:1434] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:23:38.575738 22940 tablet_bootstrap.cc:492] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:38.576342 22941 tablet_bootstrap.cc:492] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:38.576906 22941 ts_tablet_manager.cc:1403] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 12:23:38.580008 22941 raft_consensus.cc:359] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.580760 22941 raft_consensus.cc:385] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.581084 22941 raft_consensus.cc:740] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.582357 22940 tablet_bootstrap.cc:654] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.582039 22941 consensus_queue.cc:260] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.584620 22941 ts_tablet_manager.cc:1434] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:38.585655 22941 tablet_bootstrap.cc:492] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:38.593729 22941 tablet_bootstrap.cc:654] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.594250 22940 tablet_bootstrap.cc:492] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:38.594964 22940 ts_tablet_manager.cc:1403] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.015s
I20260709 12:23:38.598577 22943 tablet_bootstrap.cc:492] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:38.599239 22943 ts_tablet_manager.cc:1403] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.014s
I20260709 12:23:38.600564 22940 raft_consensus.cc:359] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.602331 22940 raft_consensus.cc:385] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.602634 22940 raft_consensus.cc:740] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.602571 22943 raft_consensus.cc:359] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.603511 22941 tablet_bootstrap.cc:492] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:38.603677 22943 raft_consensus.cc:385] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.604130 22941 ts_tablet_manager.cc:1403] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:23:38.603703 22940 consensus_queue.cc:260] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.604300 22943 raft_consensus.cc:740] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.605585 22943 consensus_queue.cc:260] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.606259 22940 ts_tablet_manager.cc:1434] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:38.607359 22940 tablet_bootstrap.cc:492] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:38.608047 22943 ts_tablet_manager.cc:1434] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:38.607671 22941 raft_consensus.cc:359] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:38.608626 22941 raft_consensus.cc:385] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.608943 22941 raft_consensus.cc:740] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.609326 22943 tablet_bootstrap.cc:492] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:38.609833 22941 consensus_queue.cc:260] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:38.612468 22941 ts_tablet_manager.cc:1434] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:38.613395 22941 tablet_bootstrap.cc:492] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:38.614709 22940 tablet_bootstrap.cc:654] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.616874 22943 tablet_bootstrap.cc:654] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.619980 22941 tablet_bootstrap.cc:654] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.627928 22940 tablet_bootstrap.cc:492] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:38.628448 22940 ts_tablet_manager.cc:1403] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.013s
I20260709 12:23:38.628736 22941 tablet_bootstrap.cc:492] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:38.629503 22941 ts_tablet_manager.cc:1403] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:23:38.631632 22940 raft_consensus.cc:359] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.632462 22940 raft_consensus.cc:385] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.632752 22940 raft_consensus.cc:740] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.633471 22941 raft_consensus.cc:359] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.634400 22941 raft_consensus.cc:385] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.634668 22941 raft_consensus.cc:740] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.633556 22940 consensus_queue.cc:260] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.636821 22943 tablet_bootstrap.cc:492] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:38.637468 22943 ts_tablet_manager.cc:1403] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.010s
I20260709 12:23:38.637964 22940 ts_tablet_manager.cc:1434] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:38.639101 22940 tablet_bootstrap.cc:492] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:38.640707 22943 raft_consensus.cc:359] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.641577 22943 raft_consensus.cc:385] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.641927 22943 raft_consensus.cc:740] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.642818 22943 consensus_queue.cc:260] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.645155 22943 ts_tablet_manager.cc:1434] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:38.646272 22943 tablet_bootstrap.cc:492] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:38.646538 22940 tablet_bootstrap.cc:654] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.647747 22941 consensus_queue.cc:260] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.650478 22941 ts_tablet_manager.cc:1434] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:23:38.651558 22941 tablet_bootstrap.cc:492] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:38.653553 22948 raft_consensus.cc:493] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.654492 22943 tablet_bootstrap.cc:654] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.654297 22948 raft_consensus.cc:515] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.658815 22948 leader_election.cc:290] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:38.664036 22948 raft_consensus.cc:493] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.664721 22948 raft_consensus.cc:515] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.673182 22948 leader_election.cc:290] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:38.672382 22941 tablet_bootstrap.cc:654] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:38.678606 22926 tablet.cc:2406] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:38.692016 22940 tablet_bootstrap.cc:492] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:38.692975 22940 ts_tablet_manager.cc:1403] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.008s
I20260709 12:23:38.693986 22943 tablet_bootstrap.cc:492] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:38.694536 22943 ts_tablet_manager.cc:1403] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.007s
I20260709 12:23:38.692039 22941 tablet_bootstrap.cc:492] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:38.695366 22941 ts_tablet_manager.cc:1403] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.006s
I20260709 12:23:38.696970 22940 raft_consensus.cc:359] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.698026 22940 raft_consensus.cc:385] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.698386 22940 raft_consensus.cc:740] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.698716 22941 raft_consensus.cc:359] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.699553 22941 raft_consensus.cc:385] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.699263 22940 consensus_queue.cc:260] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.699919 22941 raft_consensus.cc:740] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.700562 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591fe2a214844dfd9b94f5a18c3d1f89" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:38.701347 22899 raft_consensus.cc:2468] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 0.
I20260709 12:23:38.702232 22940 ts_tablet_manager.cc:1434] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:23:38.702726 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd80af53b0476880518a8ba25eb088" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:38.703526 22940 tablet_bootstrap.cc:492] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:38.703709 22900 raft_consensus.cc:2468] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 0.
I20260709 12:23:38.703451 22941 consensus_queue.cc:260] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.705643 22949 raft_consensus.cc:493] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.706107 22949 raft_consensus.cc:515] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.706362 22790 leader_election.cc:304] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:38.707666 22960 raft_consensus.cc:2804] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:38.708060 22960 raft_consensus.cc:493] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.708382 22960 raft_consensus.cc:3060] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.711985 22940 tablet_bootstrap.cc:654] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.712919 22941 ts_tablet_manager.cc:1434] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:23:38.716732 22790 leader_election.cc:304] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:38.717568 22948 raft_consensus.cc:2804] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:38.717726 22941 tablet_bootstrap.cc:492] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:38.717692 22949 leader_election.cc:290] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:38.718022 22948 raft_consensus.cc:493] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.718559 22948 raft_consensus.cc:3060] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.725167 22941 tablet_bootstrap.cc:654] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.716320 22960 raft_consensus.cc:515] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.731755 22948 raft_consensus.cc:515] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.733747 22960 leader_election.cc:290] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:38.734826 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591fe2a214844dfd9b94f5a18c3d1f89" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:38.735533 22900 raft_consensus.cc:3060] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.737511 22943 raft_consensus.cc:359] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.738574 22943 raft_consensus.cc:385] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.738943 22943 raft_consensus.cc:740] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.742839 22941 tablet_bootstrap.cc:492] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:38.743481 22941 ts_tablet_manager.cc:1403] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.006s
I20260709 12:23:38.745097 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd80af53b0476880518a8ba25eb088" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:38.745787 22899 raft_consensus.cc:3060] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.746824 22941 raft_consensus.cc:359] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.747632 22941 raft_consensus.cc:385] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.747927 22941 raft_consensus.cc:740] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.748800 22941 consensus_queue.cc:260] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.751513 22941 ts_tablet_manager.cc:1434] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:38.752563 22941 tablet_bootstrap.cc:492] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:38.752369 22943 consensus_queue.cc:260] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.754217 22899 raft_consensus.cc:2468] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 1.
I20260709 12:23:38.754782 22943 ts_tablet_manager.cc:1434] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:23:38.755594 22790 leader_election.cc:304] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:38.756398 22944 raft_consensus.cc:493] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.767943 22960 raft_consensus.cc:2804] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:38.768304 22943 tablet_bootstrap.cc:492] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:38.768090 22944 raft_consensus.cc:515] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:38.757989 22900 raft_consensus.cc:2468] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 1.
I20260709 12:23:38.758443 22948 leader_election.cc:290] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:38.762665 22941 tablet_bootstrap.cc:654] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.775182 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591fe2a214844dfd9b94f5a18c3d1f89" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:38.776407 22826 raft_consensus.cc:2393] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51d1d8f8d3fe453e98ec8003d09cf692 in current term 1: Already voted for candidate 9bdbf13de2db44bfbd10da434b8e6117 in this term.
I20260709 12:23:38.763305 22940 tablet_bootstrap.cc:492] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:38.764895 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd80af53b0476880518a8ba25eb088" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:38.765296 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591fe2a214844dfd9b94f5a18c3d1f89" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:38.778792 22750 raft_consensus.cc:2468] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 0.
I20260709 12:23:38.766593 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd80af53b0476880518a8ba25eb088" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:38.766930 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591fe2a214844dfd9b94f5a18c3d1f89" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:38.781152 22748 raft_consensus.cc:3060] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.781884 22944 leader_election.cc:290] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:38.778755 22940 ts_tablet_manager.cc:1403] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.076s	user 0.028s	sys 0.014s
I20260709 12:23:38.782956 22960 raft_consensus.cc:697] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Becoming Leader. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:38.787286 22949 raft_consensus.cc:493] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.787855 22949 raft_consensus.cc:515] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.788115 22960 consensus_queue.cc:237] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.790129 22949 leader_election.cc:290] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:38.778781 22751 raft_consensus.cc:2468] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 0.
I20260709 12:23:38.793462 22940 raft_consensus.cc:359] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.807899 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a56d86e434f339eeb079bc2ff5ca2" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
W20260709 12:23:38.808444 22696 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:38.794986 22940 raft_consensus.cc:385] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.809473 22940 raft_consensus.cc:740] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.810204 22940 consensus_queue.cc:260] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
W20260709 12:23:38.810555 22716 leader_election.cc:343] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:38.812960 22941 tablet_bootstrap.cc:492] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:38.812976 22940 ts_tablet_manager.cc:1434] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:23:38.813649 22941 ts_tablet_manager.cc:1403] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.001s
I20260709 12:23:38.814260 22940 tablet_bootstrap.cc:492] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:38.814783 22748 raft_consensus.cc:2468] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 1.
I20260709 12:23:38.816650 22790 leader_election.cc:304] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:38.817553 22948 raft_consensus.cc:2804] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:38.818022 22948 raft_consensus.cc:697] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Becoming Leader. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:38.820206 22941 raft_consensus.cc:359] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.821045 22941 raft_consensus.cc:385] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.820667 22948 consensus_queue.cc:237] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.821390 22941 raft_consensus.cc:740] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.822350 22941 consensus_queue.cc:260] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.823333 22943 tablet_bootstrap.cc:654] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.824568 22944 raft_consensus.cc:493] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.825127 22944 raft_consensus.cc:515] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.829053 22940 tablet_bootstrap.cc:654] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.832441 22941 ts_tablet_manager.cc:1434] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.007s
I20260709 12:23:38.834157 22941 tablet_bootstrap.cc:492] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:38.832713 22944 leader_election.cc:290] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:38.838804 22944 raft_consensus.cc:493] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.839313 22944 raft_consensus.cc:515] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.841601 22944 leader_election.cc:290] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:38.847999 22941 tablet_bootstrap.cc:654] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.859483 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591fe2a214844dfd9b94f5a18c3d1f89" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:38.859826 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a56d86e434f339eeb079bc2ff5ca2" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:38.860457 22900 raft_consensus.cc:2393] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51d1d8f8d3fe453e98ec8003d09cf692 in current term 1: Already voted for candidate 9bdbf13de2db44bfbd10da434b8e6117 in this term.
I20260709 12:23:38.860652 22899 raft_consensus.cc:2468] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 0.
I20260709 12:23:38.865051 22943 tablet_bootstrap.cc:492] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:38.865638 22943 ts_tablet_manager.cc:1403] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.098s	user 0.028s	sys 0.010s
I20260709 12:23:38.866720 22715 leader_election.cc:304] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:38.868366 22715 leader_election.cc:304] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:38.869091 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:38.869953 22949 raft_consensus.cc:2749] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:38.870651 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21524c63b92840cd816d9b959ac5bde0" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:38.870910 22949 raft_consensus.cc:2804] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:38.871456 22949 raft_consensus.cc:493] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.871949 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927889582dda463286d54cbc515ab560" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:38.872429 22940 tablet_bootstrap.cc:492] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:38.872745 22824 raft_consensus.cc:2468] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
I20260709 12:23:38.872946 22940 ts_tablet_manager.cc:1403] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.001s
I20260709 12:23:38.875921 22940 raft_consensus.cc:359] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.876732 22940 raft_consensus.cc:385] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.876991 22940 raft_consensus.cc:740] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.877888 22940 consensus_queue.cc:260] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.880327 22940 ts_tablet_manager.cc:1434] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:38.880280 22943 raft_consensus.cc:359] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.881232 22943 raft_consensus.cc:385] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.881558 22940 tablet_bootstrap.cc:492] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:38.882249 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:38.882934 22748 raft_consensus.cc:2468] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
I20260709 12:23:38.871953 22949 raft_consensus.cc:3060] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.884315 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21524c63b92840cd816d9b959ac5bde0" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:38.884579 22941 tablet_bootstrap.cc:492] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:38.885083 22941 ts_tablet_manager.cc:1403] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.003s
I20260709 12:23:38.884987 22748 raft_consensus.cc:2468] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
I20260709 12:23:38.886381 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927889582dda463286d54cbc515ab560" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:38.881543 22943 raft_consensus.cc:740] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.887789 22866 leader_election.cc:304] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 
I20260709 12:23:38.888394 22940 tablet_bootstrap.cc:654] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.888968 22974 raft_consensus.cc:2804] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:38.888749 22941 raft_consensus.cc:359] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.889444 22974 raft_consensus.cc:493] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.889915 22974 raft_consensus.cc:3060] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.889127 22648 catalog_manager.cc:5697] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:38.888339 22943 consensus_queue.cc:260] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.892550 22943 ts_tablet_manager.cc:1434] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 12:23:38.893615 22943 tablet_bootstrap.cc:492] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:38.889485 22941 raft_consensus.cc:385] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.894512 22941 raft_consensus.cc:740] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.895263 22941 consensus_queue.cc:260] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.897420 22941 ts_tablet_manager.cc:1434] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 12:23:38.895062 22865 leader_election.cc:343] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:38.899420 22865 leader_election.cc:304] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:38.901593 22944 raft_consensus.cc:493] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.907549 22866 leader_election.cc:304] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 
I20260709 12:23:38.907882 22944 raft_consensus.cc:515] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.910804 22944 leader_election.cc:290] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:38.911638 22944 raft_consensus.cc:2804] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:38.912142 22944 raft_consensus.cc:493] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.912616 22944 raft_consensus.cc:3060] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.919368 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27ff9796a20441faf26a2610cc4e188" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:38.920185 22748 raft_consensus.cc:2468] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
W20260709 12:23:38.920758 22865 leader_election.cc:343] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:38.898353 22941 tablet_bootstrap.cc:492] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:38.906551 22974 raft_consensus.cc:515] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
W20260709 12:23:38.921360 22866 leader_election.cc:343] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:38.920593 22949 raft_consensus.cc:515] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.923314 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27ff9796a20441faf26a2610cc4e188" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:38.904582 22943 tablet_bootstrap.cc:654] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.925854 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a56d86e434f339eeb079bc2ff5ca2" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
W20260709 12:23:38.927794 22716 leader_election.cc:343] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:38.920254 22981 raft_consensus.cc:2804] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:38.923136 22974 leader_election.cc:290] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:38.929212 22981 raft_consensus.cc:493] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.929806 22981 raft_consensus.cc:3060] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.932456 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:38.929332 22949 leader_election.cc:290] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Requested vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:38.933087 22748 raft_consensus.cc:3060] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.933867 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a56d86e434f339eeb079bc2ff5ca2" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:38.934641 22899 raft_consensus.cc:3060] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.930534 22974 raft_consensus.cc:493] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.935513 22974 raft_consensus.cc:515] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.937556 22974 leader_election.cc:290] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:38.938273 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:38.929993 22941 tablet_bootstrap.cc:654] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.940905 22748 raft_consensus.cc:2468] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:38.942476 22866 leader_election.cc:304] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 
I20260709 12:23:38.943544 22974 raft_consensus.cc:2804] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:38.943703 22866 leader_election.cc:304] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 
I20260709 12:23:38.943980 22974 raft_consensus.cc:493] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:38.944322 22865 leader_election.cc:343] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:38.944352 22974 raft_consensus.cc:3060] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:38.955471 22865 leader_election.cc:343] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:38.945459 22940 tablet_bootstrap.cc:492] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:38.945926 22899 raft_consensus.cc:2468] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 1.
I20260709 12:23:38.947678 22943 tablet_bootstrap.cc:492] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:38.970979 22943 ts_tablet_manager.cc:1403] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.000s
I20260709 12:23:38.970293 22985 raft_consensus.cc:2804] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:38.971185 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbaf531a180742fbb42c6df195c1e8d5" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:38.972172 22748 raft_consensus.cc:2468] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
I20260709 12:23:38.973683 22715 leader_election.cc:304] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:38.974887 22949 raft_consensus.cc:2804] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:38.975198 22941 tablet_bootstrap.cc:492] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:38.965502 22974 raft_consensus.cc:515] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.967950 22944 raft_consensus.cc:515] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.967011 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbaf531a180742fbb42c6df195c1e8d5" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:38.976809 22866 leader_election.cc:304] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 
I20260709 12:23:38.976987 22825 raft_consensus.cc:2468] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
I20260709 12:23:38.971230 22940 ts_tablet_manager.cc:1403] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.090s	user 0.028s	sys 0.013s
I20260709 12:23:38.975553 22949 raft_consensus.cc:697] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Becoming Leader. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:38.979331 22949 consensus_queue.cc:237] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.981197 22941 ts_tablet_manager.cc:1403] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.083s	user 0.022s	sys 0.002s
I20260709 12:23:38.980966 22940 raft_consensus.cc:359] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.981668 22940 raft_consensus.cc:385] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.981971 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21524c63b92840cd816d9b959ac5bde0" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:38.982867 22825 raft_consensus.cc:3060] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.979406 22944 leader_election.cc:290] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:38.985136 22944 raft_consensus.cc:2804] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:38.985626 22944 raft_consensus.cc:493] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.986075 22944 raft_consensus.cc:3060] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.974675 22943 raft_consensus.cc:359] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.950906 22981 raft_consensus.cc:515] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.993547 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27ff9796a20441faf26a2610cc4e188" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:38.993993 22943 raft_consensus.cc:385] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.994319 22943 raft_consensus.cc:740] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.993332 22974 leader_election.cc:290] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:38.995102 22943 consensus_queue.cc:260] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.995595 22981 leader_election.cc:290] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
W20260709 12:23:38.995615 22865 leader_election.cc:343] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:38.995838 22941 raft_consensus.cc:359] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:38.996740 22941 raft_consensus.cc:385] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.997120 22941 raft_consensus.cc:740] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.997623 22943 ts_tablet_manager.cc:1434] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 12:23:38.997979 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927889582dda463286d54cbc515ab560" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:38.998571 22824 raft_consensus.cc:3060] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.998736 22943 tablet_bootstrap.cc:492] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:39.001673 22941 consensus_queue.cc:260] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.005628 22941 ts_tablet_manager.cc:1434] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:23:39.008422 22824 raft_consensus.cc:2468] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:38.981966 22940 raft_consensus.cc:740] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.009371 22825 raft_consensus.cc:2468] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:39.011113 22940 consensus_queue.cc:260] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.011967 22865 leader_election.cc:304] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:39.012864 22981 raft_consensus.cc:2804] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.013410 22940 ts_tablet_manager.cc:1434] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 12:23:39.013372 22981 raft_consensus.cc:697] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Leader. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:39.013932 22865 leader_election.cc:304] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:39.014456 22981 consensus_queue.cc:237] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.015164 22974 raft_consensus.cc:2804] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.015699 22974 raft_consensus.cc:697] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Leader. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:39.016587 22974 consensus_queue.cc:237] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.016669 22944 raft_consensus.cc:515] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.018286 22943 tablet_bootstrap.cc:654] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.020471 22944 leader_election.cc:290] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
W20260709 12:23:39.020800 22866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.163.1:39535, user_credentials={real_user=slave}} blocked reactor thread for 44085us
I20260709 12:23:39.021380 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbaf531a180742fbb42c6df195c1e8d5" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:39.022039 22825 raft_consensus.cc:3060] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.021946 22985 raft_consensus.cc:697] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Leader. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:39.023528 22985 consensus_queue.cc:237] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:39.066849 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27ff9796a20441faf26a2610cc4e188" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:39.069051 22751 raft_consensus.cc:3060] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.066972 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21524c63b92840cd816d9b959ac5bde0" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:39.072578 22748 raft_consensus.cc:3060] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.077298 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927889582dda463286d54cbc515ab560" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:39.078720 22749 raft_consensus.cc:3060] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.080309 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbaf531a180742fbb42c6df195c1e8d5" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:39.081395 22750 raft_consensus.cc:3060] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.087047 22645 catalog_manager.cc:5697] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.104669 22949 raft_consensus.cc:493] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.105589 22949 raft_consensus.cc:515] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.110008 22748 raft_consensus.cc:2468] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:39.114531 22751 raft_consensus.cc:2468] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:39.114925 22943 tablet_bootstrap.cc:492] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:39.116261 22943 ts_tablet_manager.cc:1403] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.118s	user 0.028s	sys 0.033s
I20260709 12:23:39.118119 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60582647a2494ea3a12a8a0f46a817a5" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:39.119038 22866 leader_election.cc:304] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 9bdbf13de2db44bfbd10da434b8e6117
W20260709 12:23:39.120563 22716 leader_election.cc:343] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.121731 22949 leader_election.cc:290] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:39.122470 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60582647a2494ea3a12a8a0f46a817a5" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:39.123644 22899 raft_consensus.cc:2468] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 0.
I20260709 12:23:39.121171 22825 raft_consensus.cc:2468] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:39.127243 22715 leader_election.cc:304] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:39.127712 22865 leader_election.cc:304] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:39.129663 22974 raft_consensus.cc:2804] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.130355 22974 raft_consensus.cc:697] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Leader. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:39.130069 22943 raft_consensus.cc:359] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.130831 22981 raft_consensus.cc:2804] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.131722 22981 raft_consensus.cc:697] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Leader. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:39.131160 22943 raft_consensus.cc:385] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.132507 22943 raft_consensus.cc:740] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.132126 22974 consensus_queue.cc:237] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.133486 22949 raft_consensus.cc:2804] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:39.133389 22981 consensus_queue.cc:237] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.136785 22943 consensus_queue.cc:260] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.138201 22750 raft_consensus.cc:2468] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:39.136300 22949 raft_consensus.cc:493] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.139971 22949 raft_consensus.cc:3060] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.140619 22943 ts_tablet_manager.cc:1434] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 12:23:39.142417 22943 tablet_bootstrap.cc:492] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:39.145305 22648 catalog_manager.cc:5697] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.150584 22943 tablet_bootstrap.cc:654] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.149533 22645 catalog_manager.cc:5697] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3). New cstate: current_term: 1 leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.103796 22749 raft_consensus.cc:2468] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:39.184036 22949 raft_consensus.cc:515] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.189388 22949 leader_election.cc:290] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Requested vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:39.190186 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60582647a2494ea3a12a8a0f46a817a5" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:39.189393 22943 tablet_bootstrap.cc:492] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:39.191316 22899 raft_consensus.cc:3060] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.191852 22943 ts_tablet_manager.cc:1403] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.034s
I20260709 12:23:39.194674 22943 raft_consensus.cc:359] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:39.190387 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60582647a2494ea3a12a8a0f46a817a5" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:39.195469 22943 raft_consensus.cc:385] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.195816 22943 raft_consensus.cc:740] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
W20260709 12:23:39.196955 22716 leader_election.cc:343] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.197871 22645 catalog_manager.cc:5697] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3). New cstate: current_term: 1 leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.199852 22645 catalog_manager.cc:5697] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3). New cstate: current_term: 1 leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.201222 22645 catalog_manager.cc:5697] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3). New cstate: current_term: 1 leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.202750 22899 raft_consensus.cc:2468] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 1.
I20260709 12:23:39.202545 22645 catalog_manager.cc:5697] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3). New cstate: current_term: 1 leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.197033 22943 consensus_queue.cc:260] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:39.203951 22715 leader_election.cc:304] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:39.204805 22949 raft_consensus.cc:2804] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.205943 22943 ts_tablet_manager.cc:1434] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:23:39.206274 22949 raft_consensus.cc:697] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Becoming Leader. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:39.207552 22943 tablet_bootstrap.cc:492] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:39.207712 22949 consensus_queue.cc:237] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.214578 22943 tablet_bootstrap.cc:654] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.222118 22943 tablet_bootstrap.cc:492] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:39.222702 22943 ts_tablet_manager.cc:1403] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 12:23:39.221683 22647 catalog_manager.cc:5697] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.226285 22943 raft_consensus.cc:359] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.227154 22943 raft_consensus.cc:385] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.227474 22943 raft_consensus.cc:740] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.228214 22943 consensus_queue.cc:260] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.230358 22943 ts_tablet_manager.cc:1434] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:39.240257 22749 raft_consensus.cc:3060] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.247638 22960 consensus_queue.cc:1048] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:39.254926 22960 consensus_queue.cc:1048] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:39.261066 22968 raft_consensus.cc:493] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.261727 22968 raft_consensus.cc:515] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.265162 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a56d86e434f339eeb079bc2ff5ca2" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:39.268318 22968 leader_election.cc:290] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:39.269232 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a56d86e434f339eeb079bc2ff5ca2" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:39.270326 22900 raft_consensus.cc:2393] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bdbf13de2db44bfbd10da434b8e6117 in current term 1: Already voted for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in this term.
I20260709 12:23:39.271966 22790 leader_election.cc:304] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bdbf13de2db44bfbd10da434b8e6117; no voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:39.273736 22968 raft_consensus.cc:3060] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.291543 22968 raft_consensus.cc:2749] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.304103 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501"
dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
mode: GRACEFUL
new_leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:23:39.304911 22899 raft_consensus.cc:606] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Received request to transfer leadership to TS 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:39.314370 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbaf531a180742fbb42c6df195c1e8d5"
dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
mode: GRACEFUL
new_leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:23:39.314949 22899 raft_consensus.cc:606] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Received request to transfer leadership to TS 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:39.320283 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21524c63b92840cd816d9b959ac5bde0"
dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
mode: GRACEFUL
new_leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:23:39.320837 22899 raft_consensus.cc:606] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Received request to transfer leadership to TS 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:39.328975 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "927889582dda463286d54cbc515ab560"
dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
mode: GRACEFUL
new_leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:23:39.329587 22899 raft_consensus.cc:606] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Received request to transfer leadership to TS 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:39.337738 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f27ff9796a20441faf26a2610cc4e188"
dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
mode: GRACEFUL
new_leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:23:39.338284 22899 raft_consensus.cc:606] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Received request to transfer leadership to TS 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:39.351508 22749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60582647a2494ea3a12a8a0f46a817a5"
dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
mode: GRACEFUL
new_leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:23:39.352064 22749 raft_consensus.cc:606] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Received request to transfer leadership to TS 3f1e22aff4d5421b8edd8514049c2cbd
I20260709 12:23:39.364624 22968 raft_consensus.cc:493] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.365212 22968 raft_consensus.cc:515] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.367105 22968 leader_election.cc:290] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:39.368005 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27ff9796a20441faf26a2610cc4e188" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:39.368258 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27ff9796a20441faf26a2610cc4e188" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:39.368799 22749 raft_consensus.cc:2393] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bdbf13de2db44bfbd10da434b8e6117 in current term 1: Already voted for candidate 3f1e22aff4d5421b8edd8514049c2cbd in this term.
I20260709 12:23:39.369916 22792 leader_election.cc:304] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bdbf13de2db44bfbd10da434b8e6117; no voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:39.370590 22968 raft_consensus.cc:3060] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.376154 22968 raft_consensus.cc:2749] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.434150 22949 consensus_queue.cc:1048] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.436168 22825 raft_consensus.cc:3060] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.437817 22968 consensus_queue.cc:1048] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:39.454970 22949 consensus_queue.cc:1048] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.455097 22981 consensus_queue.cc:1048] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.460391 22981 consensus_queue.cc:1048] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:39.462644 22948 consensus_queue.cc:1048] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.469831 22974 consensus_queue.cc:1048] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.471673 22974 consensus_queue.cc:1048] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.509905 22985 raft_consensus.cc:993] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd: : Instructing follower 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:39.510547 22985 raft_consensus.cc:1081] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Signalling peer 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:39.517131 22747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501"
dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:34672
I20260709 12:23:39.517927 22747 raft_consensus.cc:493] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.518385 22747 raft_consensus.cc:3060] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.523236 22974 raft_consensus.cc:993] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd: : Instructing follower 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:39.523789 22974 raft_consensus.cc:1081] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Signalling peer 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:39.525852 22748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21524c63b92840cd816d9b959ac5bde0"
dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:34672
I20260709 12:23:39.526441 22748 raft_consensus.cc:493] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.526867 22748 raft_consensus.cc:3060] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.534584 22748 raft_consensus.cc:515] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.534724 22747 raft_consensus.cc:515] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:39.537098 22748 leader_election.cc:290] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Requested vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:39.538266 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21524c63b92840cd816d9b959ac5bde0" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:39.538635 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21524c63b92840cd816d9b959ac5bde0" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:39.538957 22826 raft_consensus.cc:3060] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.539270 22899 raft_consensus.cc:3055] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.539640 22899 raft_consensus.cc:740] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:39.540622 22899 consensus_queue.cc:260] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.542061 22899 raft_consensus.cc:3060] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.548142 22747 leader_election.cc:290] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Requested vote from peers 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:39.548905 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:39.549065 22826 raft_consensus.cc:2468] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:39.549269 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:39.549732 22900 raft_consensus.cc:3055] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.549885 22824 raft_consensus.cc:3060] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.550141 22900 raft_consensus.cc:740] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:39.550534 22716 leader_election.cc:304] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:39.551148 22900 consensus_queue.cc:260] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:39.552532 22900 raft_consensus.cc:3060] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.552582 22899 raft_consensus.cc:2468] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:39.551698 23015 raft_consensus.cc:2804] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.554190 23015 raft_consensus.cc:697] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Becoming Leader. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:39.555081 23015 consensus_queue.cc:237] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.559751 22824 raft_consensus.cc:2468] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:39.561273 22716 leader_election.cc:304] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:39.562225 23015 raft_consensus.cc:2804] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.563117 22985 consensus_queue.cc:1048] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:39.563570 22900 raft_consensus.cc:2468] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:39.563055 23015 raft_consensus.cc:697] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Becoming Leader. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:39.565061 23015 consensus_queue.cc:237] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:39.566800 22645 catalog_manager.cc:5697] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 reported cstate change: term changed from 1 to 2, leader changed from 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3) to 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.575115 22974 consensus_queue.cc:1048] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.585383 22944 raft_consensus.cc:993] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd: : Instructing follower 9bdbf13de2db44bfbd10da434b8e6117 to start an election
I20260709 12:23:39.584650 22647 catalog_manager.cc:5697] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 reported cstate change: term changed from 1 to 2, leader changed from 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3) to 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.585959 22944 raft_consensus.cc:1081] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Signalling peer 9bdbf13de2db44bfbd10da434b8e6117 to start an election
I20260709 12:23:39.587960 22824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f27ff9796a20441faf26a2610cc4e188"
dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
 from {username='slave'} at 127.0.0.1:59748
I20260709 12:23:39.588656 22824 raft_consensus.cc:493] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.589046 22824 raft_consensus.cc:3060] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.596616 22824 raft_consensus.cc:515] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.599017 22824 leader_election.cc:290] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 2 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:39.599287 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27ff9796a20441faf26a2610cc4e188" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:39.600014 22747 raft_consensus.cc:3060] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.600430 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27ff9796a20441faf26a2610cc4e188" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:39.601063 22900 raft_consensus.cc:3055] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.601459 22900 raft_consensus.cc:740] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:39.602526 23002 raft_consensus.cc:493] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.603068 23002 raft_consensus.cc:515] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.604174 22900 consensus_queue.cc:260] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.605546 22900 raft_consensus.cc:3060] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.606918 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60582647a2494ea3a12a8a0f46a817a5" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:39.609050 22747 raft_consensus.cc:2468] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 2.
I20260709 12:23:39.609800 23002 leader_election.cc:290] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:39.609648 22974 consensus_queue.cc:1048] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:39.610659 22792 leader_election.cc:304] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:39.610948 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60582647a2494ea3a12a8a0f46a817a5" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:39.611618 23002 raft_consensus.cc:2804] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.611733 22899 raft_consensus.cc:2393] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bdbf13de2db44bfbd10da434b8e6117 in current term 1: Already voted for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in this term.
I20260709 12:23:39.612154 23002 raft_consensus.cc:697] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 LEADER]: Becoming Leader. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:39.613134 22900 raft_consensus.cc:2468] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 2.
I20260709 12:23:39.613052 23002 consensus_queue.cc:237] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.613577 22790 leader_election.cc:304] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bdbf13de2db44bfbd10da434b8e6117; no voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:39.614614 22974 consensus_queue.cc:1048] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:39.614847 22968 raft_consensus.cc:3060] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.623376 22968 raft_consensus.cc:2749] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.622833 22645 catalog_manager.cc:5697] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 reported cstate change: term changed from 1 to 2, leader changed from 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3) to 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2). New cstate: current_term: 2 leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.634311 22974 raft_consensus.cc:993] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd: : Instructing follower 9bdbf13de2db44bfbd10da434b8e6117 to start an election
I20260709 12:23:39.634860 22974 raft_consensus.cc:1081] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Signalling peer 9bdbf13de2db44bfbd10da434b8e6117 to start an election
I20260709 12:23:39.636951 22826 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "927889582dda463286d54cbc515ab560"
dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
 from {username='slave'} at 127.0.0.1:59748
I20260709 12:23:39.638461 22826 raft_consensus.cc:493] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.638864 22826 raft_consensus.cc:3060] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.646416 22826 raft_consensus.cc:515] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.650331 22826 leader_election.cc:290] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 2 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:39.651108 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927889582dda463286d54cbc515ab560" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:39.651767 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927889582dda463286d54cbc515ab560" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:39.651891 22900 raft_consensus.cc:3055] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.652470 22900 raft_consensus.cc:740] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:39.652479 22747 raft_consensus.cc:3060] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.653610 22900 consensus_queue.cc:260] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.655175 22900 raft_consensus.cc:3060] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.660449 22985 consensus_queue.cc:1048] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:39.661727 22747 raft_consensus.cc:2468] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 2.
I20260709 12:23:39.663188 22792 leader_election.cc:304] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:39.663911 22900 raft_consensus.cc:2468] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 2.
I20260709 12:23:39.664338 23002 raft_consensus.cc:2804] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.665257 23002 raft_consensus.cc:697] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 LEADER]: Becoming Leader. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:39.666437 23002 consensus_queue.cc:237] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.674614 22988 consensus_queue.cc:1048] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.682025 22647 catalog_manager.cc:5697] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 reported cstate change: term changed from 1 to 2, leader changed from 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3) to 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2). New cstate: current_term: 2 leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.684115 22988 raft_consensus.cc:993] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd: : Instructing follower 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:39.684691 22988 raft_consensus.cc:1081] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Signalling peer 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:39.686641 22747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbaf531a180742fbb42c6df195c1e8d5"
dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:34672
I20260709 12:23:39.687242 22747 raft_consensus.cc:493] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.687597 22747 raft_consensus.cc:3060] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.694537 22747 raft_consensus.cc:515] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.696781 22747 leader_election.cc:290] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Requested vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:39.698426 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbaf531a180742fbb42c6df195c1e8d5" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:39.699102 22899 raft_consensus.cc:3055] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.699393 22899 raft_consensus.cc:740] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:39.699819 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbaf531a180742fbb42c6df195c1e8d5" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:39.700515 22826 raft_consensus.cc:3060] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.700248 22899 consensus_queue.cc:260] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.701747 22899 raft_consensus.cc:3060] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.710354 22826 raft_consensus.cc:2468] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:39.704005 23015 consensus_queue.cc:1048] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:23:39.711656 22716 leader_election.cc:304] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:39.712612 22949 raft_consensus.cc:2804] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.713133 22949 raft_consensus.cc:697] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Becoming Leader. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:39.713925 22949 consensus_queue.cc:237] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.715555 22899 raft_consensus.cc:2468] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:39.721065 23015 raft_consensus.cc:993] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692: : Instructing follower 3f1e22aff4d5421b8edd8514049c2cbd to start an election
I20260709 12:23:39.721793 22978 raft_consensus.cc:1081] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Signalling peer 3f1e22aff4d5421b8edd8514049c2cbd to start an election
I20260709 12:23:39.725545 22899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60582647a2494ea3a12a8a0f46a817a5"
dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
 from {username='slave'} at 127.0.0.1:60482
I20260709 12:23:39.725227 22647 catalog_manager.cc:5697] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 reported cstate change: term changed from 1 to 2, leader changed from 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3) to 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.726275 22899 raft_consensus.cc:493] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.727288 22899 raft_consensus.cc:3060] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.728041 23015 consensus_queue.cc:1048] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:39.739156 22899 raft_consensus.cc:515] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.745829 22899 leader_election.cc:290] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 2 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:39.746605 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60582647a2494ea3a12a8a0f46a817a5" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:39.747421 22747 raft_consensus.cc:3055] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.747809 22747 raft_consensus.cc:740] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:39.748157 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60582647a2494ea3a12a8a0f46a817a5" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:39.748850 22826 raft_consensus.cc:3060] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.748775 22747 consensus_queue.cc:260] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.750896 22747 raft_consensus.cc:3060] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.757387 22826 raft_consensus.cc:2468] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 2.
I20260709 12:23:39.758846 22747 raft_consensus.cc:2468] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 2.
I20260709 12:23:39.758965 22865 leader_election.cc:304] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:39.759964 22944 raft_consensus.cc:2804] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.760512 22944 raft_consensus.cc:697] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 LEADER]: Becoming Leader. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:39.761461 22944 consensus_queue.cc:237] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:39.768527 22649 catalog_manager.cc:5697] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd reported cstate change: term changed from 1 to 2, leader changed from 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1) to 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3). New cstate: current_term: 2 leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.960074 22899 raft_consensus.cc:1275] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:39.961562 23015 consensus_queue.cc:1048] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.970603 22826 raft_consensus.cc:1275] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:39.971889 22978 consensus_queue.cc:1048] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.012987 22826 raft_consensus.cc:1275] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.013918 22899 raft_consensus.cc:1275] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.014497 22978 consensus_queue.cc:1048] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.015390 23015 consensus_queue.cc:1048] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.038916 22899 raft_consensus.cc:1275] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Refusing update from remote peer 9bdbf13de2db44bfbd10da434b8e6117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.040376 23002 consensus_queue.cc:1048] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.050263 22747 raft_consensus.cc:1275] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Refusing update from remote peer 9bdbf13de2db44bfbd10da434b8e6117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.051775 23002 consensus_queue.cc:1048] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:40.097345 22899 raft_consensus.cc:1275] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.098878 23024 consensus_queue.cc:1048] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.108255 22826 raft_consensus.cc:1275] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.109681 22949 consensus_queue.cc:1048] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.119472 22747 raft_consensus.cc:1275] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Refusing update from remote peer 9bdbf13de2db44bfbd10da434b8e6117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.121090 23002 consensus_queue.cc:1048] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.130014 22899 raft_consensus.cc:1275] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Refusing update from remote peer 9bdbf13de2db44bfbd10da434b8e6117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.132062 22948 consensus_queue.cc:1048] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:40.159955 22747 raft_consensus.cc:1275] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Refusing update from remote peer 3f1e22aff4d5421b8edd8514049c2cbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.161396 22944 consensus_queue.cc:1048] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:40.170367 22826 raft_consensus.cc:1275] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Refusing update from remote peer 3f1e22aff4d5421b8edd8514049c2cbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.172842 22988 consensus_queue.cc:1048] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.382052 22647 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36428:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:42.384573 22647 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:42.437590 22733 tablet_service.cc:1511] Processing CreateTablet for tablet 42b40ea3189a4b4c95d017682ec74f76 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:42.438855 22808 tablet_service.cc:1511] Processing CreateTablet for tablet 42b40ea3189a4b4c95d017682ec74f76 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:42.439319 22733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b40ea3189a4b4c95d017682ec74f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.440500 22808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b40ea3189a4b4c95d017682ec74f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.441136 22887 tablet_service.cc:1511] Processing CreateTablet for tablet 42b40ea3189a4b4c95d017682ec74f76 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:42.442301 22736 tablet_service.cc:1511] Processing CreateTablet for tablet ef42b7fac39244be91146a719d308af8 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:42.442768 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b40ea3189a4b4c95d017682ec74f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.444501 22816 tablet_service.cc:1511] Processing CreateTablet for tablet ef42b7fac39244be91146a719d308af8 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:42.445807 22816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef42b7fac39244be91146a719d308af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.448115 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 297bc3accfda49429011af64238a4d0c (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:42.448818 22885 tablet_service.cc:1511] Processing CreateTablet for tablet ef42b7fac39244be91146a719d308af8 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:42.450070 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 297bc3accfda49429011af64238a4d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.450330 22885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef42b7fac39244be91146a719d308af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.450446 22809 tablet_service.cc:1511] Processing CreateTablet for tablet 297bc3accfda49429011af64238a4d0c (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:42.451905 22809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 297bc3accfda49429011af64238a4d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.452232 22736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef42b7fac39244be91146a719d308af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.463689 22888 tablet_service.cc:1511] Processing CreateTablet for tablet 297bc3accfda49429011af64238a4d0c (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:42.465322 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 297bc3accfda49429011af64238a4d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.467356 22813 tablet_service.cc:1511] Processing CreateTablet for tablet 09d2ab0e748245f99699e553f70a761f (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:42.468873 22813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d2ab0e748245f99699e553f70a761f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.468626 22735 tablet_service.cc:1511] Processing CreateTablet for tablet 09d2ab0e748245f99699e553f70a761f (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:42.470060 22735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d2ab0e748245f99699e553f70a761f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.472952 22889 tablet_service.cc:1511] Processing CreateTablet for tablet 09d2ab0e748245f99699e553f70a761f (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:42.473078 22815 tablet_service.cc:1511] Processing CreateTablet for tablet 6a827d96165945a8a42818cbf38a8d43 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:42.474365 22889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d2ab0e748245f99699e553f70a761f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.474581 22815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a827d96165945a8a42818cbf38a8d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.475473 22886 tablet_service.cc:1511] Processing CreateTablet for tablet 6a827d96165945a8a42818cbf38a8d43 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:42.476868 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a827d96165945a8a42818cbf38a8d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.478341 22741 tablet_service.cc:1511] Processing CreateTablet for tablet 6a827d96165945a8a42818cbf38a8d43 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:42.479233 22812 tablet_service.cc:1511] Processing CreateTablet for tablet a3f0b9bc38d5437791fae720c3c35a8f (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:42.476533 22737 tablet_service.cc:1511] Processing CreateTablet for tablet a3f0b9bc38d5437791fae720c3c35a8f (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:42.480623 22812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f0b9bc38d5437791fae720c3c35a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.481635 22890 tablet_service.cc:1511] Processing CreateTablet for tablet a3f0b9bc38d5437791fae720c3c35a8f (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:42.482928 22890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f0b9bc38d5437791fae720c3c35a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.484683 22814 tablet_service.cc:1511] Processing CreateTablet for tablet bf106763b68f464da34a89f47c6418a1 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:42.486002 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf106763b68f464da34a89f47c6418a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.488142 22738 tablet_service.cc:1511] Processing CreateTablet for tablet d4e89782a92440d1ad37bdab5b84a7de (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:42.488668 22884 tablet_service.cc:1511] Processing CreateTablet for tablet bf106763b68f464da34a89f47c6418a1 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:42.490125 22884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf106763b68f464da34a89f47c6418a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.492764 22741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a827d96165945a8a42818cbf38a8d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.492514 22810 tablet_service.cc:1511] Processing CreateTablet for tablet d4e89782a92440d1ad37bdab5b84a7de (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:42.493883 22810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e89782a92440d1ad37bdab5b84a7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.494935 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e89782a92440d1ad37bdab5b84a7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.496817 22883 tablet_service.cc:1511] Processing CreateTablet for tablet d4e89782a92440d1ad37bdab5b84a7de (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:42.498208 22883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e89782a92440d1ad37bdab5b84a7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.499367 22734 tablet_service.cc:1511] Processing CreateTablet for tablet 7d81d62acc4845b1898ab574f9875e5f (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:42.500681 22734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d81d62acc4845b1898ab574f9875e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.501691 22811 tablet_service.cc:1511] Processing CreateTablet for tablet 7d81d62acc4845b1898ab574f9875e5f (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:42.503036 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d81d62acc4845b1898ab574f9875e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.484617 22740 tablet_service.cc:1511] Processing CreateTablet for tablet bf106763b68f464da34a89f47c6418a1 (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:42.505321 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf106763b68f464da34a89f47c6418a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.507880 22737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f0b9bc38d5437791fae720c3c35a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.509963 22882 tablet_service.cc:1511] Processing CreateTablet for tablet 7d81d62acc4845b1898ab574f9875e5f (DEFAULT_TABLE table=soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:42.511350 22882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d81d62acc4845b1898ab574f9875e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.641772 23038 tablet_bootstrap.cc:492] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:42.658113 23037 tablet_bootstrap.cc:492] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:42.658867 23039 tablet_bootstrap.cc:492] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:42.677894 23038 tablet_bootstrap.cc:654] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.685489 23039 tablet_bootstrap.cc:654] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.684748 23037 tablet_bootstrap.cc:654] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.694741 23039 tablet_bootstrap.cc:492] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:42.695266 23039 ts_tablet_manager.cc:1403] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.003s
I20260709 12:23:42.696290 23037 tablet_bootstrap.cc:492] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:42.696837 23037 ts_tablet_manager.cc:1403] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.003s
I20260709 12:23:42.698815 23039 raft_consensus.cc:359] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.699661 23039 raft_consensus.cc:385] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.699947 23038 tablet_bootstrap.cc:492] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:42.699965 23039 raft_consensus.cc:740] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.700593 23038 ts_tablet_manager.cc:1403] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.007s
I20260709 12:23:42.700968 23039 consensus_queue.cc:260] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.701244 23037 raft_consensus.cc:359] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.701938 23037 raft_consensus.cc:385] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.702236 23037 raft_consensus.cc:740] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.703001 23037 consensus_queue.cc:260] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.703948 23039 ts_tablet_manager.cc:1434] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:42.703997 23038 raft_consensus.cc:359] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.704952 23038 raft_consensus.cc:385] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.705190 23039 tablet_bootstrap.cc:492] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:42.705231 23038 raft_consensus.cc:740] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.706671 23038 consensus_queue.cc:260] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.709327 23038 ts_tablet_manager.cc:1434] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:42.710402 23038 tablet_bootstrap.cc:492] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:42.713930 23039 tablet_bootstrap.cc:654] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.716516 23038 tablet_bootstrap.cc:654] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.723234 23037 ts_tablet_manager.cc:1434] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.003s
I20260709 12:23:42.728266 23037 tablet_bootstrap.cc:492] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:42.733584 23038 tablet_bootstrap.cc:492] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:42.734133 23038 ts_tablet_manager.cc:1403] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.009s
I20260709 12:23:42.737030 23037 tablet_bootstrap.cc:654] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.736860 23038 raft_consensus.cc:359] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.737527 23038 raft_consensus.cc:385] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.737797 23038 raft_consensus.cc:740] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.738221 23039 tablet_bootstrap.cc:492] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:42.738472 23038 consensus_queue.cc:260] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.738787 23039 ts_tablet_manager.cc:1403] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.015s
I20260709 12:23:42.740901 23038 ts_tablet_manager.cc:1434] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:23:42.741883 23038 tablet_bootstrap.cc:492] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:42.742812 23039 raft_consensus.cc:359] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.743877 23039 raft_consensus.cc:385] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.744244 23039 raft_consensus.cc:740] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.745381 23039 consensus_queue.cc:260] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.748394 23039 ts_tablet_manager.cc:1434] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:42.749392 23039 tablet_bootstrap.cc:492] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:42.753624 23038 tablet_bootstrap.cc:654] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.756055 23039 tablet_bootstrap.cc:654] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.759191 23037 tablet_bootstrap.cc:492] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:42.759887 23037 ts_tablet_manager.cc:1403] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.006s
I20260709 12:23:42.764081 23037 raft_consensus.cc:359] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.765121 23037 raft_consensus.cc:385] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.765471 23037 raft_consensus.cc:740] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.766314 23037 consensus_queue.cc:260] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.767524 23038 tablet_bootstrap.cc:492] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:42.767544 23039 tablet_bootstrap.cc:492] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:42.768215 23038 ts_tablet_manager.cc:1403] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.012s
I20260709 12:23:42.768314 23039 ts_tablet_manager.cc:1403] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:23:42.768996 23037 ts_tablet_manager.cc:1434] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.007s
I20260709 12:23:42.770145 23037 tablet_bootstrap.cc:492] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:42.771544 23039 raft_consensus.cc:359] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.772356 23039 raft_consensus.cc:385] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.772660 23039 raft_consensus.cc:740] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.772790 23038 raft_consensus.cc:359] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.773684 23038 raft_consensus.cc:385] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.773478 23039 consensus_queue.cc:260] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.774076 23038 raft_consensus.cc:740] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.775085 23038 consensus_queue.cc:260] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.777874 23037 tablet_bootstrap.cc:654] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.779655 23039 ts_tablet_manager.cc:1434] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 12:23:42.780795 23039 tablet_bootstrap.cc:492] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:42.777544 23038 ts_tablet_manager.cc:1434] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:42.782660 23038 tablet_bootstrap.cc:492] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:42.787472 23040 raft_consensus.cc:493] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.787966 23039 tablet_bootstrap.cc:654] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.788046 23040 raft_consensus.cc:515] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.789675 23038 tablet_bootstrap.cc:654] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.792068 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f0b9bc38d5437791fae720c3c35a8f" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:42.792375 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f0b9bc38d5437791fae720c3c35a8f" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:42.793038 22824 raft_consensus.cc:2468] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 0.
W20260709 12:23:42.794039 22715 leader_election.cc:343] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.795275 22716 leader_election.cc:304] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 3f1e22aff4d5421b8edd8514049c2cbd
I20260709 12:23:42.796216 23024 raft_consensus.cc:2804] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.796656 23024 raft_consensus.cc:493] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.797083 23024 raft_consensus.cc:3060] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.802505 23040 leader_election.cc:290] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:42.817312 23038 tablet_bootstrap.cc:492] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:42.818164 23038 ts_tablet_manager.cc:1403] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.036s	user 0.024s	sys 0.003s
I20260709 12:23:42.822506 23038 raft_consensus.cc:359] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.823529 23038 raft_consensus.cc:385] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.823902 23038 raft_consensus.cc:740] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.825045 23038 consensus_queue.cc:260] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.832783 23038 ts_tablet_manager.cc:1434] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:23:42.834265 23038 tablet_bootstrap.cc:492] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:42.841280 23024 raft_consensus.cc:515] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.843271 23038 tablet_bootstrap.cc:654] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.844695 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f0b9bc38d5437791fae720c3c35a8f" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:42.845592 22824 raft_consensus.cc:3060] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:42.849365 22696 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:42.861907 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f0b9bc38d5437791fae720c3c35a8f" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:42.863770 23025 raft_consensus.cc:493] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.864523 23025 raft_consensus.cc:515] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.869745 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d81d62acc4845b1898ab574f9875e5f" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:42.872704 23025 leader_election.cc:290] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
W20260709 12:23:42.874392 22715 leader_election.cc:343] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.874997 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d81d62acc4845b1898ab574f9875e5f" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
W20260709 12:23:42.874370 22792 leader_election.cc:343] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:42.877368 22790 leader_election.cc:343] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.877920 22790 leader_election.cc:304] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bdbf13de2db44bfbd10da434b8e6117; no voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:42.879513 23036 raft_consensus.cc:2749] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:42.882994 23024 leader_election.cc:290] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Requested vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:42.883960 22824 raft_consensus.cc:2468] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 1.
I20260709 12:23:42.885852 22716 leader_election.cc:304] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 3f1e22aff4d5421b8edd8514049c2cbd
I20260709 12:23:42.887745 23024 raft_consensus.cc:2804] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:42.889364 23024 raft_consensus.cc:697] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Becoming Leader. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:42.890509 23024 consensus_queue.cc:237] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.894635 23037 tablet_bootstrap.cc:492] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:42.895313 23037 ts_tablet_manager.cc:1403] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.125s	user 0.058s	sys 0.027s
I20260709 12:23:42.897050 23039 tablet_bootstrap.cc:492] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:42.897847 23039 ts_tablet_manager.cc:1403] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.117s	user 0.043s	sys 0.044s
I20260709 12:23:42.900650 23038 tablet_bootstrap.cc:492] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:42.901202 23038 ts_tablet_manager.cc:1403] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.039s
I20260709 12:23:42.901137 23039 raft_consensus.cc:359] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.898979 23037 raft_consensus.cc:359] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.903385 23039 raft_consensus.cc:385] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.903695 23037 raft_consensus.cc:385] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.903800 23039 raft_consensus.cc:740] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.904222 23037 raft_consensus.cc:740] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.904428 23038 raft_consensus.cc:359] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.905217 23038 raft_consensus.cc:385] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.904898 23039 consensus_queue.cc:260] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.905586 23038 raft_consensus.cc:740] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.905224 23037 consensus_queue.cc:260] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.905808 22648 catalog_manager.cc:5697] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.906411 23038 consensus_queue.cc:260] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.909154 23038 ts_tablet_manager.cc:1434] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:42.910054 23039 ts_tablet_manager.cc:1434] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.009s
I20260709 12:23:42.910202 23038 tablet_bootstrap.cc:492] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:42.911175 23039 tablet_bootstrap.cc:492] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:42.915441 23037 ts_tablet_manager.cc:1434] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 12:23:42.916548 23037 tablet_bootstrap.cc:492] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:42.917603 23038 tablet_bootstrap.cc:654] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.922201 22988 raft_consensus.cc:493] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.922724 22988 raft_consensus.cc:515] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.924932 22988 leader_election.cc:290] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:42.923017 23039 tablet_bootstrap.cc:654] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.925583 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e89782a92440d1ad37bdab5b84a7de" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:42.926465 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e89782a92440d1ad37bdab5b84a7de" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
W20260709 12:23:42.927214 22866 leader_election.cc:343] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:42.927930 22865 leader_election.cc:343] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.928359 22865 leader_election.cc:304] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd; no voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:42.929432 22988 raft_consensus.cc:2749] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:42.934660 23038 tablet_bootstrap.cc:492] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:42.935012 23037 tablet_bootstrap.cc:654] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.935240 23038 ts_tablet_manager.cc:1403] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 12:23:42.936367 23039 tablet_bootstrap.cc:492] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:42.936923 23039 ts_tablet_manager.cc:1403] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.006s
I20260709 12:23:42.938737 23038 raft_consensus.cc:359] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.940346 23039 raft_consensus.cc:359] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.941164 23038 raft_consensus.cc:385] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.941512 23039 raft_consensus.cc:385] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.941627 23038 raft_consensus.cc:740] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.941939 23039 raft_consensus.cc:740] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.942884 23039 consensus_queue.cc:260] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.945705 23039 ts_tablet_manager.cc:1434] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:42.946686 23039 tablet_bootstrap.cc:492] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:42.942911 23038 consensus_queue.cc:260] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.951869 23038 ts_tablet_manager.cc:1434] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:23:42.953213 23038 tablet_bootstrap.cc:492] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:42.956324 23039 tablet_bootstrap.cc:654] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.960219 23037 tablet_bootstrap.cc:492] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:42.960790 23037 ts_tablet_manager.cc:1403] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.009s
I20260709 12:23:42.961496 23038 tablet_bootstrap.cc:654] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.963996 23037 raft_consensus.cc:359] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.965047 23037 raft_consensus.cc:385] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.965497 23037 raft_consensus.cc:740] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.966405 23037 consensus_queue.cc:260] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.968325 23039 tablet_bootstrap.cc:492] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:42.968861 23039 ts_tablet_manager.cc:1403] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.012s
I20260709 12:23:42.969632 23037 ts_tablet_manager.cc:1434] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:23:42.970798 23037 tablet_bootstrap.cc:492] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:42.971531 23038 tablet_bootstrap.cc:492] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:42.972090 23038 ts_tablet_manager.cc:1403] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:23:42.971939 23039 raft_consensus.cc:359] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.972760 23039 raft_consensus.cc:385] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.973073 23039 raft_consensus.cc:740] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.973948 23039 consensus_queue.cc:260] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.975675 23038 raft_consensus.cc:359] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.976488 23038 raft_consensus.cc:385] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.976506 23039 ts_tablet_manager.cc:1434] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:42.976902 23038 raft_consensus.cc:740] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.977870 23038 consensus_queue.cc:260] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.978974 23037 tablet_bootstrap.cc:654] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.980597 23038 ts_tablet_manager.cc:1434] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:42.981711 23038 tablet_bootstrap.cc:492] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:42.984205 23039 tablet_bootstrap.cc:492] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:42.985176 23037 tablet_bootstrap.cc:492] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:42.985844 23037 ts_tablet_manager.cc:1403] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:23:42.988698 23038 tablet_bootstrap.cc:654] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.990939 23037 raft_consensus.cc:359] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.991956 23037 raft_consensus.cc:385] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.992408 23037 raft_consensus.cc:740] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.992980 23039 tablet_bootstrap.cc:654] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.993618 23037 consensus_queue.cc:260] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:42.997233 23037 ts_tablet_manager.cc:1434] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:43.004806 23036 raft_consensus.cc:493] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.005417 23036 raft_consensus.cc:515] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.006328 23037 tablet_bootstrap.cc:492] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:43.009634 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e89782a92440d1ad37bdab5b84a7de" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:43.010370 22748 raft_consensus.cc:2468] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 0.
I20260709 12:23:43.010412 23036 leader_election.cc:290] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.012109 22792 leader_election.cc:304] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:43.013082 23036 raft_consensus.cc:2804] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.012887 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e89782a92440d1ad37bdab5b84a7de" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:43.013599 23036 raft_consensus.cc:493] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.014051 23036 raft_consensus.cc:3060] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.014576 23037 tablet_bootstrap.cc:654] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.014248 22900 raft_consensus.cc:2468] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 0.
I20260709 12:23:43.024715 23036 raft_consensus.cc:515] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.026614 23037 tablet_bootstrap.cc:492] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:43.026945 23025 raft_consensus.cc:493] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.027292 23037 ts_tablet_manager.cc:1403] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 12:23:43.027766 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e89782a92440d1ad37bdab5b84a7de" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:43.027523 23025 raft_consensus.cc:515] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.028368 22748 raft_consensus.cc:3060] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.029855 23025 leader_election.cc:290] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.026968 23036 leader_election.cc:290] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.031553 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b40ea3189a4b4c95d017682ec74f76" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:43.032725 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b40ea3189a4b4c95d017682ec74f76" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
W20260709 12:23:43.032882 22792 leader_election.cc:343] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.033422 22899 raft_consensus.cc:2468] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 0.
I20260709 12:23:43.033651 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e89782a92440d1ad37bdab5b84a7de" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:43.034368 22900 raft_consensus.cc:3060] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.034966 22790 leader_election.cc:304] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:43.040117 22748 raft_consensus.cc:2468] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 1.
I20260709 12:23:43.041311 23038 tablet_bootstrap.cc:492] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:43.031562 23037 raft_consensus.cc:359] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.041610 22792 leader_election.cc:304] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:43.041850 23037 raft_consensus.cc:385] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.042028 23036 raft_consensus.cc:2804] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.042246 23037 raft_consensus.cc:740] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.042500 23036 raft_consensus.cc:493] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.042771 23036 raft_consensus.cc:3060] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.043126 23037 consensus_queue.cc:260] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.043596 23025 raft_consensus.cc:2804] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.041847 23038 ts_tablet_manager.cc:1403] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.024s
I20260709 12:23:43.049002 23039 tablet_bootstrap.cc:492] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:43.049604 23039 ts_tablet_manager.cc:1403] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.010s
I20260709 12:23:43.050062 23038 raft_consensus.cc:359] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.050676 23038 raft_consensus.cc:385] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.050961 23038 raft_consensus.cc:740] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.051612 23038 consensus_queue.cc:260] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.054307 23037 ts_tablet_manager.cc:1434] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:23:43.055462 23037 tablet_bootstrap.cc:492] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:43.058336 23039 raft_consensus.cc:359] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.059082 23039 raft_consensus.cc:385] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.059381 23039 raft_consensus.cc:740] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.060246 23039 consensus_queue.cc:260] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.060875 23024 raft_consensus.cc:493] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.061398 23024 raft_consensus.cc:515] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.061535 23036 raft_consensus.cc:515] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.063582 23024 leader_election.cc:290] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.065200 22988 raft_consensus.cc:493] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.065757 22988 raft_consensus.cc:515] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.067806 22988 leader_election.cc:290] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:43.065176 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b40ea3189a4b4c95d017682ec74f76" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:43.068727 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a827d96165945a8a42818cbf38a8d43" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:43.068907 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a827d96165945a8a42818cbf38a8d43" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:43.069433 22899 raft_consensus.cc:2468] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 0.
I20260709 12:23:43.069612 22824 raft_consensus.cc:2468] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 0.
I20260709 12:23:43.071247 22716 leader_election.cc:304] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:43.075006 23052 raft_consensus.cc:2804] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.075649 23052 raft_consensus.cc:493] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.076071 23037 tablet_bootstrap.cc:654] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:43.078195 22792 leader_election.cc:343] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.071659 23039 ts_tablet_manager.cc:1434] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:23:43.076064 23052 raft_consensus.cc:3060] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.075099 22900 raft_consensus.cc:2468] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 1.
I20260709 12:23:43.082114 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf106763b68f464da34a89f47c6418a1" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:43.082854 22824 raft_consensus.cc:2468] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
I20260709 12:23:43.086191 22865 leader_election.cc:304] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:43.087040 22988 raft_consensus.cc:2804] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.087414 22988 raft_consensus.cc:493] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.078233 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf106763b68f464da34a89f47c6418a1" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:43.087838 22988 raft_consensus.cc:3060] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.087900 23039 tablet_bootstrap.cc:492] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:43.088027 22748 raft_consensus.cc:2468] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
I20260709 12:23:43.096475 23038 ts_tablet_manager.cc:1434] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.003s
I20260709 12:23:43.097509 23038 tablet_bootstrap.cc:492] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117: Bootstrap starting.
I20260709 12:23:43.099653 22988 raft_consensus.cc:515] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.097879 23025 raft_consensus.cc:697] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Becoming Leader. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:43.103199 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf106763b68f464da34a89f47c6418a1" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:43.104029 22748 raft_consensus.cc:3060] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.104094 23025 consensus_queue.cc:237] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.098752 23036 leader_election.cc:290] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.103364 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf106763b68f464da34a89f47c6418a1" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:43.105870 22824 raft_consensus.cc:3060] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.110051 22988 leader_election.cc:290] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:43.114507 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b40ea3189a4b4c95d017682ec74f76" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:43.115116 22748 raft_consensus.cc:2468] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:43.115226 23037 tablet_bootstrap.cc:492] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:43.116101 23037 ts_tablet_manager.cc:1403] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.014s
I20260709 12:23:43.116436 22866 leader_election.cc:304] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 
I20260709 12:23:43.117372 22988 raft_consensus.cc:2804] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.115252 22900 raft_consensus.cc:3060] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.119506 23024 raft_consensus.cc:493] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.119998 23024 raft_consensus.cc:515] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.120533 22824 raft_consensus.cc:2468] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:43.120992 23038 tablet_bootstrap.cc:654] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.122135 23024 leader_election.cc:290] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.124898 23037 raft_consensus.cc:359] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.126334 23037 raft_consensus.cc:385] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.124648 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297bc3accfda49429011af64238a4d0c" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:43.126714 23037 raft_consensus.cc:740] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.127683 23037 consensus_queue.cc:260] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
W20260709 12:23:43.128309 22715 leader_election.cc:343] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.130570 22900 raft_consensus.cc:2468] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 1.
I20260709 12:23:43.137053 22790 leader_election.cc:304] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:43.118778 23052 raft_consensus.cc:515] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.134222 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297bc3accfda49429011af64238a4d0c" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:43.135144 23065 raft_consensus.cc:493] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.138718 23065 raft_consensus.cc:515] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.139813 22824 raft_consensus.cc:2468] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 0.
I20260709 12:23:43.140980 23065 leader_election.cc:290] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.141593 23065 raft_consensus.cc:2804] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.142062 23065 raft_consensus.cc:697] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Becoming Leader. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:43.142769 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297bc3accfda49429011af64238a4d0c" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:43.142900 23065 consensus_queue.cc:237] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.143519 22716 leader_election.cc:304] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 3f1e22aff4d5421b8edd8514049c2cbd
I20260709 12:23:43.144943 23052 leader_election.cc:290] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Requested vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.145453 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297bc3accfda49429011af64238a4d0c" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:43.143587 22748 raft_consensus.cc:2468] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 0.
I20260709 12:23:43.146528 23052 raft_consensus.cc:2804] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.148351 23052 raft_consensus.cc:493] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.148527 22792 leader_election.cc:304] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:43.148770 23052 raft_consensus.cc:3060] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.149369 22988 raft_consensus.cc:697] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Leader. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
W20260709 12:23:43.150068 22790 leader_election.cc:343] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.150126 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a827d96165945a8a42818cbf38a8d43" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:43.151563 22824 raft_consensus.cc:3060] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.151690 23069 raft_consensus.cc:2804] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.152493 23069 raft_consensus.cc:493] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.152894 23069 raft_consensus.cc:3060] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.153820 23037 ts_tablet_manager.cc:1434] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.037s	user 0.017s	sys 0.001s
I20260709 12:23:43.150825 22988 consensus_queue.cc:237] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.154974 23037 tablet_bootstrap.cc:492] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:43.149104 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a827d96165945a8a42818cbf38a8d43" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:43.156814 23052 raft_consensus.cc:515] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.157816 22900 raft_consensus.cc:3060] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.160828 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297bc3accfda49429011af64238a4d0c" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:43.162598 23052 leader_election.cc:290] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Requested vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.162786 22824 raft_consensus.cc:2468] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 1.
I20260709 12:23:43.163245 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297bc3accfda49429011af64238a4d0c" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:43.164172 22716 leader_election.cc:304] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:43.165241 23052 raft_consensus.cc:2804] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:23:43.165362 22715 leader_election.cc:343] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.166616 23037 tablet_bootstrap.cc:654] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.166538 23052 raft_consensus.cc:697] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Becoming Leader. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:43.167953 23039 tablet_bootstrap.cc:654] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.167649 23052 consensus_queue.cc:237] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.174183 23038 tablet_bootstrap.cc:492] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117: No bootstrap required, opened a new log
I20260709 12:23:43.174705 23038 ts_tablet_manager.cc:1403] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.012s
I20260709 12:23:43.179078 23038 raft_consensus.cc:359] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.179814 23038 raft_consensus.cc:385] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.180101 23038 raft_consensus.cc:740] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.180352 23037 tablet_bootstrap.cc:492] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:43.180878 23038 consensus_queue.cc:260] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.181360 23037 ts_tablet_manager.cc:1403] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 12:23:43.183948 23038 ts_tablet_manager.cc:1434] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:23:43.184489 23037 raft_consensus.cc:359] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.185199 23037 raft_consensus.cc:385] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.185467 23037 raft_consensus.cc:740] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.186146 23037 consensus_queue.cc:260] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.188262 23037 ts_tablet_manager.cc:1434] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:43.187547 22646 catalog_manager.cc:5697] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.188335 22649 catalog_manager.cc:5697] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3). New cstate: current_term: 1 leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.189422 23037 tablet_bootstrap.cc:492] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd: Bootstrap starting.
I20260709 12:23:43.190981 22900 raft_consensus.cc:2468] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 1.
I20260709 12:23:43.191830 22988 raft_consensus.cc:493] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.195225 22988 raft_consensus.cc:515] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.196187 23037 tablet_bootstrap.cc:654] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.198415 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef42b7fac39244be91146a719d308af8" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:43.199164 22748 raft_consensus.cc:2468] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
I20260709 12:23:43.199923 22988 leader_election.cc:290] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:43.193190 23069 raft_consensus.cc:515] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.201086 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef42b7fac39244be91146a719d308af8" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:43.201380 22826 raft_consensus.cc:2393] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 51d1d8f8d3fe453e98ec8003d09cf692 in current term 1: Already voted for candidate 9bdbf13de2db44bfbd10da434b8e6117 in this term.
I20260709 12:23:43.201790 22824 raft_consensus.cc:2468] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
I20260709 12:23:43.203166 22865 leader_election.cc:304] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:43.204159 23039 tablet_bootstrap.cc:492] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:43.204661 23039 ts_tablet_manager.cc:1403] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.005s
I20260709 12:23:43.207584 23039 raft_consensus.cc:359] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.208250 23039 raft_consensus.cc:385] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.208514 23039 raft_consensus.cc:740] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.209227 22716 leader_election.cc:304] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:43.209206 23039 consensus_queue.cc:260] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.210301 23024 raft_consensus.cc:2749] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:43.211330 23039 ts_tablet_manager.cc:1434] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:43.212266 23037 tablet_bootstrap.cc:492] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd: No bootstrap required, opened a new log
I20260709 12:23:43.212700 23039 tablet_bootstrap.cc:492] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692: Bootstrap starting.
I20260709 12:23:43.212775 23037 ts_tablet_manager.cc:1403] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 12:23:43.216418 23037 raft_consensus.cc:359] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.217110 23037 raft_consensus.cc:385] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.217403 23037 raft_consensus.cc:740] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.218160 23037 consensus_queue.cc:260] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.219239 23072 raft_consensus.cc:2804] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.219677 23072 raft_consensus.cc:493] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.219975 23072 raft_consensus.cc:3060] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.220151 23037 ts_tablet_manager.cc:1434] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:43.220265 23039 tablet_bootstrap.cc:654] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.225606 23039 tablet_bootstrap.cc:492] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692: No bootstrap required, opened a new log
I20260709 12:23:43.226122 23039 ts_tablet_manager.cc:1403] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:23:43.229107 23039 raft_consensus.cc:359] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.229084 23072 raft_consensus.cc:515] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.233671 23039 raft_consensus.cc:385] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.234006 23039 raft_consensus.cc:740] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.234819 23039 consensus_queue.cc:260] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.236507 23069 leader_election.cc:290] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.236763 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef42b7fac39244be91146a719d308af8" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:43.237473 22748 raft_consensus.cc:3060] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.238183 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297bc3accfda49429011af64238a4d0c" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:43.239187 22900 raft_consensus.cc:3060] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.240634 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297bc3accfda49429011af64238a4d0c" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:43.241464 22747 raft_consensus.cc:2393] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bdbf13de2db44bfbd10da434b8e6117 in current term 1: Already voted for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in this term.
I20260709 12:23:43.246214 22748 raft_consensus.cc:2468] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:43.242092 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef42b7fac39244be91146a719d308af8" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:43.248023 23072 leader_election.cc:290] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:43.251355 22900 raft_consensus.cc:2468] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 1.
I20260709 12:23:43.248025 22826 raft_consensus.cc:3060] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.248147 22866 leader_election.cc:304] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 
I20260709 12:23:43.257539 23071 raft_consensus.cc:2804] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.258309 23071 raft_consensus.cc:697] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Leader. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:43.259176 23071 consensus_queue.cc:237] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.252260 23039 ts_tablet_manager.cc:1434] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 12:23:43.262036 23024 raft_consensus.cc:493] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.262612 23024 raft_consensus.cc:515] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.266048 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b40ea3189a4b4c95d017682ec74f76" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:43.266453 22790 leader_election.cc:304] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:43.267381 23065 raft_consensus.cc:2804] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.267885 23065 raft_consensus.cc:697] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Becoming Leader. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:43.268988 23024 leader_election.cc:290] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.268711 23065 consensus_queue.cc:237] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.269793 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b40ea3189a4b4c95d017682ec74f76" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:43.269837 22826 raft_consensus.cc:2468] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:43.270735 22899 raft_consensus.cc:2393] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51d1d8f8d3fe453e98ec8003d09cf692 in current term 1: Already voted for candidate 9bdbf13de2db44bfbd10da434b8e6117 in this term.
I20260709 12:23:43.272653 22715 leader_election.cc:304] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:43.266623 22649 catalog_manager.cc:5697] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.273963 23024 raft_consensus.cc:3060] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.274487 22649 catalog_manager.cc:5697] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.276268 23052 raft_consensus.cc:493] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.276995 23052 raft_consensus.cc:515] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.279363 23052 leader_election.cc:290] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.281096 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d2ab0e748245f99699e553f70a761f" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" is_pre_election: true
I20260709 12:23:43.282048 22899 raft_consensus.cc:2468] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 0.
I20260709 12:23:43.283542 22715 leader_election.cc:304] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 
I20260709 12:23:43.284396 23052 raft_consensus.cc:2804] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.284139 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d2ab0e748245f99699e553f70a761f" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:43.284814 23052 raft_consensus.cc:493] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.285205 23052 raft_consensus.cc:3060] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.285315 22824 raft_consensus.cc:2468] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 0.
I20260709 12:23:43.297147 23024 raft_consensus.cc:2749] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:43.297796 23052 raft_consensus.cc:515] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.299904 23052 leader_election.cc:290] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Requested vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:43.300671 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d2ab0e748245f99699e553f70a761f" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:43.300999 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d2ab0e748245f99699e553f70a761f" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:43.301368 22826 raft_consensus.cc:3060] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.301704 22899 raft_consensus.cc:3060] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.301445 22649 catalog_manager.cc:5697] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3). New cstate: current_term: 1 leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.305898 22646 catalog_manager.cc:5697] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2). New cstate: current_term: 1 leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.308037 23071 raft_consensus.cc:493] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.308593 23071 raft_consensus.cc:515] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.308983 22826 raft_consensus.cc:2468] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 1.
I20260709 12:23:43.310305 22716 leader_election.cc:304] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:43.310809 23071 leader_election.cc:290] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:43.311373 23052 raft_consensus.cc:2804] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.312425 23052 raft_consensus.cc:697] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Becoming Leader. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:43.312741 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f0b9bc38d5437791fae720c3c35a8f" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:43.313848 23052 consensus_queue.cc:237] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.316861 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f0b9bc38d5437791fae720c3c35a8f" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:43.319482 22826 raft_consensus.cc:2393] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f1e22aff4d5421b8edd8514049c2cbd in current term 1: Already voted for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in this term.
I20260709 12:23:43.319667 22899 raft_consensus.cc:2468] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 1.
I20260709 12:23:43.321864 22865 leader_election.cc:304] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd; no voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:43.322794 23071 raft_consensus.cc:3060] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.331459 22646 catalog_manager.cc:5697] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1). New cstate: current_term: 1 leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.334841 23071 raft_consensus.cc:2749] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:43.375375 23052 consensus_queue.cc:1048] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.387590 23052 consensus_queue.cc:1048] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.564581 23071 raft_consensus.cc:493] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.565109 23071 raft_consensus.cc:515] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.566937 23071 leader_election.cc:290] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:43.567898 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d81d62acc4845b1898ab574f9875e5f" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" is_pre_election: true
I20260709 12:23:43.568017 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d81d62acc4845b1898ab574f9875e5f" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117" is_pre_election: true
I20260709 12:23:43.568846 22824 raft_consensus.cc:2468] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
I20260709 12:23:43.568846 22748 raft_consensus.cc:2468] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 0.
I20260709 12:23:43.570081 22865 leader_election.cc:304] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:43.570875 23071 raft_consensus.cc:2804] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.571225 23071 raft_consensus.cc:493] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.571595 23071 raft_consensus.cc:3060] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.576192 23052 consensus_queue.cc:1048] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.577545 23071 raft_consensus.cc:515] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.579553 23071 leader_election.cc:290] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:43.580523 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d81d62acc4845b1898ab574f9875e5f" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:43.581414 22748 raft_consensus.cc:3060] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.583693 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d81d62acc4845b1898ab574f9875e5f" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:43.584332 22824 raft_consensus.cc:3060] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.592765 22824 raft_consensus.cc:2468] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:43.593793 22865 leader_election.cc:304] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:43.594700 23071 raft_consensus.cc:2804] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.594873 23024 consensus_queue.cc:1048] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:43.595238 23071 raft_consensus.cc:697] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Leader. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:43.595280 22748 raft_consensus.cc:2468] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 1.
I20260709 12:23:43.596485 23071 consensus_queue.cc:237] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:43.613085 22649 catalog_manager.cc:5697] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3). New cstate: current_term: 1 leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.637682 23065 consensus_queue.cc:1048] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.649655 23065 consensus_queue.cc:1048] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.667784 23071 consensus_queue.cc:1048] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.679596 22988 consensus_queue.cc:1048] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.680740 23071 consensus_queue.cc:1048] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:43.683576 23072 consensus_queue.cc:1048] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.690462 23068 consensus_queue.cc:1048] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:43.718304 23101 consensus_queue.cc:1048] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:43.724342 23102 consensus_queue.cc:1048] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:43.741859 23065 consensus_queue.cc:1048] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.780058 23024 consensus_queue.cc:1048] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.785866 23024 consensus_queue.cc:1048] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.872694 22824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42b40ea3189a4b4c95d017682ec74f76"
dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
mode: GRACEFUL
new_leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:23:43.873258 22824 raft_consensus.cc:606] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Received request to transfer leadership to TS 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:43.879287 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef42b7fac39244be91146a719d308af8"
dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
mode: GRACEFUL
new_leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:23:43.879905 22899 raft_consensus.cc:606] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Received request to transfer leadership to TS 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:43.884913 22824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "297bc3accfda49429011af64238a4d0c"
dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
mode: GRACEFUL
new_leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:23:43.885366 22824 raft_consensus.cc:606] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Received request to transfer leadership to TS 51d1d8f8d3fe453e98ec8003d09cf692
I20260709 12:23:43.892715 22747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a827d96165945a8a42818cbf38a8d43"
dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
mode: GRACEFUL
new_leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:23:43.893293 22747 raft_consensus.cc:606] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Received request to transfer leadership to TS 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:43.899061 22747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3f0b9bc38d5437791fae720c3c35a8f"
dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
mode: GRACEFUL
new_leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:23:43.899763 22747 raft_consensus.cc:606] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Received request to transfer leadership to TS 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:43.904696 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf106763b68f464da34a89f47c6418a1"
dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
mode: GRACEFUL
new_leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:23:43.905119 22899 raft_consensus.cc:606] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Received request to transfer leadership to TS 9bdbf13de2db44bfbd10da434b8e6117
I20260709 12:23:44.011915 23024 raft_consensus.cc:993] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692: : Instructing follower 9bdbf13de2db44bfbd10da434b8e6117 to start an election
I20260709 12:23:44.012409 23090 raft_consensus.cc:1081] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Signalling peer 9bdbf13de2db44bfbd10da434b8e6117 to start an election
I20260709 12:23:44.013978 22824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3f0b9bc38d5437791fae720c3c35a8f"
dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
 from {username='slave'} at 127.0.0.1:59742
I20260709 12:23:44.014467 22824 raft_consensus.cc:493] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:44.014767 22824 raft_consensus.cc:3060] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.020560 22824 raft_consensus.cc:515] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.022570 22824 leader_election.cc:290] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 2 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:44.023240 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f0b9bc38d5437791fae720c3c35a8f" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:44.023759 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f0b9bc38d5437791fae720c3c35a8f" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:44.024432 22899 raft_consensus.cc:3060] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.023984 22747 raft_consensus.cc:3055] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:44.028384 22747 raft_consensus.cc:740] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:44.029181 22747 consensus_queue.cc:260] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.030155 22747 raft_consensus.cc:3060] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.031737 22899 raft_consensus.cc:2468] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 2.
I20260709 12:23:44.032950 22790 leader_election.cc:304] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:44.033708 23065 raft_consensus.cc:2804] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:44.034224 23065 raft_consensus.cc:697] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 LEADER]: Becoming Leader. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:44.035040 23065 consensus_queue.cc:237] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.036334 22747 raft_consensus.cc:2468] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 2.
I20260709 12:23:44.038753 23072 consensus_queue.cc:1048] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:44.045658 22648 catalog_manager.cc:5697] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 reported cstate change: term changed from 1 to 2, leader changed from 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1) to 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2). New cstate: current_term: 2 leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.051985 23071 consensus_queue.cc:1048] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:44.073822 23090 raft_consensus.cc:993] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692: : Instructing follower 9bdbf13de2db44bfbd10da434b8e6117 to start an election
I20260709 12:23:44.074397 23052 raft_consensus.cc:1081] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Signalling peer 9bdbf13de2db44bfbd10da434b8e6117 to start an election
I20260709 12:23:44.076072 22824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a827d96165945a8a42818cbf38a8d43"
dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
 from {username='slave'} at 127.0.0.1:59742
I20260709 12:23:44.076617 22824 raft_consensus.cc:493] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:44.076951 22824 raft_consensus.cc:3060] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.082679 22824 raft_consensus.cc:515] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.084347 22824 leader_election.cc:290] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 2 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:44.085179 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a827d96165945a8a42818cbf38a8d43" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:44.085465 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a827d96165945a8a42818cbf38a8d43" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:44.085942 22748 raft_consensus.cc:3055] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:44.086179 22899 raft_consensus.cc:3060] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.086812 22748 raft_consensus.cc:740] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:44.087764 22748 consensus_queue.cc:260] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.088950 22748 raft_consensus.cc:3060] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.089179 23071 raft_consensus.cc:993] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd: : Instructing follower 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:44.089720 22988 raft_consensus.cc:1081] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Signalling peer 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:44.091363 22747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef42b7fac39244be91146a719d308af8"
dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:34672
I20260709 12:23:44.091992 22747 raft_consensus.cc:493] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:44.092392 22747 raft_consensus.cc:3060] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.092810 22899 raft_consensus.cc:2468] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 2.
I20260709 12:23:44.093849 22790 leader_election.cc:304] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:44.094538 23065 raft_consensus.cc:2804] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:44.095038 23065 raft_consensus.cc:697] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 LEADER]: Becoming Leader. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:44.095917 23065 consensus_queue.cc:237] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.097391 22748 raft_consensus.cc:2468] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 2.
I20260709 12:23:44.100217 22747 raft_consensus.cc:515] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.102594 22747 leader_election.cc:290] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Requested vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:44.103256 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef42b7fac39244be91146a719d308af8" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:44.103916 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef42b7fac39244be91146a719d308af8" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:44.103935 22824 raft_consensus.cc:3060] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.104509 22899 raft_consensus.cc:3055] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:44.104785 22899 raft_consensus.cc:740] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:44.105430 22899 consensus_queue.cc:260] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.106312 22899 raft_consensus.cc:3060] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.106643 22648 catalog_manager.cc:5697] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 reported cstate change: term changed from 1 to 2, leader changed from 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1) to 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2). New cstate: current_term: 2 leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.110756 22824 raft_consensus.cc:2468] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:44.111284 22899 raft_consensus.cc:2468] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:44.112026 22716 leader_election.cc:304] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:44.113013 23052 raft_consensus.cc:2804] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:44.113638 23052 raft_consensus.cc:697] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Becoming Leader. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:44.114449 23052 consensus_queue.cc:237] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.122818 22648 catalog_manager.cc:5697] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 reported cstate change: term changed from 1 to 2, leader changed from 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3) to 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.127363 23065 raft_consensus.cc:993] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117: : Instructing follower 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:44.127998 23102 raft_consensus.cc:1081] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Signalling peer 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:44.129904 22747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "297bc3accfda49429011af64238a4d0c"
dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:34662
I20260709 12:23:44.130452 22747 raft_consensus.cc:493] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:44.130779 22747 raft_consensus.cc:3060] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.137157 22747 raft_consensus.cc:515] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.138816 22747 leader_election.cc:290] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Requested vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:44.139681 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297bc3accfda49429011af64238a4d0c" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:44.139776 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297bc3accfda49429011af64238a4d0c" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:44.140571 22824 raft_consensus.cc:3055] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:44.140650 22899 raft_consensus.cc:3060] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.140858 22824 raft_consensus.cc:740] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:44.141727 22824 consensus_queue.cc:260] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.142666 22824 raft_consensus.cc:3060] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.146278 22899 raft_consensus.cc:2468] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:44.147342 22715 leader_election.cc:304] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 
I20260709 12:23:44.148166 23052 raft_consensus.cc:2804] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:44.148512 22824 raft_consensus.cc:2468] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:44.148877 23052 raft_consensus.cc:697] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Becoming Leader. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:44.149792 23052 consensus_queue.cc:237] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.156432 22648 catalog_manager.cc:5697] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 reported cstate change: term changed from 1 to 2, leader changed from 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2) to 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.280257 23096 raft_consensus.cc:993] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd: : Instructing follower 9bdbf13de2db44bfbd10da434b8e6117 to start an election
I20260709 12:23:44.280700 23096 raft_consensus.cc:1081] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Signalling peer 9bdbf13de2db44bfbd10da434b8e6117 to start an election
I20260709 12:23:44.282176 22824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf106763b68f464da34a89f47c6418a1"
dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
 from {username='slave'} at 127.0.0.1:59748
I20260709 12:23:44.282645 22824 raft_consensus.cc:493] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:44.283001 22824 raft_consensus.cc:3060] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.287979 22824 raft_consensus.cc:515] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.289587 22824 leader_election.cc:290] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 2 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:44.290391 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf106763b68f464da34a89f47c6418a1" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:44.290666 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf106763b68f464da34a89f47c6418a1" candidate_uuid: "9bdbf13de2db44bfbd10da434b8e6117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:44.291069 22747 raft_consensus.cc:3060] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.291203 22899 raft_consensus.cc:3055] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:44.291631 22899 raft_consensus.cc:740] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:44.292397 22899 consensus_queue.cc:260] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.293584 22899 raft_consensus.cc:3060] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.298550 22747 raft_consensus.cc:2468] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 2.
I20260709 12:23:44.300253 22792 leader_election.cc:304] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:44.300730 22899 raft_consensus.cc:2468] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdbf13de2db44bfbd10da434b8e6117 in term 2.
I20260709 12:23:44.301239 23112 raft_consensus.cc:2804] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:44.302030 23112 raft_consensus.cc:697] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 LEADER]: Becoming Leader. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:44.303462 23102 raft_consensus.cc:993] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117: : Instructing follower 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:44.303256 23112 consensus_queue.cc:237] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.303998 23065 raft_consensus.cc:1081] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Signalling peer 51d1d8f8d3fe453e98ec8003d09cf692 to start an election
I20260709 12:23:44.305713 22747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42b40ea3189a4b4c95d017682ec74f76"
dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
 from {username='slave'} at 127.0.0.1:34662
I20260709 12:23:44.306303 22747 raft_consensus.cc:493] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:44.306674 22747 raft_consensus.cc:3060] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.311252 22648 catalog_manager.cc:5697] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 reported cstate change: term changed from 1 to 2, leader changed from 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3) to 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2). New cstate: current_term: 2 leader_uuid: "9bdbf13de2db44bfbd10da434b8e6117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.313306 22747 raft_consensus.cc:515] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.316411 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b40ea3189a4b4c95d017682ec74f76" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:44.316939 22824 raft_consensus.cc:3055] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:44.317148 22747 leader_election.cc:290] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Requested vote from peers 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803), 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3:42343)
I20260709 12:23:44.317220 22824 raft_consensus.cc:740] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:44.318426 22824 consensus_queue.cc:260] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.319814 22824 raft_consensus.cc:3060] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.320451 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b40ea3189a4b4c95d017682ec74f76" candidate_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
I20260709 12:23:44.321105 22900 raft_consensus.cc:3060] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:44.325244 22824 raft_consensus.cc:2468] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:44.326418 22716 leader_election.cc:304] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d1d8f8d3fe453e98ec8003d09cf692, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:44.326495 22900 raft_consensus.cc:2468] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d1d8f8d3fe453e98ec8003d09cf692 in term 2.
I20260709 12:23:44.327262 23052 raft_consensus.cc:2804] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:44.327904 23052 raft_consensus.cc:697] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Becoming Leader. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:44.328639 23052 consensus_queue.cc:237] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:44.335559 22648 catalog_manager.cc:5697] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 reported cstate change: term changed from 1 to 2, leader changed from 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2) to 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1). New cstate: current_term: 2 leader_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.482939 22747 raft_consensus.cc:1275] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Refusing update from remote peer 9bdbf13de2db44bfbd10da434b8e6117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.484524 23112 consensus_queue.cc:1048] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.494220 22900 raft_consensus.cc:1275] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Refusing update from remote peer 9bdbf13de2db44bfbd10da434b8e6117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.496479 23065 consensus_queue.cc:1048] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.539973 22824 raft_consensus.cc:1275] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.541301 23090 consensus_queue.cc:1048] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.550918 22900 raft_consensus.cc:1275] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.553495 23052 consensus_queue.cc:1048] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.582235 22747 raft_consensus.cc:1275] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Refusing update from remote peer 9bdbf13de2db44bfbd10da434b8e6117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.583478 22900 raft_consensus.cc:1275] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.583725 23065 consensus_queue.cc:1048] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.584856 23052 consensus_queue.cc:1048] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.592511 22899 raft_consensus.cc:1275] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Refusing update from remote peer 9bdbf13de2db44bfbd10da434b8e6117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.596923 22826 raft_consensus.cc:1275] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.597205 23102 consensus_queue.cc:1048] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.604995 23052 consensus_queue.cc:1048] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.685597 22747 raft_consensus.cc:1275] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Refusing update from remote peer 9bdbf13de2db44bfbd10da434b8e6117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.686875 23102 consensus_queue.cc:1048] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.694375 22900 raft_consensus.cc:1275] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Refusing update from remote peer 9bdbf13de2db44bfbd10da434b8e6117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.696008 23112 consensus_queue.cc:1048] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.906714 22900 raft_consensus.cc:1275] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.908128 23024 consensus_queue.cc:1048] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.916946 22826 raft_consensus.cc:1275] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Refusing update from remote peer 51d1d8f8d3fe453e98ec8003d09cf692: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:44.920181 23052 consensus_queue.cc:1048] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.914188 22648 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36428:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:23:46.941901 22648 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36428:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:23:46.969256 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:47.161074 23151 tablet.cc:1724] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:47.232846 23155 log.cc:927] Time spent T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
W20260709 12:23:47.234197 23154 log.cc:927] Time spent T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:23:47.233248 23160 tablet.cc:1724] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.237674 23165 tablet.cc:1724] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.181128 23156 tablet.cc:1724] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:47.243409 22792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.163.1:39535, user_credentials={real_user=slave}} blocked reactor thread for 45621.8us
I20260709 12:23:47.278970 23174 tablet.cc:1724] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:47.332957 23162 log.cc:927] Time spent T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:23:47.392518 23190 tablet.cc:1724] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.409248 23151 tablet.cc:1724] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.370842 23176 tablet.cc:1724] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.417241 23190 tablet.cc:1724] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.437744 22747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501"
dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
mode: GRACEFUL
new_leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
 from {username='slave'} at 127.0.0.1:53494
I20260709 12:23:47.438666 22747 raft_consensus.cc:606] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Received request to transfer leadership to TS 3f1e22aff4d5421b8edd8514049c2cbd
I20260709 12:23:47.442714 23183 tablet.cc:1724] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.470971 23165 tablet.cc:1724] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.504678 23153 raft_consensus.cc:993] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692: : Instructing follower 3f1e22aff4d5421b8edd8514049c2cbd to start an election
I20260709 12:23:47.505308 23153 raft_consensus.cc:1081] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Signalling peer 3f1e22aff4d5421b8edd8514049c2cbd to start an election
I20260709 12:23:47.489151 23176 tablet.cc:1724] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.457561 23174 tablet.cc:1724] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.513608 22900 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501"
dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
 from {username='slave'} at 127.0.0.1:60482
I20260709 12:23:47.510149 23188 tablet.cc:1724] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.516410 22900 raft_consensus.cc:493] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:47.517567 22900 raft_consensus.cc:3060] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.485538 23191 tablet.cc:1724] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.521839 23189 tablet.cc:1724] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.523087 23156 tablet.cc:1724] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.535355 22900 raft_consensus.cc:515] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:47.537498 22900 leader_election.cc:290] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 3 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
W20260709 12:23:47.538158 23187 log.cc:927] Time spent T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:47.519495 23192 tablet.cc:1724] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.477254 23160 tablet.cc:1724] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:47.551229 23193 log.cc:927] Time spent T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:23:47.553845 23151 tablet.cc:1724] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.554939 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:47.558533 22826 raft_consensus.cc:3060] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.556396 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb1f075a92d4c9aa04e85f27c157501" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:47.562755 22750 raft_consensus.cc:3055] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.571744 22750 raft_consensus.cc:740] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51d1d8f8d3fe453e98ec8003d09cf692, State: Running, Role: LEADER
I20260709 12:23:47.572578 22750 consensus_queue.cc:260] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:47.573895 22750 raft_consensus.cc:3060] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.572952 23176 tablet.cc:1724] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.574348 22826 raft_consensus.cc:2468] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 3.
I20260709 12:23:47.578476 22865 leader_election.cc:304] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 9bdbf13de2db44bfbd10da434b8e6117; no voters: 
I20260709 12:23:47.584172 23163 raft_consensus.cc:2804] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:47.584792 23163 raft_consensus.cc:697] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 3 LEADER]: Becoming Leader. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:47.585834 23163 consensus_queue.cc:237] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } }
I20260709 12:23:47.592569 22826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1dd80af53b0476880518a8ba25eb088"
dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
mode: GRACEFUL
new_leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
 from {username='slave'} at 127.0.0.1:50904
I20260709 12:23:47.593302 22826 raft_consensus.cc:606] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Received request to transfer leadership to TS 3f1e22aff4d5421b8edd8514049c2cbd
I20260709 12:23:47.594795 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:47.595559 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:47.596320 23165 tablet.cc:1724] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.584564 23174 tablet.cc:1724] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.601560 23188 tablet.cc:1724] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.628253 23192 tablet.cc:1724] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.634415 23165 tablet.cc:1724] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.636545 22649 catalog_manager.cc:5697] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd reported cstate change: term changed from 2 to 3, leader changed from 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1) to 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3). New cstate: current_term: 3 leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:47.645468 23192 tablet.cc:1724] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:47.619186 22750 raft_consensus.cc:2468] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 3.
I20260709 12:23:47.671730 22645 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b: soft_deleted_table [id=bbe02330b6a445dd97b7bd7da3aec042] alter complete (version 1)
I20260709 12:23:47.839411 23169 raft_consensus.cc:993] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117: : Instructing follower 3f1e22aff4d5421b8edd8514049c2cbd to start an election
I20260709 12:23:47.840194 23166 raft_consensus.cc:1081] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Signalling peer 3f1e22aff4d5421b8edd8514049c2cbd to start an election
I20260709 12:23:47.841905 22895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1dd80af53b0476880518a8ba25eb088"
dest_uuid: "3f1e22aff4d5421b8edd8514049c2cbd"
 from {username='slave'} at 127.0.0.1:60472
I20260709 12:23:47.842403 22895 raft_consensus.cc:493] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:47.842757 22895 raft_consensus.cc:3060] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.849261 22895 raft_consensus.cc:515] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:47.850847 22895 leader_election.cc:290] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 2 election: Requested vote from peers 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535), 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803)
I20260709 12:23:47.851639 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd80af53b0476880518a8ba25eb088" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51d1d8f8d3fe453e98ec8003d09cf692"
I20260709 12:23:47.851965 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1dd80af53b0476880518a8ba25eb088" candidate_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bdbf13de2db44bfbd10da434b8e6117"
I20260709 12:23:47.852335 22750 raft_consensus.cc:3060] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.852663 22826 raft_consensus.cc:3055] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.853065 22826 raft_consensus.cc:740] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bdbf13de2db44bfbd10da434b8e6117, State: Running, Role: LEADER
I20260709 12:23:47.853976 22826 consensus_queue.cc:260] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:47.856418 22826 raft_consensus.cc:3060] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.858916 22750 raft_consensus.cc:2468] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 2.
I20260709 12:23:47.860353 22866 leader_election.cc:304] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1e22aff4d5421b8edd8514049c2cbd, 51d1d8f8d3fe453e98ec8003d09cf692; no voters: 
I20260709 12:23:47.861295 23120 raft_consensus.cc:2804] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.861701 23120 raft_consensus.cc:697] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 LEADER]: Becoming Leader. State: Replica: 3f1e22aff4d5421b8edd8514049c2cbd, State: Running, Role: LEADER
I20260709 12:23:47.862496 23120 consensus_queue.cc:237] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } }
I20260709 12:23:47.863307 22826 raft_consensus.cc:2468] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1e22aff4d5421b8edd8514049c2cbd in term 2.
I20260709 12:23:47.870538 22646 catalog_manager.cc:5697] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd reported cstate change: term changed from 1 to 2, leader changed from 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2) to 3f1e22aff4d5421b8edd8514049c2cbd (127.11.163.3). New cstate: current_term: 2 leader_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1e22aff4d5421b8edd8514049c2cbd" member_type: VOTER last_known_addr { host: "127.11.163.3" port: 42343 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:48.127835 22826 raft_consensus.cc:1275] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 3 FOLLOWER]: Refusing update from remote peer 3f1e22aff4d5421b8edd8514049c2cbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:48.129132 23120 consensus_queue.cc:1048] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:48.141160 22750 raft_consensus.cc:1275] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 3 FOLLOWER]: Refusing update from remote peer 3f1e22aff4d5421b8edd8514049c2cbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:48.144585 23120 consensus_queue.cc:1048] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:48.410562 22826 raft_consensus.cc:1275] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Refusing update from remote peer 3f1e22aff4d5421b8edd8514049c2cbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.411767 23120 consensus_queue.cc:1048] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdbf13de2db44bfbd10da434b8e6117" member_type: VOTER last_known_addr { host: "127.11.163.2" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.420804 22750 raft_consensus.cc:1275] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Refusing update from remote peer 3f1e22aff4d5421b8edd8514049c2cbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.422278 23204 consensus_queue.cc:1048] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d1d8f8d3fe453e98ec8003d09cf692" member_type: VOTER last_known_addr { host: "127.11.163.1" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.596781 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:48.602802 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:48.603245 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:49.604570 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:49.612366 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:49.612838 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:50.614043 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:50.620909 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:50.621384 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:51.622434 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:51.627763 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:51.628247 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:52.629361 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:52.635772 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:52.636363 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:53.637563 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:53.643201 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:53.643728 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:54.644773 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:54.650274 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:54.650769 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:55.652092 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:55.658211 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:55.658833 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:56.659991 11916 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:56.665670 11916 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:56.666144 11916 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:57.726944 11916 tablet_server.cc:179] TabletServer@127.11.163.1:0 shutting down...
W20260709 12:23:57.762372 22866 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
W20260709 12:23:57.767972 22866 consensus_peers.cc:597] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd -> Peer 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535): Couldn't send request to peer 51d1d8f8d3fe453e98ec8003d09cf692. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:57.773788 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:23:57.773731 22866 consensus_peers.cc:597] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd -> Peer 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535): Couldn't send request to peer 51d1d8f8d3fe453e98ec8003d09cf692. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:57.774858 11916 tablet_replica.cc:333] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.775854 11916 raft_consensus.cc:2243] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.776976 11916 raft_consensus.cc:2272] T 42b40ea3189a4b4c95d017682ec74f76 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.780103 11916 tablet_replica.cc:333] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.781062 11916 raft_consensus.cc:2243] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.781878 11916 raft_consensus.cc:2272] T d4e89782a92440d1ad37bdab5b84a7de P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.785245 11916 tablet_replica.cc:333] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.786164 11916 raft_consensus.cc:2243] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.786963 11916 raft_consensus.cc:2272] T bf106763b68f464da34a89f47c6418a1 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.789584 11916 tablet_replica.cc:333] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.790279 11916 raft_consensus.cc:2243] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.790880 11916 raft_consensus.cc:2272] T 7d81d62acc4845b1898ab574f9875e5f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.793370 11916 tablet_replica.cc:333] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.794021 11916 raft_consensus.cc:2243] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.795343 11916 raft_consensus.cc:2272] T 09d2ab0e748245f99699e553f70a761f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.799062 11916 tablet_replica.cc:333] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
W20260709 12:23:57.799604 22792 consensus_peers.cc:597] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 -> Peer 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535): Couldn't send request to peer 51d1d8f8d3fe453e98ec8003d09cf692. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:57.799999 11916 raft_consensus.cc:2243] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.800740 11916 raft_consensus.cc:2272] T a3f0b9bc38d5437791fae720c3c35a8f P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.803493 11916 tablet_replica.cc:333] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.804154 11916 raft_consensus.cc:2243] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.805035 11916 raft_consensus.cc:2272] T fbaf531a180742fbb42c6df195c1e8d5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.807446 11916 tablet_replica.cc:333] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.808027 11916 raft_consensus.cc:2243] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.808543 11916 raft_consensus.cc:2272] T c1dd80af53b0476880518a8ba25eb088 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.810832 11916 tablet_replica.cc:333] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.811447 11916 raft_consensus.cc:2243] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.812283 11916 raft_consensus.cc:2272] T ef42b7fac39244be91146a719d308af8 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.814507 11916 tablet_replica.cc:333] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.815117 11916 raft_consensus.cc:2243] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.815642 11916 raft_consensus.cc:2272] T f27ff9796a20441faf26a2610cc4e188 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.818043 11916 tablet_replica.cc:333] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.818615 11916 raft_consensus.cc:2243] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.819105 11916 raft_consensus.cc:2272] T 60582647a2494ea3a12a8a0f46a817a5 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.821395 11916 tablet_replica.cc:333] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.821995 11916 raft_consensus.cc:2243] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.822449 11916 raft_consensus.cc:2272] T 591fe2a214844dfd9b94f5a18c3d1f89 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.824910 11916 tablet_replica.cc:333] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.825491 11916 raft_consensus.cc:2243] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.826417 11916 raft_consensus.cc:2272] T 21524c63b92840cd816d9b959ac5bde0 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.828977 11916 tablet_replica.cc:333] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.829542 11916 raft_consensus.cc:2243] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.830443 11916 raft_consensus.cc:2272] T 297bc3accfda49429011af64238a4d0c P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.832811 11916 tablet_replica.cc:333] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.833364 11916 raft_consensus.cc:2243] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.833873 11916 raft_consensus.cc:2272] T 0cb1f075a92d4c9aa04e85f27c157501 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.836845 11916 tablet_replica.cc:333] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.837476 11916 raft_consensus.cc:2243] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.838671 11916 raft_consensus.cc:2272] T ad6a56d86e434f339eeb079bc2ff5ca2 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.841862 11916 tablet_replica.cc:333] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.842428 11916 raft_consensus.cc:2243] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.842983 11916 raft_consensus.cc:2272] T 6a827d96165945a8a42818cbf38a8d43 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.845342 11916 tablet_replica.cc:333] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692: stopping tablet replica
I20260709 12:23:57.845852 11916 raft_consensus.cc:2243] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.846395 11916 raft_consensus.cc:2272] T 927889582dda463286d54cbc515ab560 P 51d1d8f8d3fe453e98ec8003d09cf692 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.894387 11916 tablet_server.cc:196] TabletServer@127.11.163.1:0 shutdown complete.
I20260709 12:23:57.941190 11916 tablet_server.cc:179] TabletServer@127.11.163.2:0 shutting down...
I20260709 12:23:57.977573 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:57.978411 11916 tablet_replica.cc:333] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:57.979492 11916 raft_consensus.cc:2243] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.980718 11916 raft_consensus.cc:2272] T bf106763b68f464da34a89f47c6418a1 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.984083 11916 tablet_replica.cc:333] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:57.984860 11916 raft_consensus.cc:2243] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:23:57.985535 22792 consensus_peers.cc:597] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 -> Peer 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535): Couldn't send request to peer 51d1d8f8d3fe453e98ec8003d09cf692. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39535: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:57.986266 11916 raft_consensus.cc:2272] T d4e89782a92440d1ad37bdab5b84a7de P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.989018 11916 tablet_replica.cc:333] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:57.989683 11916 raft_consensus.cc:2243] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.990597 11916 raft_consensus.cc:2272] T 6a827d96165945a8a42818cbf38a8d43 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.993094 11916 tablet_replica.cc:333] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:57.993786 11916 raft_consensus.cc:2243] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.994345 11916 raft_consensus.cc:2272] T 42b40ea3189a4b4c95d017682ec74f76 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.997020 11916 tablet_replica.cc:333] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:57.997633 11916 raft_consensus.cc:2243] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.998184 11916 raft_consensus.cc:2272] T 09d2ab0e748245f99699e553f70a761f P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.000607 11916 tablet_replica.cc:333] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.001200 11916 raft_consensus.cc:2243] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.001789 11916 raft_consensus.cc:2272] T 7d81d62acc4845b1898ab574f9875e5f P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.004313 11916 tablet_replica.cc:333] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.004917 11916 raft_consensus.cc:2243] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:58.005786 11916 raft_consensus.cc:2272] T a3f0b9bc38d5437791fae720c3c35a8f P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.008128 11916 tablet_replica.cc:333] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.008714 11916 raft_consensus.cc:2243] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.009209 11916 raft_consensus.cc:2272] T ef42b7fac39244be91146a719d308af8 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.011677 11916 tablet_replica.cc:333] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.012238 11916 raft_consensus.cc:2243] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:58.013118 11916 raft_consensus.cc:2272] T f27ff9796a20441faf26a2610cc4e188 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.015462 11916 tablet_replica.cc:333] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.016033 11916 raft_consensus.cc:2243] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:58.017084 11916 raft_consensus.cc:2272] T 591fe2a214844dfd9b94f5a18c3d1f89 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.020099 11916 tablet_replica.cc:333] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.020759 11916 raft_consensus.cc:2243] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.021330 11916 raft_consensus.cc:2272] T 60582647a2494ea3a12a8a0f46a817a5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:58.022701 22866 consensus_peers.cc:597] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd -> Peer 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535): Couldn't send request to peer 51d1d8f8d3fe453e98ec8003d09cf692. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39535: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:58.024235 11916 tablet_replica.cc:333] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.024824 11916 raft_consensus.cc:2243] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.025261 11916 raft_consensus.cc:2272] T ad6a56d86e434f339eeb079bc2ff5ca2 P 9bdbf13de2db44bfbd10da434b8e6117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.027868 11916 tablet_replica.cc:333] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.028400 11916 raft_consensus.cc:2243] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.028908 11916 raft_consensus.cc:2272] T 297bc3accfda49429011af64238a4d0c P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.031312 11916 tablet_replica.cc:333] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.032004 11916 raft_consensus.cc:2243] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.032541 11916 raft_consensus.cc:2272] T 0cb1f075a92d4c9aa04e85f27c157501 P 9bdbf13de2db44bfbd10da434b8e6117 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.034725 11916 tablet_replica.cc:333] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.035306 11916 raft_consensus.cc:2243] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.035831 11916 raft_consensus.cc:2272] T 21524c63b92840cd816d9b959ac5bde0 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.038097 11916 tablet_replica.cc:333] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.038636 11916 raft_consensus.cc:2243] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.039351 11916 raft_consensus.cc:2272] T fbaf531a180742fbb42c6df195c1e8d5 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.042246 11916 tablet_replica.cc:333] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.042786 11916 raft_consensus.cc:2243] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:58.043879 11916 raft_consensus.cc:2272] T 927889582dda463286d54cbc515ab560 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.046171 11916 tablet_replica.cc:333] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117: stopping tablet replica
I20260709 12:23:58.047041 11916 raft_consensus.cc:2243] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.047574 11916 raft_consensus.cc:2272] T c1dd80af53b0476880518a8ba25eb088 P 9bdbf13de2db44bfbd10da434b8e6117 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:58.090981 22865 consensus_peers.cc:597] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd -> Peer 9bdbf13de2db44bfbd10da434b8e6117 (127.11.163.2:34803): Couldn't send request to peer 9bdbf13de2db44bfbd10da434b8e6117. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.2:34803: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:58.092798 11916 tablet_server.cc:196] TabletServer@127.11.163.2:0 shutdown complete.
W20260709 12:23:58.115906 22866 consensus_peers.cc:597] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd -> Peer 51d1d8f8d3fe453e98ec8003d09cf692 (127.11.163.1:39535): Couldn't send request to peer 51d1d8f8d3fe453e98ec8003d09cf692. Status: Network error: Client connection negotiation failed: client connection to 127.11.163.1:39535: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:58.140502 11916 tablet_server.cc:179] TabletServer@127.11.163.3:0 shutting down...
I20260709 12:23:58.172793 11916 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:58.173641 11916 tablet_replica.cc:333] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.174299 11916 raft_consensus.cc:2243] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.174877 11916 raft_consensus.cc:2272] T 09d2ab0e748245f99699e553f70a761f P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.177320 11916 tablet_replica.cc:333] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.177951 11916 raft_consensus.cc:2243] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:58.178843 11916 raft_consensus.cc:2272] T 7d81d62acc4845b1898ab574f9875e5f P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.181245 11916 tablet_replica.cc:333] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.181869 11916 raft_consensus.cc:2243] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.182367 11916 raft_consensus.cc:2272] T a3f0b9bc38d5437791fae720c3c35a8f P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.184648 11916 tablet_replica.cc:333] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.185238 11916 raft_consensus.cc:2243] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.185755 11916 raft_consensus.cc:2272] T 42b40ea3189a4b4c95d017682ec74f76 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.188194 11916 tablet_replica.cc:333] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.188871 11916 raft_consensus.cc:2243] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.189358 11916 raft_consensus.cc:2272] T d4e89782a92440d1ad37bdab5b84a7de P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.191576 11916 tablet_replica.cc:333] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.192144 11916 raft_consensus.cc:2243] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.192638 11916 raft_consensus.cc:2272] T bf106763b68f464da34a89f47c6418a1 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.195022 11916 tablet_replica.cc:333] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.195784 11916 raft_consensus.cc:2243] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.196334 11916 raft_consensus.cc:2272] T fbaf531a180742fbb42c6df195c1e8d5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.198848 11916 tablet_replica.cc:333] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.199522 11916 raft_consensus.cc:2243] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.200013 11916 raft_consensus.cc:2272] T 6a827d96165945a8a42818cbf38a8d43 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.202203 11916 tablet_replica.cc:333] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.202773 11916 raft_consensus.cc:2243] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.203358 11916 raft_consensus.cc:2272] T ef42b7fac39244be91146a719d308af8 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.205660 11916 tablet_replica.cc:333] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.206223 11916 raft_consensus.cc:2243] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:58.207123 11916 raft_consensus.cc:2272] T 60582647a2494ea3a12a8a0f46a817a5 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.209265 11916 tablet_replica.cc:333] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.209815 11916 raft_consensus.cc:2243] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.210278 11916 raft_consensus.cc:2272] T 591fe2a214844dfd9b94f5a18c3d1f89 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.212569 11916 tablet_replica.cc:333] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.213114 11916 raft_consensus.cc:2243] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.213596 11916 raft_consensus.cc:2272] T f27ff9796a20441faf26a2610cc4e188 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.215678 11916 tablet_replica.cc:333] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.216228 11916 raft_consensus.cc:2243] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.216699 11916 raft_consensus.cc:2272] T 927889582dda463286d54cbc515ab560 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.218780 11916 tablet_replica.cc:333] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.219290 11916 raft_consensus.cc:2243] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:58.220263 11916 raft_consensus.cc:2272] T c1dd80af53b0476880518a8ba25eb088 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.222474 11916 tablet_replica.cc:333] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.223002 11916 raft_consensus.cc:2243] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.223562 11916 raft_consensus.cc:2272] T 21524c63b92840cd816d9b959ac5bde0 P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.225656 11916 tablet_replica.cc:333] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.226183 11916 raft_consensus.cc:2243] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.226691 11916 raft_consensus.cc:2272] T 297bc3accfda49429011af64238a4d0c P 3f1e22aff4d5421b8edd8514049c2cbd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.228825 11916 tablet_replica.cc:333] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.229329 11916 raft_consensus.cc:2243] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:58.230168 11916 raft_consensus.cc:2272] T 0cb1f075a92d4c9aa04e85f27c157501 P 3f1e22aff4d5421b8edd8514049c2cbd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.232374 11916 tablet_replica.cc:333] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd: stopping tablet replica
I20260709 12:23:58.232858 11916 raft_consensus.cc:2243] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.233379 11916 raft_consensus.cc:2272] T ad6a56d86e434f339eeb079bc2ff5ca2 P 3f1e22aff4d5421b8edd8514049c2cbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.276329 11916 tablet_server.cc:196] TabletServer@127.11.163.3:0 shutdown complete.
I20260709 12:23:58.314693 11916 master.cc:562] Master@127.11.163.62:43547 shutting down...
I20260709 12:23:58.340596 11916 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:58.341328 11916 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.341687 11916 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3bac7ef92ce54f7196526e68cefc411b: stopping tablet replica
I20260709 12:23:58.363490 11916 master.cc:584] Master@127.11.163.62:43547 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20755 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (42289 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (399424 ms total)
[  PASSED  ] 8 tests.
I20260709 12:23:58.424634 11916 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2278 messages since previous log ~32 seconds ago
I20260709 12:23:58.424844 11916 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2282 messages since previous log ~32 seconds ago
I20260709 12:23:58.424991 11916 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2282 messages since previous log ~32 seconds ago
I20260709 12:23:58.425148 11916 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:23:58.425302 11916 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:23:58.425465 11916 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~178 seconds ago
I20260709 12:23:58.425688 11916 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 12:23:58.425943 11916 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
